Welcome! ๐Ÿ™‹โ€โ™‚๏ธ View more

ec2 3

AWS EC2์™€ Python Selenium ์„ ํ™œ์šฉํ•œ ํ† ์ด ํ”„๋กœ์ ํŠธ ๐Ÿ’ป (feat. ๋ฐฉํƒˆ์ถœ ์ž๋ฆฌ ์ฐพ๊ธฐ!)

ํ•„์ž๋Š” ์ตœ๊ทผ์— AWS Certified Cloud Practitioner ์ž๊ฒฉ์ฆ์„ ์ทจ๋“ํ–ˆ๋‹ค. Data Engineer๊ฐ€ ๋˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ๊ทธ๋“ค์ด ์‚ฌ์šฉํ•˜๋Š” ๊ธฐ๋ณธ์ ์ธ ์–ธ์–ด๋Š” ์•Œ์•„์•ผํ•œ๋‹ค๊ณ  ์ƒ๊ฐํ–ˆ๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค. ํ•ฉ๊ฒฉ์˜ ๊ธฐ์จ๋„ ์ž ์‹œ, ์ž๊ฒฉ์ฆ๋„ ์ทจ๋“ํ–ˆ์œผ๋‹ˆ ๋ณธ๊ฒฉ์ ์œผ๋กœ AWS๋ฅผ ์‹ค์งˆ์ ์œผ๋กœ ์‚ฌ์šฉํ•ด๋ณด๊ธฐ๋กœ ๋‹ค์งํ–ˆ๋‹ค! 1. ํ”„๋กœ์ ํŠธ ์ฃผ์ œ ์ •ํ•˜๊ธฐ ํ•„์ž๋Š” ๋ฐฉํƒˆ์ถœ ์ทจ๋ฏธ๋กœ ์ฆ๊ธด๋‹ค. ์ทจ์ง ํ›„ ์ƒ๊ฒฝํ•˜์—ฌ ์œ ๋ช…ํ•˜๋‹ค๋Š” ๋ฐฉํƒˆ์ถœ์€ ๋Œ€๋ถ€๋ถ„ ํ•ด๋ดค๋‹ค. ํ•˜์ง€๋งŒ ์˜ˆ์•ฝ์กฐ์ฐจํ•˜๊ธฐ ํž˜๋“  ์œ ๋ช…ํ•œ ๋ฐฉํƒˆ์ถœ ํ…Œ๋งˆ๊ฐ€ ์žˆ๋Š”๋ฐ ๊ทธ๊ฒƒ์€ ๋ฐ”๋กœ ํ™๋Œ€ ๋ฆฌ์ฝ”๋”์˜ "Tempo Rubato"์ด๋‹ค. ๋”ฐ๋ผ์„œ ๋‘ ๋‹ฌ ์‚ฌ์ด์— ์ทจ์†Œ๋˜๋Š” ์‹œ๊ฐ„์ด ์žˆ๋Š”์ง€ ํ™•์ธํ•ด์„œ ์žˆ๋‹ค๋ฉด ๊ทธ ์ •๋ณด๋ฅผ ๋ฉ”์ผ์„ ์ „์†กํ•˜๋Š” ํ”„๋กœ์ ํŠธ๋ฅผ ๊ธฐํšํ–ˆ๋‹ค. ํ”„๋กœ์ ํŠธ ์ฃผ์ œ๋ฅผ ์„ ์ •ํ•˜๋Š” ๋ฐ ์žˆ์–ด์„œ ์•„๋ž˜์™€ ๊ฐ™์€ ์ ์„ ๊ณ ๋ คํ–ˆ๋‹ค. 1. 24์‹œ๊ฐ„ ๋Œ์•„๊ฐ€์•ผ..

ํ„ฐ๋ฏธ๋„ ์ข…๋ฃŒ ํ›„์—๋„ ํ”„๋กœ์„ธ์Šค ์‹คํ–‰ (feat. Selenium ์ž‘๋™์‹œ ์œ ์˜์‚ฌํ•ญ)

ํ•˜๋ฃจ์ข…์ผ ์‹คํ–‰ํ•ด์•ผํ•  ์Šคํฌ๋ฆฝํŠธ๊ฐ€ ์žˆ์–ด ํ”„๋กœ์„ธ์Šค๋ฅผ ๋ฐฑ๊ทธ๋ผ์šด๋“œ๋กœ ๋Œ๋ ค์•ผํ–ˆ๋‹ค.์•„๋ž˜์™€ ๊ฐ™์ด nohup์„ ์‚ฌ์šฉํ•˜๋ฉด ๊ฐ€๋Šฅํ•˜๋‹ค.nohup python3 MyScript.py &nohup python3 MyScript.py > /dev/null 2>&1 & #ํ‘œ์ค€์ถœ๋ ฅ์„ ์„ค์ •ํ•˜์ง€ ์•Š์„ ๋•Œnohup python3 MyScript.py > /tmp/nohup.log 2>&1 & #/tmp/nohup.log๋กœ ์ €์žฅํ•  ๋•Œnohup python3 -u MyScript.py #printํ•œ ๋‚ด์šฉ์„ ๋กœ๊ทธํŒŒ์ผ์— ํฌํ•จํ•˜๊ณ  ์‹ถ์„ ๋•Œ์ข…๋ฃŒ ๋ฐฉ๋ฒ•์€ ์•„๋ž˜์™€ ๊ฐ™๋‹ค.ps -ef | grep ์Šคํฌ๋ฆฝํŠธ๋ช… # PID(์ฒซ๋ฒˆ์งธ๋กœ ๋‚˜์˜ค๋Š” ์ˆซ์ž) ํ™•์ธkill -9 PID # ๋ฐฑํ”„๋กœ์„ธ์Šค ์‚ญ์ œ ์ข€ ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์€ ์•„๋ž˜๋ฅผ ์ฐธ๊ณ !https://joonyon.tisto..

์ตœ์ดˆ EC2์— PIP ์„ค์น˜

EC2 ์ตœ์ดˆ ๊ฐœ์„ค ํ›„ PIP ์„ค์น˜์‹œ ์•„๋ž˜ ์—๋Ÿฌ๊ฐ€ ๋‚˜ํƒ€๋‚  ์ˆ˜ ์žˆ๋‹ค.$ Unable to locate package python3-pip $ Package 'python3-pip' has no installation candidate ๊ทธ๋Ÿด๋•Œ ์•„๋ž˜์™€ ๊ฐ™์ด ์‹œ๋„ํ•ด๋ณด์ž. ๐Ÿค—$ sudo apt update$ sudo apt upgrade$ sudo apt install python3-pip