studyabout.md

배운것 총정리

CNCF

• https://landscape.cncf.io

SFTP

FTP와 SFTP 차이점

SFTP는 ssh 방식으로 암호화 된 FTP SSH랑 같은 포트를 사용하기 때문에 openssh를 설치하면 SFTP도 바로 사용 가능

• 참고: https://medium.com/@labcloud/ssh-암호화-원리-및-aws-ssh-접속-실습-33a08fa76596 https://nhj12311.tistory.com/76
• vscode SFTP 연결: https://poalim.tistory.com/19
• RSA P-key 생성: http://www.fun25.co.kr/blog/ssh-key-setup

DNS

DNS 서버를 바꿔야하는 이유(?)

• 참고: https://www.pcmag.com/how-to/how-and-why-to-change-your-dns-server

  추가자료(서브넷 마스크, 게이트웨이): https://www.netmanias.com/ko/post/blog/5403/ip-ip-routing-network-protocol/subnet-mask-and-default-gateway

HTTP/2

• https://www.digitalocean.com/community/tutorials/http-1-1-vs-http-2-what-s-the-difference
• scrapy http/2 scrapy/scrapy#4769
• fast python requests https://python.plainenglish.io/send-http-requests-as-fast-as-possible-in-python-304134d46604

Python

return과 yield의 차이

Pytest

DB & Server

• ORM: https://dongchans.github.io/2019/28/
• InfluxDB https://dongchans.github.io/2019/28/
• Grafana https://medium.com/finda-tech/grafana란-f3c7c1551c38
• PostgreSQL <>
• Redis <>

Scrapy

관련 Github

• Twisted https://twistedmatrix.com/trac/

async, coroutine

• asyncio https://hamait.tistory.com/834
• asyncio & coroutine https://blog.humminglab.io/python-coroutine-programming-2/
• 동기&비동기, blocking&non-blocking https://velog.io/@wonhee010/동기vs비동기-feat.-blocking-vs-non-blocking
• async event-driven https://niklasjang.tistory.com/57
• aiohttp https://blog.weirdx.io/post/52588 https://item4.blog/2017-11-26/Asynchronous-HTTP-Request-with-aiohttp/

multi threading

multi processing

참고한 github

• https://github.com/coderecode-com/read_csv_excel_into_scrapy
• https://github.com/snutiise/Twitter-Crawler https://snutiise.github.io/twitter-image-crawler/