This repo contains a full-fledged Python-based script that scrapes a JavaScript-rendered website, cleans the data, and pushes the results to a cloud-based database. The workflow is orchestrated on Airflow to run automatically

This repo contains a scraping script that crawls a JavaScript-rendered website using the scrapy-playwright package in Python and the scrapy framework

This repo contains a Python script that opens the website of LATAM airlines, inputs some parameters in the flight search fields and scrapes some data off of the page using Python selenium