Skip to content

Web crawler to get the latest image form on Indonesia Election 2024

License

Notifications You must be signed in to change notification settings

SteveImmanuel/pemilu-2024-crawl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pemilu 2024 Image Crawler

Installation

pip install -r requirements.txt
playwright install chromium

Usage

Basic:

python main.py

Advanced:

python main.py -h
usage: main.py [-h] [--start-url START_URL] [--output OUTPUT] [--timeout TIMEOUT] [--workers WORKERS] [--headless]
               [--resume]

Indonesia Pemilu 2024 Scraper

options:
  -h, --help            show this help message and exit
  --start-url START_URL
                        Starting url. Base is https://pemilu2024.kpu.go.id
  --output OUTPUT       Output directory
  --timeout TIMEOUT     Timeout for each request
  --workers WORKERS     Total concurrent workers
  --headless            Run in headless mode
  --resume              Resume previous session if available

About

Web crawler to get the latest image form on Indonesia Election 2024

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages