Skip to content
This repository has been archived by the owner on Jan 18, 2018. It is now read-only.

Latest commit

 

History

History
18 lines (12 loc) · 372 Bytes

README.md

File metadata and controls

18 lines (12 loc) · 372 Bytes

crawler-boxoffice

base crawler for boxoffice

#refer to scrapy official doc http://doc.scrapy.org/en/1.0/intro/tutorial.html#crawling

#TODO:

  • normalize, date, ateend/capacity, shows/sellout, prices, promoters for relational DB
  • switch to django or flask project

#pip req pip install scrapy

#command reference scrapy crawl bo

scrapy crawl bospider -o items.json