Skip to content

Latest commit

 

History

History
16 lines (11 loc) · 519 Bytes

README.md

File metadata and controls

16 lines (11 loc) · 519 Bytes

crawler_puppeteer

Crawler for web scraping developed with NodeJS + Puppeteer

How to run?

  • Install node v8.+ (puppeteer needs the most recent node to work properly).
  • Clone this repository and run 'npm install'.
  • Run the crawler using 'node scrape.js' and watch the console messages.
  • The data will be at disposal in the 'newsletters.json' file.
  • OBS: The file 'example.json' contains some data fetched in '24 March 2018'

License

The MIT License (MIT)

Copyright (c) 2018 Bruno Leandro de Lima