Skip to content
This repository has been archived by the owner on Jul 8, 2021. It is now read-only.

Latest commit

 

History

History
21 lines (13 loc) · 533 Bytes

README.md

File metadata and controls

21 lines (13 loc) · 533 Bytes

###Clrawler

The Skipper: Kowalski, status report.

Kowalski: I'm randomly pushing buttons while we spin out of control, Skipper.

The Skipper: Can I push one? I might feel better.

There is code for CasperJS (a wrapper over PhantomJS). With a working example.

  • basespider.js abstract basespider
  • spider.js the main file
  • spiders/example.js an examle script for a site

You can use command like this to run

1| $ casperjs spider.js --spider = spider_name --imagedir = /path/to/the/dir