simplecrawler

v0.3.3
Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend.
crawler spider cache queue simplecrawler eventemitter

Readme Versions Dependencies Scripts

test

mocha -R spec -t 5000
npm i [email protected]

Metadata

  • Unknown
  • >=0.8.0
  • Christopher Giffard
  • released 9/26/2013

Downloads