simplecrawler

v0.3.14
Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend.
simple crawler spider cache queue simplecrawler eventemitter

Readme Versions Dependencies Scripts

Dependencies (1)

URIjs

Dev dependencies (3)

chai jshint mocha
npm i [email protected]

Metadata

  • Unknown
  • >=0.8.0
  • Christopher Giffard
  • released 4/20/2015

Downloads