simplecrawler

v0.6.1
Very straightforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend.
simple crawler spider cache queue simplecrawler eventemitter

Readme Versions Dependencies Scripts

Dependencies (2)

iconv-lite urijs

Dev dependencies (3)

chai eslint mocha
npm i [email protected]

Metadata

Downloads