simplecrawler

v1.0.1
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
simple crawler spider cache queue simplecrawler eventemitter

Readme Versions Dependencies Scripts

lint

eslint example/ lib/ test/

mocha

mocha -R spec -t 5000

test

npm run lint && npm run mocha

docs

jsdoc -c jsdoc.json
npm i [email protected]

Metadata

Downloads