simplecrawler

v1.1.9
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
simple crawler spider cache queue simplecrawler eventemitter

Readme Versions Dependencies Scripts

lint

eslint example/ lib/ test/

mocha

mocha -t 5000 --exit

test

npm run lint && npm run mocha

docs

jsdoc2md -t jsdoc2md/README.hbs --partial jsdoc2md/*.hbs --files lib/*.js > README.md
npm i simplecrawler

Metadata

Downloads