GitHub
simplecrawler
v1.1.3
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
simple
crawler
spider
cache
queue
simplecrawler
eventemitter
Readme
Versions
Dependencies
Scripts
Dependencies (4)
async
iconv-lite
robots-parser
urijs
Dev dependencies (4)
chai
eslint
jsdoc
mocha
npm i
[email protected]
Source Code
github.com/cgiffard/node...
Homepage
github.com/cgiffard/node-sim...
Metadata
BSD-2-Clause
>=0.10.0
Christopher Giffard
released 6/9/2017
Downloads
Downloads Tab Here
Maintainers
cgiffard
fredrikekelund