scrapingnode
v0.3.9 cli command-line ineed scraper scraping web-scraper
scrapingnode
A simple command-line wrapper around ineed.
Installation
npm i -g scrapingnode
Usage:
scrapingnode
Usage: scrapingnode <option> <url>
Option can be one of:
content (which collects content) or
data (which collects links, scripts, etc.) or
code (which collects HTML comments, CSS, and JS)
all (all of the above)
Example: scrapingnode code zacanger.com
You can leave off the https://
/http://
if you want. Or not. Up to you.
You'll get a bunch of stuff you can really easily parse. Nice, huh?
Maybe do something like scrapingnode content blog.zacanger.com > zacs-blog.json
,
or scrapingnode code zacanger.com/p | jq .jsCode
or something.
Contributions welcome.
License: WTFPL.