tokenizer2

v1.0.0
tokenize any text stream given some basic regex rules to match tokens
tokenizer through stream

Readme Versions Dependencies Scripts
2.0.1 2.0.0 1.2.1 1.2.0 1.1.0 1.0.1 1.0.0
npm i [email protected]

Metadata

  • MIT
  • Whatever
  • smallhelm
  • released 6/17/2015

Downloads

Maintainers