GitHub
@mlc-ai/web-tokenizers
v0.1.5
| [NPM Package](https://www.npmjs.com/package/@mlc-ai/web-tokenizers) | [WebLLM](https://github.com/mlc-ai/web-llm) |
machine_learning
llm
nlp
Readme
Versions
Dependencies
Scripts
Dependencies (0)
No dependencies
Dev dependencies (10)
tslib
eslint
rollup
typescript
@rollup/plugin-wasm
@rollup/plugin-commonjs
@typescript-eslint/parser
rollup-plugin-typescript2
@rollup/plugin-node-resolve
@typescript-eslint/eslint-plugin
npm i @mlc-ai/web-tokenizers
Source Code
github.com/mlc-ai/tokeni...
Homepage
github.com/mlc-ai/tokenizers...
Metadata
Apache-2.0
Whatever
Unknown
released 8/12/2024
Downloads
Downloads Tab Here
Maintainers
rickzx
charliefruan
sudeepag
ruihanglai
tqchen