GitHub
unitoken
v0.0.1
Universal tokenizer in pure javascript
Readme
Versions
Dependencies
Scripts
Dependencies (1)
js-tiktoken
Dev dependencies (15)
@antfu/eslint-config
@antfu/ni
@antfu/utils
@types/node
bumpp
eslint
esno
lint-staged
pnpm
rimraf
simple-git-hooks
typescript
unbuild
vite
vitest
npm i unitoken
Source Code
github.com/meistrari/uni...
Homepage
github.com/meistrari/unitoken
Metadata
MIT
Whatever
Henrique Cunha
released 10/2/2023
Downloads
Downloads Tab Here
Maintainers
henrykunh