unitoken

v0.0.1
Universal tokenizer in pure javascript

Readme Versions Dependencies Scripts

Dependencies (1)

js-tiktoken

Dev dependencies (15)

@antfu/eslint-config @antfu/ni @antfu/utils @types/node bumpp eslint esno lint-staged pnpm rimraf simple-git-hooks typescript unbuild vite vitest
npm i unitoken

Metadata

  • MIT
  • Whatever
  • Henrique Cunha
  • released 10/2/2023

Downloads

Maintainers