tiktoken-node

v0.0.5
tiktoken is a fast [BPE](https://en.wikipedia.org/wiki/Byte_pair_encoding) tokeniser for use with OpenAI's models.

Readme Versions Dependencies Scripts

build:debug

napi build --platform --no-dts-header --js false --dts ../index.d.ts ./dist

build

npm run build:debug -- --release

format

cargo fmt
npm i [email protected]

Metadata

  • MIT
  • >= 14
  • Unknown
  • released 3/21/2023

Downloads

Maintainers