tiktoken-node

v0.0.5

tiktoken is a fast [BPE](https://en.wikipedia.org/wiki/Byte_pair_encoding) tokeniser for use with OpenAI's models.

Readme Versions Dependencies Scripts

Dependencies (0)

No dependencies

Dev dependencies (2)

@napi-rs/cli typescript

npm i [email protected]

Source Code

github.com/ceifa/tiktoke...

Homepage

github.com/ceifa/tiktoken-no...

Metadata

MIT
>= 14
Unknown
released 3/21/2023

Downloads

Maintainers