tiktoken-node

v0.0.2
tiktoken is a fast [BPE](https://en.wikipedia.org/wiki/Byte_pair_encoding) tokeniser for use with OpenAI's models.

Metadata

  • MIT
  • >= 14
  • Unknown
  • released 3/16/2023

Downloads

Maintainers