GitHub
gpt-tokenizer
v2.4.1
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
BPE
encoder
decoder
tokenizer
GPT
GPT-2
GPT-3
GPT-3.5
GPT-4
and 8 more...
Readme
Versions
Dependencies
Scripts
Dependencies (0)
No dependencies
Dev dependencies (3)
tsx
typescript
@niieani/scaffold
npm i
[email protected]
Source Code
github.com/niieani/gpt-t...
Homepage
github.com/niieani/gpt-token...
Metadata
MIT
Whatever
Bazyli Brzoska
released 10/7/2024
Downloads
Downloads Tab Here
Maintainers
niieani