GitHub
gpt-tokenizer
v1.0.4
BPE Encoder Decoder for GPT-2 / GPT-3
BPE
encoder
decoder
tokenizer
GPT
GPT-2
GPT-3
GPT-3.5
GPT-4
and 7 more...
Readme
Versions
Dependencies
Scripts
2.5.1
2.5.0
2.4.1
2.4.0
2.3.0
2.2.3
2.2.2
2.2.1
2.2.0
2.1.2
2.1.1
2.1.0
2.0.0
2.0.0-beta.2
2.0.0-beta.1
1.0.5
1.0.4
1.0.3
1.0.2
1.0.1
1.0.0
npm i
[email protected]
Source Code
github.com/niieani/gpt-t...
Homepage
github.com/niieani/gpt-token...
Metadata
MIT
Whatever
Bazyli Brzoska
released 5/1/2023
Downloads
Downloads Tab Here
Maintainers
niieani