Package note
gpt-tokenizer
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
v3.4.0·975K weekly downloads·Health 65/100
Gpt-tokenizer is a pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models. Licensed under MIT, it is popular in the JavaScript ecosystem with 974.5K weekly downloads.
Key Metrics
- Weekly Downloads
- 974.5K
- Bundle (gzip)
- 1011.3 KB
- Last Updated
- Vulnerabilities
- 0
Download Trend
↑22%
Health Score Breakdown
Gpt-tokenizer has an good overall health score of 65/100. Its strongest dimension is security (100/100), while maintenance (40/100) is the area with most room for improvement. This package is in good shape overall.
Maintenance
40
Popularity
90
Quality
50
Security
100
Stability
70
Free JS Stack Cheatsheet
The best package for every category — one PDF.
Join 500+ devs. No spam.
Package Details
- License
- MIT
- Dependencies
- 0
- Uncompressed Size
- 2.0 MB
Keywords
BPEencoderdecodertokenizerGPTGPT-2GPT-3GPT-3.5GPT-4GPT-4oNLPNatural Language ProcessingText GenerationOpenAIMachine Learning