gpt-tokenizer @3.1.0
—
License
No
Install Scripts
0
Dependencies
8
Dev Dependencies
15044.4 KB
Package Size
Published
Maintainers
niieani
Keywords
BPEencoderdecodertokenizerGPTGPT-2GPT-3GPT-3.5GPT-4GPT-4oNLPNatural Language ProcessingText GenerationOpenAIMachine Learningml
Dev Dependencies (8)
| Package | Constraint | Registry Status |
|---|---|---|
| vitest | ^3.2.4 | auto_approved |
| devalue | ^5.3.2 | auto_approved |
| @swc/cli | ^0.7.8 | auto_approved |
| @swc/core | 1.13.5 | auto_approved |
| typescript | ^5.9.3 | auto_approved |
| node-resolve-ts | ^1.0.2 | Not imported |
| @edge-runtime/vm | ^5.0.0 | auto_approved |
| @niieani/scaffold | ^1.7.54 | Not imported |
Changes from v3.0.1
No metadata changes detected.
File Changes
189 added
0 removed
798 modified
size delta: +956.0 KB
Commit: 135a8513f314 Browse source
Published to npm: