All gpt-tokenizer versions

gpt-tokenizer @3.2.0

License
No
Install Scripts
0
Dependencies
8
Dev Dependencies
15048.3 KB
Package Size
Published

Maintainers

niieani

Keywords

BPEencoderdecodertokenizerGPTGPT-2GPT-3GPT-3.5GPT-4GPT-4oNLPNatural Language ProcessingText GenerationOpenAIMachine Learningml

Dev Dependencies (8)

PackageConstraintRegistry Status
vitest ^3.2.4 auto_approved
devalue ^5.3.2 auto_approved
@swc/cli ^0.7.8 auto_approved
@swc/core 1.13.5 auto_approved
typescript ^5.9.3 auto_approved
node-resolve-ts ^1.0.2 Not imported
@edge-runtime/vm ^5.0.0 auto_approved
@niieani/scaffold ^1.7.54 Not imported

Changes from v3.1.0

No metadata changes detected.

File Changes

0 added 0 removed 198 modified size delta: +48.9 KB

Commit: dcc878381f2b Browse source

Published to npm: