All @huggingface/tokenizers versions
@huggingface/tokenizers @0.0.2
Apache-2.0
License
No
Install Scripts
0
Dependencies
14
Dev Dependencies
65.7 KB
Package Size
Published
🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers
Maintainers
julien-cpierriccoyotte508xenovagary149
Dev Dependencies (14)
| Package | Constraint | Registry Status |
|---|---|---|
| jest | ^30.2.0 | auto_approved |
| dotenv | ^17.2.3 | auto_approved |
| eslint | ^9.37.0 | auto_approved |
| rimraf | ^6.0.1 | auto_approved |
| terser | ^5.40.0 | auto_approved |
| esbuild | ^0.25.5 | auto_approved |
| ts-jest | ^29.4.4 | auto_approved |
| prettier | ^3.5.3 | auto_approved |
| typescript | ^5.4.0 | auto_approved |
| @types/jest | ^30.0.0 | auto_approved |
| @types/node | ^24.9.2 | auto_approved |
| jest-environment-node | ^30.2.0 | auto_approved |
| @typescript-eslint/parser | ^8.46.0 | auto_approved |
| @typescript-eslint/eslint-plugin | ^8.46.0 | auto_approved |
Changes from v0.0.1
Dependency Changes
Script Changes
+ format:checkFile Changes
0 added
0 removed
8 modified
size delta: -.8 KB
Commit: 4fa791290c0f Browse source
Published to npm: