All @huggingface/tokenizers versions
@huggingface/tokenizers @0.0.3
Apache-2.0
License
No
Install Scripts
1
Dependencies
15
Dev Dependencies
65.7 KB
Package Size
Published
🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers
Maintainers
julien-cpierriccoyotte508xenovagary149
Dependencies (1)
| Package | Constraint | Registry Status |
|---|---|---|
| @huggingface/tokenizers | ^0.0.2 | auto_approved |
Dev Dependencies (15)
| Package | Constraint | Registry Status |
|---|---|---|
| jest | ^30.2.0 | auto_approved |
| dotenv | ^17.2.3 | auto_approved |
| eslint | ^9.37.0 | auto_approved |
| rimraf | ^6.0.1 | auto_approved |
| terser | ^5.40.0 | auto_approved |
| esbuild | ^0.25.5 | auto_approved |
| ts-jest | ^29.4.4 | auto_approved |
| prettier | ^3.5.3 | auto_approved |
| tsc-alias | ^1.8.16 | auto_approved |
| typescript | ^5.4.0 | auto_approved |
| @types/jest | ^30.0.0 | auto_approved |
| @types/node | ^24.9.2 | auto_approved |
| jest-environment-node | ^30.2.0 | auto_approved |
| @typescript-eslint/parser | ^8.46.0 | auto_approved |
| @typescript-eslint/eslint-plugin | ^8.46.0 | auto_approved |
Transitive Dependency Tree
1 transitive deps
max depth 1
├─
@huggingface/tokenizers
^0.0.2
→ 0.0.2
Changes from v0.0.2
Dependency Changes
| Change | Package | Version |
|---|---|---|
| added | @huggingface/tokenizers | ^0.0.2 |
File Changes
0 added
0 removed
17 modified
size delta: +.1 KB
Commit: 098c42ff25d8 Browse source
Published to npm: