All @huggingface/tokenizers versions
@huggingface/tokenizers @0.0.5
Apache-2.0
License
No
Install Scripts
0
Dependencies
15
Dev Dependencies
67.2 KB
Package Size
Published
🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers
Maintainers
julien-cpierriccoyotte508xenovagary149
Dev Dependencies (15)
| Package | Constraint | Registry Status |
|---|---|---|
| jest | ^30.2.0 | auto_approved |
| dotenv | ^17.2.3 | auto_approved |
| eslint | ^9.37.0 | auto_approved |
| rimraf | ^6.0.1 | auto_approved |
| terser | ^5.40.0 | auto_approved |
| esbuild | ^0.25.5 | auto_approved |
| ts-jest | ^29.4.4 | auto_approved |
| prettier | ^3.5.3 | auto_approved |
| tsc-alias | ^1.8.16 | auto_approved |
| typescript | ^5.4.0 | auto_approved |
| @types/jest | ^30.0.0 | auto_approved |
| @types/node | ^24.9.2 | auto_approved |
| jest-environment-node | ^30.2.0 | auto_approved |
| @typescript-eslint/parser | ^8.46.0 | auto_approved |
| @typescript-eslint/eslint-plugin | ^8.46.0 | auto_approved |
Changes from v0.0.4
No metadata changes detected.
File Changes
28 added
23 removed
38 modified
size delta: +3.0 KB
Commit: 717d6e3b45d2 Browse source
Published to npm: