All @huggingface/tokenizers versions
@huggingface/tokenizers @0.1.3
Apache-2.0
License
No
Install Scripts
0
Dependencies
15
Dev Dependencies
69.4 KB
Package Size
Published
🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers
Maintainers
julien-cpierriccoyotte508xenovagary149
Dev Dependencies (15)
| Package | Constraint | Registry Status |
|---|---|---|
| jest | ^30.2.0 | auto_approved |
| dotenv | ^17.2.3 | auto_approved |
| eslint | ^9.37.0 | auto_approved |
| rimraf | ^6.0.1 | auto_approved |
| terser | ^5.40.0 | auto_approved |
| esbuild | ^0.25.5 | auto_approved |
| ts-jest | ^29.4.4 | auto_approved |
| prettier | ^3.5.3 | auto_approved |
| tsc-alias | ^1.8.16 | auto_approved |
| typescript | ^5.4.0 | auto_approved |
| @types/jest | ^30.0.0 | auto_approved |
| @types/node | ^24.9.2 | auto_approved |
| jest-environment-node | ^30.2.0 | auto_approved |
| @typescript-eslint/parser | ^8.46.0 | auto_approved |
| @typescript-eslint/eslint-plugin | ^8.46.0 | auto_approved |
Changes from v0.1.2
No metadata changes detected.
File Changes
0 added
0 removed
5 modified
size delta: +.2 KB
Commit: d6fc380d3d4e Browse source
Published to npm: