All @huggingface/tokenizers versions

@huggingface/tokenizers @0.0.5

Apache-2.0
License
No
Install Scripts
0
Dependencies
15
Dev Dependencies
67.2 KB
Package Size
Published

🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers

Maintainers

julien-cpierriccoyotte508xenovagary149

Dev Dependencies (15)

PackageConstraintRegistry Status
jest ^30.2.0 auto_approved
dotenv ^17.2.3 auto_approved
eslint ^9.37.0 auto_approved
rimraf ^6.0.1 auto_approved
terser ^5.40.0 auto_approved
esbuild ^0.25.5 auto_approved
ts-jest ^29.4.4 auto_approved
prettier ^3.5.3 auto_approved
tsc-alias ^1.8.16 auto_approved
typescript ^5.4.0 auto_approved
@types/jest ^30.0.0 auto_approved
@types/node ^24.9.2 auto_approved
jest-environment-node ^30.2.0 auto_approved
@typescript-eslint/parser ^8.46.0 auto_approved
@typescript-eslint/eslint-plugin ^8.46.0 auto_approved

Changes from v0.0.4

No metadata changes detected.

File Changes

28 added 23 removed 38 modified size delta: +3.0 KB

Commit: 717d6e3b45d2 Browse source

Published to npm: