All @veldica/prose-tokenizer versions
@veldica/prose-tokenizer @1.0.0
—
License
No
Install Scripts
0
Dependencies
3
Dev Dependencies
14.3 KB
Package Size
Published
Maintainers
veldica
Keywords
tokenizertokenizationsentence-splitterprosemarkdowntext-analysisword-countparagraph-splittingeditorial-toolingnlpdeterministicmarkdown-tokenizerrule-basedllmai
Dev Dependencies (3)
| Package | Constraint | Registry Status |
|---|---|---|
| tsx | ^4.21.0 | auto_approved |
| typescript | ^5.0.0 | auto_approved |
| @types/node | ^22.13.9 | auto_approved |
Commit: 80fd9d43de5d Browse source
Published to npm: