All @veldica/prose-tokenizer versions

@veldica/prose-tokenizer @1.0.0

License
No
Install Scripts
0
Dependencies
3
Dev Dependencies
14.3 KB
Package Size
Published

Maintainers

veldica

Keywords

tokenizertokenizationsentence-splitterprosemarkdowntext-analysisword-countparagraph-splittingeditorial-toolingnlpdeterministicmarkdown-tokenizerrule-basedllmai

Dev Dependencies (3)

PackageConstraintRegistry Status
tsx ^4.21.0 auto_approved
typescript ^5.0.0 auto_approved
@types/node ^22.13.9 auto_approved

Commit: 80fd9d43de5d Browse source

Published to npm: