robots-parser @3.0.1
—
License
No
Install Scripts
0
Dependencies
3
Dev Dependencies
9.5 KB
Package Size
Published
Maintainers
samclarke
Keywords
robots.txtparseruser-agentscraperspiderbotrobots-exclusion-standard
Dev Dependencies (3)
| Package | Constraint | Registry Status |
|---|---|---|
| nyc | ^15.1.0 | auto_approved |
| chai | ^4.3.6 | auto_approved |
| mocha | ^10.0.0 | auto_approved |
Commit: dd032ec3da65 Browse source
Published to npm: