robot-directives Not imported
Parse robot directives within HTML meta and/or HTTP headers.
Import to Registry
This package is not yet in the vetted registry. Import it to start the review process.
0.4.0
Latest Version
MIT
License
6
Published Versions
3
Dependencies
Maintainers
stevenvachon
Keywords
crawlersheaderhtmlhttpmetametadatanofollownoindexrobotsrobots.txtseospiders
Dependencies
| Package | Constraint |
|---|---|
| deep-freeze-node | ^1.1.2 |
| isbot | ^2.0.3 |
| useragent | ^2.1.13 |
Published Versions
| Version |
|---|
| 0.4.0 |
| 0.4.0-alpha |
| 0.3.0 |
| 0.2.1 |
| 0.2.0 |
| 0.1.0 |