Automatically exported from code.google.com/p/planningalerts
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
1234 |
- User-agent: *
- Disallow: /cgi-bin/
- Disallow: /scrapers/
- Disallow: /api.php
|