Automatically exported from code.google.com/p/planningalerts
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 

5 lines
74 B

  1. User-agent: *
  2. Disallow: /cgi-bin/
  3. Disallow: /scrapers/
  4. Disallow: /api.php