Automatically exported from code.google.com/p/planningalerts
25개 이상의 토픽을 선택하실 수 없습니다. Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

robots.txt 74 B

1234
  1. User-agent: *
  2. Disallow: /cgi-bin/
  3. Disallow: /scrapers/
  4. Disallow: /api.php