robots.txt 39 B

1234
  1. User-agent: *
  2. Disallow:
  3. Crawl-delay: 5