Startsida Utforska Hjälp
Logga in
mro
/
ShaarliGo
spegling av https://code.mro.name/mro/ShaarliGo
Bevaka 1
Stjärnmärk 0
Fork 0
Filer Ärenden
Gren: master
Grenar Taggar
ShaarliGo
/
static
/
robots.txt

robots.txt 418 B
Permalänk Historik Rå

1234567891011121314151617181920 
  1. 

  2. # https://ahrefs.com/robot
    3. 

  3. User-agent: AhrefsBot
    4. 

  4. # https://support.apple.com/de-de/HT204683
    5. 

  5. User-agent: Applebot
    6. 

  6. User-agent: Buck
    7. 

  7. # https://cliqz.com/cliqzbot
    8. 

  8. User-agent: Cliqzbot
    9. 

  9. User-agent: Daum
    10. 

  10. # https://mj12bot.com/
    11. 

  11. User-agent: MJ12bot
    12. 

  12. User-agent: um-IC
    13. 

  13. # https://yandex.com/support/webmaster/controlling-robot/robots-txt.html
    14. 

  14. User-agent: Yandex
    15. 

  15. Disallow: /
    16. 

  16. 

  17. User-agent: *
    18. 

  18. Disallow: /shaarligo.cgi
    19. 

  19. # Allow: /o/p/
    20. 

  20.