Creates a robots.txt for applications that can be set to allow or disallow web crawlers to the app.

Alex Gleason 9393640fa9 Fixed inconsistent help text per tomd 6 years ago
subcommands 0492e68244 Add default subcommand 7 years ago
templates d02a7246d4 Filesystem skeleton 7 years ago
LICENSE d02a7246d4 Filesystem skeleton 7 years ago
README.md 9393640fa9 Fixed inconsistent help text per tomd 6 years ago
commands 9393640fa9 Fixed inconsistent help text per tomd 6 years ago
functions b9f9ac57d8 Give dokku ownership of nginx.conf.d 7 years ago
plugin.toml d02a7246d4 Filesystem skeleton 7 years ago

README.md

dokku robots.txt

Creates a robots.txt for applications that can be set to allow or disallow web crawlers to the app. This is useful for deploying websites that you do not want indexed by search engines. For instance, you may want to deploy a production app with robots allowed and a staging app with robots disallowed.

requirements

  • dokku 0.4.x+

installation

# on 0.4.x+
sudo dokku plugin:install https://notabug.org/candlewaster/dokku-robots.txt.git robots.txt

commands

robots.txt:disallow <app>, Discourages web crawlers from indexing this app
robots.txt:allow <app>,    Doesn't discourage web crawlers from indexing this app

usage

# Discourage web crawlers from indexing myapp
dokku robots.txt:disallow myapp

# Don't discourage web crawlers from indexing myapp
dokku robots.txt:allow myapp

# View robots.txt for myapp
dokku robots.txt myapp