Dynamic robots.txt (Apache) Rewrite requests for robots.txt to a dynamic file which generates robot directives.
Block Specific User-agents (NGINX) Disallow specific User-agents' requests. Useful for dealing with malicious bots.
Block Specific User-agents (Apache) Block specific User-agents' requests. Useful for dealing with malicious bots.