#3457 (How to handle requests from robots via the IP address)

by Luc Saffre · in Hosting (system administration) · assigned to Luc Saffre

6 aastat, 9 kuud ago by tonis about #3457 (How to handle requests from robots via the IP address) : Do we not have access to the conf for the ngnix or apache conf? I think we can just add an for it to work. alias /robots.txt /home/user/luc/robots.txt
6 aastat, 9 kuud ago by Luc Saffre about #3457 (How to handle requests from robots via the IP address) : Answering to robots.txt requests should be done by nginx or apache. The Lino process shouldn't get bothered with them. And that's how it is done on SR or LF. But for avanti everything is sent to Lino. It's actually an issue with the DNS config, which is managed by themselves. But we don't want to bo...
6 aastat, 9 kuud ago by tonis about #3457 (How to handle requests from robots via the IP address) : Is there a robots.txt file? I think on sr and or lf, we have a robots file that's the basic 'go away' config.