#3457 (How to handle requests from robots via the IP address)
by Luc Saffre · in Hosting (system administration) · assigned to Luc Saffre
Summary
Children
Comments
- 6 years, 9 months ago by tonis about #3457 (How to handle requests from robots via the IP address) : Do we not have access to the conf for the ngnix or apache conf? I think we can just add an for it to work. alias /robots.txt /home/user/luc/robots.txt
- 6 years, 9 months ago by Luc Saffre about #3457 (How to handle requests from robots via the IP address) : Answering to robots.txt requests should be done by nginx or apache. The Lino process shouldn't get bothered with them. And that's how it is done on SR or LF. But for avanti everything is sent to Lino. It's actually an issue with the DNS config, which is managed by themselves. But we don't want to bo...
- 6 years, 9 months ago by tonis about #3457 (How to handle requests from robots via the IP address) : Is there a robots.txt file? I think on sr and or lf, we have a robots file that's the basic 'go away' config.