3 posts • joined 27 May 2011
If only she had included a robots.txt file, she wouldn't have to put up with being spidered like this.
Indeed - 22/7 is a closer approximation than 3.14
The Register - Independent news and views for the tech community. Part of Situation Publishing
Join our daily or weekly newsletters, subscribe to a specific section or set News alerts
Biting the hand that feeds IT © 1998–2019