But... robots.txt can be ignored and most likely is ignored by Google. Profits over privacy, etc.
Not a member of The Register? Create a new account here.
Remember me on this computer? Post anonymously?