The Bot Project is all about the webmaster community working together to build a picture of what search engine bots are doing, when they're doing it and where they're from.

What happens if there's a problem with the bot project - will my robots.txt still be delivered.

Yes. We do a flush before we do any updating so your robots.txt will be displayed, then the bot project updating code is executed.

The code is as small and "light" as possible so there really shouldn't be a problem.