Welcome to the bot project

The Bot Project is about the webmaster community working together to build a clear picture on what crawlers are out there and when they're accessing our sites. The charts below give an indication of which are the most active bots on those sites that take part in the Bot Project.

Google,Yahoo,Live activity over the last few days

Most frequent bots over the last 24 hours

Most frequent bots over the last 7 days

---

The Bot Project is about the webmaster community working together to build a clear picture on what crawlers are out there and when they're accessing our sites.

You add some code to your robots.txt file and it updates The Bot Project whenever that file is requested. You can the view your own site statistics from this site (or your Drupal site if you have the module installed**) and the whole community gets the bigger picture.

It would be great if we could track a bots activity across sites but that's not in phase one. The idea is to just collate and publish information and once there's a community for this project we'll let them (IE you) decide how far it goes.

You can chose to make your stats public or private. By default, only you can see your individual site stats.

** We're looking for people to create Wordpress, Joomla, etc modules. Please post in the plugins contributor forum if you can help.