Web robots, spiders and other user agents.

Sorry Folks, the database is down for maintenance, check back later please.

Here you will find a database of robots, spiders and other user agents for programs that surf the web.

From this database you can create a mod_rewrite or .htaccess file to redirect or keep out your choice of user agents from certain content on your website.
You can also create an analog.cfg file to separate the hits of robots and spiders from "real" users, so you can have better visitor statistics and know if a certain search engine bot has visited you lately.
And last, but not least, you can create a PHP array with your choice of user agents to be used as you please in your website.

Why? Well, I wanted to make it easier for me to keep track of web robots and spiders so I could separate them in my log analysis.
If you are a WebMaster, you know what I mean.

So, you can come in and check that spider/bot that has crawled your site and see what is it all about and decide wether you should keep it out or let it in.