Web Technology @ CCBC

Student driven blog for all things web.

The Robots Exclusion Protocol

Posted by jrosero on February 24, 2008

This site has a ton of information on bots and all kinds of things that might be scanning your site.

http://www.robotstxt.org/

http://www.botsvsbrowsers.com/I know that there are options to prevent posts by unregistered members if you are the owner of a blog, but a lot of times you still get flooded with spam posts. Hopefully these sites can help those of you with your own sites who might be experiencing these annoyances.

Advertisements

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

 
%d bloggers like this: