Go Back   Webmaster Forums & SEO Internet Marketing Resources > Search Engine Optimization > Robots.txt


Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 04-12-2008, 04:40 PM
Junior Member
 
Join Date: Apr 2008
Posts: 20
urbt is on a distinguished road
Default Blocking filters

I own several proxy sites, which as you can guess are most used by school students at school. The problem is they get blocked by what I can only presume are robots that scour sites for keywords and certain things and then block them. Just wondering if you can block these robots (if they are robots) in robots.txt

Thanks guys
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 07:34 AM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.1.0