Blocking filters
I own several proxy sites, which as you can guess are most used by school students at school. The problem is they get blocked by what I can only presume are robots that scour sites for keywords and certain things and then block them. Just wondering if you can block these robots (if they are robots) in robots.txt
Thanks guys
|