PDA

View Full Version : .htaccess Help



fedor
01-02-2007, 08:04 PM
Ok can sombody give me the code to block this stupid spam bot: ^Mozilla/4.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)

dkinzer
01-02-2007, 09:04 PM
If you have the IP address or range, you can give them an "access denied". Put this is your .htaccess to block the IP address x.y.z.t:

# deny access to spammers and other nuisances
order allow,deny
deny from x.y.z.t
allow from all
You can block a range by omitting, for example the "t" (leaving the dot).

Keying on the user agent, this ruleset should redirect them right back at themselves. I don't know if this violates any rules - use at your own risk.

RewriteCond %{HTTP_USER_AGENT} T-H-U-N-D-E-R-S-T-O-N-E [NC]
RewriteRule ^(.*)$ http://%{REMOTE_ADDR}/ [R=301,L]

dkinzer
01-02-2007, 09:13 PM
On further research, it appears that Thunderstone may be a legitimate search engine that you would want indexing your site. What behavior have you observed that leads you to call it a "spambot"?

They claim that they honor robots.txt (http://www.thunderstone.com/site/webinator5man/page_exclusion_robots_txt_and.html). If that is true and you don't want them indexing your site you can modify your robots.txt to exclude all.

fedor
01-03-2007, 01:06 PM
I also don't want them to steal my info:mad:
By info I mean where I live!:(
And they ignore my robots.txt :(

Pethens
01-03-2007, 01:28 PM
Thunderstone sells an Internet search appliance which could be used by just about anybody. They may be a legitimate business, but I wouldn't assume that about all the people using their product.

Regards,

Stephen

Basil
01-08-2007, 02:16 PM
I also don't want them to steal my info:mad:
By info I mean where I live!:(
And they ignore my robots.txt :(
Don't put information on your website that you don't want people to see.