Unknown Bots eating up my valuable bandwidth!! How to stop!!

Use your .htaccess to ban these bad bots. But before you do this you need to find out if they are worthless.
Ban a single IP:
deny from "IP goes here"

or

deny from "IP with /cidr"

or via user agent e.g short example.:

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Alexibot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Yeti/0.01 [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xenu's [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus
RewriteRule ^.* - [F,L]

Click to expand...

You should look in to creating a robots.txt - you'll have to google to find an example that meets your needs.

Bad bots don´t follow the rules in robots.txt
So what was the IP you found in your log files ?

Ban the IP in your .htaccess file

There's frankly no telling what the bot was up to; chances are it's not something good, but it could be a mistake/bug. Regardless, the easy way out is simply to ban the offending IP(s). .htaccess is a quick way to do this, and that has already been laid out for you. It's also one of the easiest on resources.

Talk to your host they can look at logs and see what exactly is the problem. You probably can block there ip.

sdsinc said:

Ban the IP in your .htaccess file

Click to expand...

They might appear with another one. Maybe it worth to read about their activity to think over the measures to be taken?

Mailed my host with this issue. Waiting for reply. But what bothers me is why does my own hosts IP appear in that list and repeated hits?? And the hits point out to images in my directory.

What is the bot name I wonder?

tracked out these two. Can anyone verify if they are useful. Checked out in the blacklist at What Is My IP Address? - Is my IP address blacklisted? and they appear to be listed.


119.152.40.205
83.132.77.29

---------- Post added at 11:19 PM ---------- Previous post was at 10:47 PM ----------

Can writing something like this in htacess help

<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

<Limit GET POST>
order deny,allow
deny from 212.100.249.69
deny from 119.152.40.205
deny from 83.132.77.29
</Limit>

Could you tell which host are you using?

It seems that you need first block the IPs to stop them temporary and then you will need in any case to work on some kind of filters and probably will need to hire some designers

I woyld suggest warning your host, if there worth being with they will sort it out for you.


Sean

Had contacted the host. They replied that it isant an hosting issue or issiue with other sites on their hosting. They say that thats a issue related to the robot.txt file and advised to create a robot.txt file to stop the unwanted bots from acessing the site.

Simply use your .htaccess to stop these bots, if its not working; call your hosting company and talk to some technical person, instead of customer service. I did face couple of problems like this in past, i talk to hosting and CS guy said this not hosting, issue, after two days i called again and talk to some technical supervisor, then they solve that issue.