Page 1 of 1

Twenga and their bot

Posted: Tue May 25, 2010 4:03 pm
by Highland
Has anyone heard of Twenga?
http://www.twenga.com/bot.html

I had to shut them off with the firewall because their infernal script was scrawling dozens of our sites at once.
IP list, if you're interested
94.75.199.211
94.75.247.195
94.75.247.197
94.75.199.212
85.17.226.92
95.211.113.74

Re: Twenga and their bot

Posted: Thu May 27, 2010 9:55 am
by Highland
Ok, maybe they're trying to get back at me now. I had about 100 requests blocked last night like this

GET /sales-catalog/index/index/index/index/index/index/index/index/index/index/index/index/index/index/index/index/index/index/index/alert(this.getAttribute('title')); return false; HTTP/1.0
Host: www.mydomain.com
User-Agent: TwengaBot/1.1 (+http://www.twenga.com/bot.html)
Accept-Encoding: gzip
Cookie: PHPSESSID=vgdu7ao4ic8b2q62qnbff0a3i2; stat_marker=stat;
Accept-Language: en,en;q=0.5
Accept-Charset: utf-8,*;q=0.7

All from different IPs

Re: Twenga and their bot

Posted: Fri May 28, 2010 5:09 am
by mikeshinn
We added a rule into ASL yesterday to block this bot. If that doesnt work for some reason, please let us know.

Re: Twenga and their bot

Posted: Fri May 28, 2010 1:41 pm
by Highland
I know. I was the one who filed the ticket ;)

We had (I kid you not) over 139 million hits from their infernal bot in a week. After the rule update it dropped our processor loads by half.

Re: Twenga and their bot

Posted: Fri May 28, 2010 4:24 pm
by scott
Wow. Thats pretty metal.

Re: Twenga and their bot

Posted: Sun May 30, 2010 8:14 am
by mikeshinn
After the rule update it dropped our processor loads by half.
ASL: Saving you CPU cycles from stupid bots since 2005.