Comments on: How to eliminate spam bots from AWStats for good

By: Carsten

Carsten — Tue, 22 Sep 2009 17:43:38 +0000

Is there any way to make AWStats apply this filter on the fly as it analyzes the log files?

By: Alex

Alex — Tue, 07 Apr 2009 14:10:28 +0000

You’ll need to re-run logs through new filter obviously.
The old reports just lack the needed key information to distinguish trash within them.

BTW, I believe it’s a good policy to keep all your web access logs. Quite a few of my websites take only 300 MB uncompressed in log files space per month (just over 1 million hits). Disks are cheap nowadays and you may get new ideas of what to do with the logs in future.

By: Joe

Joe — Tue, 07 Apr 2009 13:47:29 +0000

What about old reports?!

By: Joe

Joe — Tue, 07 Apr 2009 13:46:52 +0000

What about old reports?!

By: Alex

Alex — Wed, 10 Dec 2008 12:30:02 +0000

Thanks for contributing, Ruben.

Actually, I see the script is in need of revision as my stats once again started to seem poisoned.

Looks like .js access is the single most reliable indication for humanness, robots are rarely interested in JavaScript. Only problem – not all sites readily include this type of files in every page, so this test isn’t totally universal out of the box.

By: Ruben Rubio

Ruben Rubio — Wed, 10 Dec 2008 09:09:39 +0000

So, change

while () {

By: Ruben Rubio

Ruben Rubio — Wed, 10 Dec 2008 09:08:57 +0000

Testing … <

By: Ruben Rubio

Ruben Rubio — Wed, 10 Dec 2008 09:07:48 +0000

If you have this error:

Use of uninitialized value in pattern match (m//) at ./remove_spambots.pl line 19.

Change the lines at line 19 and line 45 that seems like:

while () {

By: Penultimate Reality » Blog Archive » Spambots Hurting Statistics

Penultimate Reality » Blog Archive » Spambots Hurting Statistics — Sat, 22 Dec 2007 01:20:51 +0000

[...] reason), and it’d be nice to filter them out of AWStats somehow. I found an interesting script that purports to help solve this problem, but I haven’t actually figured out how the script [...]

By: Results of taking care for the site • STEREO.org.ua

Results of taking care for the site • STEREO.org.ua — Sat, 03 Nov 2007 01:23:13 +0000

[...] Statistics are very reliable, I believe. A special technique for filtering out spam bots from apache log files has been employed for the report Feb-Oct 2007 (blog.stereo.org.ua) and Jul-Oct 2007 [...]