Home Private Messages Search
CPG Dragonfly™ CMS Dedicated Server & Bandwidth Sponsored by DedicatedNOW
Toggle Content
 
Forums ⇒ Miscellaneous ⇒ Search Engines ⇒ [solved] Rampaging bots


[solved] Rampaging bots
Questions and issues with search engines, SEO, bots, meta tags.
Go to page Previous  1, 2
Post new topic    Reply to topic    Printer Friendly Page     Forum Index ⇒  Search Engines

View previous topic :: View next topic  
Author Message
NanoCaiordo
Developer
Developer

Offline Offline
Joined: Jun 29, 2004
Posts: 3878
Location: Melbourne, AU
PostPosted: Tue Oct 11, 2011 12:03 pm
Post subject: Re: Rampaging bots

Thats for sure not the best way to ask a simple question.

I google it.

Beside, Yahoo and MSN are included already, recognized using by their ip ranges and not by the user agent which can be easily modified.

_________________
.:: I met php the 03 December 2003 :: Unforgettable day! ::.

Linux 64bit / Apache 2.2 / PHP 5.4 / MySQL 5.5.22 / v9, v10
Linux 32bit / Apache 2.2 / PHP 5.3.10 / MySQL 5.5.22 / v9, v10
Windows 64bit / IIS 7.5 / PHP 5.3.10 / MySQL 5.5.22 / v9, v10


NanoCaiordo's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
mixed
Back to top
View user's profile Visit poster's website Photo Gallery
Kinsman
Dragonfly addicted
Dragonfly addicted

Offline Offline
Joined: May 29, 2006
Posts: 343
Location: Australia
PostPosted: Tue Oct 11, 2011 12:13 pm
Post subject: Re: Rampaging bots

erm ok then, I did ask it in the very first post, to which everyone answered they had no idea, so assumed it can't be done if the experts don't know.

I would hazard a guess that both MSN and Yahoo bots have evolved over time, as I can assure you the ones listed are different to the ones currently trawling us.

Which is why it should be an easily updateable page I guess.

Sorry to trouble, back to google for me then.

The end result to this is still the same for me though, I can't add new bots.


Kinsman's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
2.6.18-164.11.1.el5xen/2.2.13/5.0.89-community-log/5.2.11/9.3.3.0
Back to top
View user's profile Visit poster's website
NanoCaiordo
Developer
Developer

Offline Offline
Joined: Jun 29, 2004
Posts: 3878
Location: Melbourne, AU
PostPosted: Tue Oct 11, 2011 1:20 pm
Post subject: Re: Rampaging bots

What you can do to confirm that they are evolved, which is highly possible, and we missed to add those new ip ranges to our list is:

open /includes/db/db.php and at line 83 replace $the_error ... with
PHP:
	
$the_error .= "\r\n\r\nGuest information:\r\nUser id: ".$userinfo['user_id']."\r\nUsername: ".(SEARCHBOT ? SEARCHBOT : $userinfo['username'])."\r\nAdmin: ".($show ? 'Yes' : 'No')."\r\nIP: $addr\r\nHost: $host";

The above is one line only, not 2 or 3 lines depends how your browsers wrapped it.

This corrected code will try to catch the bot name, otherwise the user name.
Next SQL error you have after editing the code should tell you, and us, if we registered that ip as bot or not.

_________________
.:: I met php the 03 December 2003 :: Unforgettable day! ::.

Linux 64bit / Apache 2.2 / PHP 5.4 / MySQL 5.5.22 / v9, v10
Linux 32bit / Apache 2.2 / PHP 5.3.10 / MySQL 5.5.22 / v9, v10
Windows 64bit / IIS 7.5 / PHP 5.3.10 / MySQL 5.5.22 / v9, v10


NanoCaiordo's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
mixed
Back to top
View user's profile Visit poster's website Photo Gallery
Kinsman
Dragonfly addicted
Dragonfly addicted

Offline Offline
Joined: May 29, 2006
Posts: 343
Location: Australia
PostPosted: Tue Oct 11, 2011 1:39 pm
Post subject: Re: Rampaging bots

think i found the worst 2.

www.useragentstring.co...d_8652.php

www.useragentstring.co...d_3231.php


Kinsman's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
2.6.18-164.11.1.el5xen/2.2.13/5.0.89-community-log/5.2.11/9.3.3.0
Back to top
View user's profile Visit poster's website
Display posts from previous:   
Post new topic    Reply to topic    Printer Friendly Page    Forum Index ⇒  Search Engines
Page 2 of 2
All times are GMT
Go to page Previous  1, 2



Jump to:  


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum


 
   Toggle Content User Info

Welcome Anonymous

Nickname
Password
(Register)

   Toggle Content Last CVS commits
· Fixed .ico Expires header.
· Removed domain name from cookies so subdomains wont access them anymore.
· CSS and JS, case insensitives.
· CSS and JS, send correct HTTP 1.1 headers and fixed issues where themes and...
· Further security class improvements.
· 301 redirects on LEO changes
· Option to force 3xx http status codes
· Validate googlebot.com and google.com crawlers.
· CCBot
· Rss with etag and atom.

อ่านต่อ...

   Toggle Content Community

Support for DragonflyCMS in a other languages:

Deutsch
Español

   Toggle Content X-links
UltraEdit Browse Happy logo Firefox MySQL PostgreSQL Valid CSS! Valid XHTML 1.0! Unicode Encoded Badge NukeBiz Resources Raven DragonflyCMS Dedicated Now InsideSupport Lampe Berger

You are seeing squares or questionmarks on this page?

All content of this website is copyrighted by the Creative Commons NC-SA
The logos and trademarks used on this site are the property of their respective owners
We are not responsible for comments posted by our users, as they are the property of the poster.
Our server runs on a P3 1.2GHz with 512MB RAM with no accelerators
Support GoPHP5.org
Interactive software released under GNU GPL, Code Credits, Privacy Policy