I've got someone crawling my photo gallery... not sure if it's a good bot/bad bot? Maybe something called "SE-PICSEARCH" or "Picsearch AB"(see below). Any ideas?
Here's the IP addresses it's using:
217.212.224.143
217.212.224.146
217.212.224.159
NetRange: 217.0.0.0 - 217.255.255.255
CIDR: 217.0.0.0/8
NetName: 217-RIPE
NetHandle: NET-217-0-0-0-1
Parent:
NetType: Allocated to RIPE NCC
NameServer: NS-PRI.RIPE.NET
NameServer: NS3.NIC.FR
NameServer: SUNIC.SUNET.SE
NameServer: NS-EXT.ISC.ORG
NameServer: SEC1.APNIC.NET
NameServer: SEC3.APNIC.NET
NameServer: TINNIE.ARIN.NET
Comment: These addresses have been further assigned to users in
Comment: the RIPE NCC region. Contact information can be found in
Comment: the RIPE database at www.ripe.net/whois
RegDate: 2000-06-05
Updated: 2005-07-27
# ARIN WHOIS database, last updated 2005-12-21 19:10
# Enter ? for additional hints on searching ARIN's WHOIS database.
How to Avoid Being Indexed
If you do not wish Picsearch to index your images please add 'psbot' to your robots.txt file according to the The Robot Exclusion Standard (example provided below). If you do not have access to the robots.txt file Psbot also obeys the robots meta tag and the psbot meta tag. (examples provided below).
* robots.txt example:
Include the following in your robots.txt file:
User-agent: psbot
Disallow: /
* Robots META tag example:
Include the following in the head section of your web-page:
<meta name="robots" content="noindex,nofollow">
* Psbot META tag example:
Include the following in the head section of your web-page:
<meta name="psbot" content="noindex,nofollow">
Please enter your server specs in your user profile! 😢
Never said I didn't want to allow it... maybe I do? I'm asking if you guys know what this bot is and if maybe the bot should be recognized by DF? It looks like it's indexing coppermine (and other various pages) to me.
I know how to prevent bots, that's not the point of this thread.
Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Debian Linux/apache 1.3/4.0.23_Debian-1-log/4.3.10-2/9.0.6.1
If it's a legit lycos bot then it sounds like they are launching some new image search like google images. The problem that google ran into was it was jacking copyrighted images too. The holders of those images sued google. So lycos better not be bypassing robots.txt to get at images or they'll find themselves sued too.
Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Linux/1.3.33/4.4/4.3.11
If it's a legit lycos bot then it sounds like they are launching some new image search like google images. The problem that google ran into was it was jacking copyrighted images too. The holders of those images sued google. So lycos better not be bypassing robots.txt to get at images or they'll find themselves sued too.
doesn't look like they are bypassing robots.txt. However, I would say that CPGNuke should recognize the bot. Right now, it only recognizes it as a guest and not a bot in the who is where menu. Can that be fixed?
Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Debian Linux/apache 1.3/4.0.23_Debian-1-log/4.3.10-2/9.0.6.1
picsearch (psbot) is far from being a new bot - many people disallow it because it indexes all your pictures so others can "borrow" them. It can also be very server intensive.
If you want to recognize it as a bot you will have to mod your version of includes/classes/cpg_member.php around line 188 plus.
The next version of Dragonfly has it listed as a known agent in the new security system and no longer uses cpg_member.php
PicSearch has recently turned up in my Who's Online Block (I'm running CVS) - It's either suddenly turned up and seems to be indexing a lot more sites, or it's been there all the time as a Guest, and is now classified as a bot
yw - I have a fair acquaintance with psbot as it's a frequent visitor.
Picsearch : December
Visits: 41386
Visits / Day: 1335.0
[8514] 217.212.224.142
[9379] 217.212.224.143
[6032] 217.212.224.144
[5141] 217.212.224.145
[6982] 217.212.224.146
[5338] 217.212.224.159
Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
yw - I have a fair acquaintance with psbot as it's a frequent visitor.
Picsearch : December
Visits: 41386
Visits / Day: 1335.0
[8514] 217.212.224.142
[9379] 217.212.224.143
[6032] 217.212.224.144
[5141] 217.212.224.145
[6982] 217.212.224.146
[5338] 217.212.224.159
haha, yea... me too. Never around, then all of a sudden it's been here since mid-december almost 24/7. I don't mind it, but I'm wondering how long it'll take for it to finish crawling.
Where did you pull that info from?
Server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS):
Debian Linux/apache 1.3/4.0.23_Debian-1-log/4.3.10-2/9.0.6.1
