Exclusive eBooks, Software Solutions, Quality Guaranteed
 
Web NukeBiz
Welcome to NukeBiz · Members
Amazon
show cart or checkout0 items
Cart Value: 0.00

Forums » DragonflyCMS Projects » IP Tracker » Can't get rid of Inktomi/Yahoo!
Can't get rid of Inktomi/Yahoo!
Keeping tabs on visitors, bots and modules being used.
Topic initiation via Bugger.

Post new topic    Reply to topic    Printer Friendly Page     Forum Index »  Management » IP Tracker

View previous topic :: View next topic  
Author Message
Shenphen
New Poster
New Poster

Offline Offline
Joined: Apr 23, 2005
Posts: 1

PostPosted: Sun Apr 24, 2005 11:21 am
Post subject: Can't get rid of Inktomi/Yahoo!

I have too many Inktomi/Yahoo! visits!
I entered:
Code::
$exclude_hosts = array('.+inktomisearch.com','msnbot.msn.com');
It works fine for msn bot, but not for Inktomi!!
I've tried also:
Code::
$exclude_ips = array('68.142.+','66.196.+'); 
but it doesn't seems to work either Sad

Any idea?
Thank you Smile


Shenphen please enter your server specs in your user profile! Crying or Very sad
Back to top
View user's profile
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Sun Apr 24, 2005 12:29 pm
Post subject: Re: Can't get rid of Inktomi/Yahoo!

just 'inktomisearch.com'

_________________
DonationsPro for vBulletin, SMF, MyBB, DragonflyCMS


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
norbie
Supervisor
Supervisor

Offline Offline
Joined: Jul 16, 2005
Posts: 18

PostPosted: Mon Jul 18, 2005 4:45 am
Post subject: Re: Can't get rid of Inktomi/Yahoo!

I can't seem to get rid of this or other bots either!

I'm using
Code::
$exclude_hosts = array('inktomisearch.com', 'msnbot.msn.com', 'googlebot.com'); 

But this still isnt blocking bots such as:

Quote::
crawl-66-249-71-67.googlebot.com
crawl-66-249-64-33.googlebot.com
lj2225.inktomisearch.com
crawl-66-249-64-39.googlebot.com
lj2545.inktomisearch.com

I've tried several variations of the inktomisearch with wildcards, but I can't seem to get it to work Confused


norbie please enter your server specs in your user profile! Crying or Very sad
Back to top
View user's profile
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Mon Jul 18, 2005 6:17 pm
Post subject: Re: Can't get rid of Inktomi/Yahoo!

hmm, still not sure why that isn't working, so I've restructured the check - it should now detect host names and ip addresses - follow existing instructions in ipconfig.php for excclusion of IP and hostname.

'inktomisearch.com' is sufficient to ensure it is excluded. Some care needs to be taken now e.g. if you were to use 'msn.com', it would exclude all things msn, including search queries, so it is important to use something like 'msnbot.msn.com'.

Simply extract the iptracking.inc from the attached zip and upload to modules/IP_Tracker


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Tue Jul 19, 2005 6:45 am
Post subject: Re: Can't get rid of Inktomi/Yahoo!

Something I should have thought of originally was to just provide a flag that automatically excludes known search engines - that way you don't have to keep adding IPs and hostnames for bots that Dragonfly already identifies.

That way, you have the main ones covered and just use ipconfig to cover the gaps and any other specifics you want to handle.


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
norbie
Supervisor
Supervisor

Offline Offline
Joined: Jul 16, 2005
Posts: 18

PostPosted: Wed Jul 20, 2005 1:18 am
Post subject: Re: Can't get rid of Inktomi/Yahoo!

Phoenix wrote:
Something I should have thought of originally was to just provide a flag that automatically excludes known search engines - that way you don't have to keep adding IPs and hostnames for bots that Dragonfly already identifies.

That way, you have the main ones covered and just use ipconfig to cover the gaps and any other specifics you want to handle.

That would be a good addition Smile

Thanks for the new file, I'll let you know if there's any problems!


norbie please enter your server specs in your user profile! Crying or Very sad
Back to top
View user's profile
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Wed Jul 20, 2005 8:11 am
Post subject: Re: Can't get rid of Inktomi/Yahoo!

new flag $exclude_bots now introduced - works fine and will be in next version - just doing some further testing on unix time changes.


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Wed Jul 20, 2005 3:36 pm
Post subject: Re: Can't get rid of Inktomi/Yahoo!

all done and tested okay - simply activate the flag in ipconfig

nukebiz.com/Downloads/...id=37.html


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
norbie
Supervisor
Supervisor

Offline Offline
Joined: Jul 16, 2005
Posts: 18

PostPosted: Wed Jul 20, 2005 5:33 pm
Post subject: Re: Can't get rid of Inktomi/Yahoo!

A few other suggestions that could be good.

Can you exclude certain users? e.g. myself on my own site racks up a tonne of logging that doesn't need doing.

And maybe a button to clear all data from the table in the Module? Or maybe only for specific entries?


norbie please enter your server specs in your user profile! Crying or Very sad
Back to top
View user's profile
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Wed Jul 20, 2005 6:18 pm
Post subject: Re: Can't get rid of Inktomi/Yahoo!

exclude users can be added in an array like the others, though eventually I have to create a proper admin interface.

With an admin interface, it would be fairly straight forward to allow deletion of the first x,000 records, which essentially is what the program does now by setting the $ipdel variable.

Specific entries is a bit more work because you really need to know what you want before you do it.


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
Phoenix
Chairman
Chairman

Offline Offline
Joined: Mar 17, 2004
Posts: 1543
Location: Netizen
PostPosted: Thu Jul 21, 2005 12:30 am
Post subject: Re: Can't get rid of Inktomi/Yahoo!

oh well, started it - IP Tracker config now runs mainly from a new database table, though it means an extra database query, which was the benefit of a static config file.

Still some exclusion arrays to work out how to manage, and the admin interface, although the admin is the easy part.


Phoenix's server specs (Server OS / Apache / MySQL / PHP / DragonflyCMS)
Back to top
View user's profile Visit poster's website ICQ Number Yahoo Messenger Photo Gallery
norbie
Supervisor
Supervisor

Offline Offline
Joined: Jul 16, 2005
Posts: 18

PostPosted: Thu Jul 21, 2005 12:39 am
Post subject: Re: Can't get rid of Inktomi/Yahoo!

Well good luck, with the testing - If I can help at all, let me know! Smile


norbie please enter your server specs in your user profile! Crying or Very sad
Back to top
View user's profile
Display posts from previous:   
Post new topic    Reply to topic    Printer Friendly Page    Forum Index »  Management » IP Tracker
Page 1 of 1
All times are GMT + 9.5 Hours



Jump to:  


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum