corsasport.co.uk
 

Corsa Sport » Message Board » Off Day » Geek Day » googlebot/yahoo slurp


New Topic

New Poll
  <<  1    2  >> Subscribe | Add to Favourites

You are not logged in and may not post or reply to messages. Please log in or create a new account or mail us about fixing an existing one - register@corsasport.co.uk

There are also many more features available when you are logged in such as private messages, buddy list, location services, post search and more.


Author googlebot/yahoo slurp
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
21st Dec 07 at 20:35   View Garage View User's Profile U2U Member Reply With Quote

anyone know how to run a check on an ip address to determine if its a googlebot or yahoo slurp bot crawling the site?
Deadude
Member

Registered: 30th Jun 07
Location: Spondon, Derby
User status: Offline
22nd Dec 07 at 21:49   View User's Profile U2U Member Reply With Quote

no the ip address??
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
22nd Dec 07 at 21:53   View Garage View User's Profile U2U Member Reply With Quote

the answer is

if ( strpos( $_SERVER['HTTP_USER_AGENT'], 'Googlebot' ) !== false )
{
$user_agent="(Googlebot)";
}

allows me to do this



need to find out some more of the main ones like Live etc

[Edited on 22-12-2007 by Steve]
Deadude
Member

Registered: 30th Jun 07
Location: Spondon, Derby
User status: Offline
22nd Dec 07 at 21:59   View User's Profile U2U Member Reply With Quote

i dont think googlebot is never not connected to our site at work seems to always b there...
James
Member

Registered: 1st Jun 02
Location: Surrey
User status: Offline
22nd Dec 07 at 22:21   View User's Profile U2U Member Reply With Quote

Nice feature Steve.
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
23rd Dec 07 at 18:02   View Garage View User's Profile U2U Member Reply With Quote

cheers james
James
Member

Registered: 1st Jun 02
Location: Surrey
User status: Offline
23rd Dec 07 at 19:19   View User's Profile U2U Member Reply With Quote

I always think it's the little things that make a good website, the use of Ajax on Facebook for example I think is awesome.
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
23rd Dec 07 at 20:24   View Garage View User's Profile U2U Member Reply With Quote

facebooks going downhill, i keep getting random crashing errors these days
Ian
Site Administrator

Avatar

Registered: 28th Aug 99
Location: Liverpool
User status: Offline
24th Dec 07 at 02:11   View Garage View User's Profile U2U Member Reply With Quote

Most robots will indicate as such in the user agent.

Bad news - there are loads of them.

[Edited on 24-12-2007 by Ian]
Ian
Site Administrator

Avatar

Registered: 28th Aug 99
Location: Liverpool
User status: Offline
24th Dec 07 at 02:53   View Garage View User's Profile U2U Member Reply With Quote

More bad news - I stole your idea.
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
24th Dec 07 at 08:36   View Garage View User's Profile U2U Member Reply With Quote

haha its ok its not like iv never stole your ideas
Ian
Site Administrator

Avatar

Registered: 28th Aug 99
Location: Liverpool
User status: Offline
24th Dec 07 at 15:23   View Garage View User's Profile U2U Member Reply With Quote

Got some funky ones.

Opera/9.10 (Nintendo Wii; U; ; 1621; en)
Nokia6300/2.0 (04.71) Profile/MIDP-2.0 Configuration/CLDC-1.1

Had a PS3 before as well but I didn't copy the string.
IvIarkgraham
Premium Member

Avatar

Registered: 27th Mar 04
Location: Ellesmere Port, Cheshire
User status: Offline
24th Dec 07 at 15:28   View Garage View User's Profile U2U Member Reply With Quote

so you can see when people are browsing from there specific model of phone or ps3?

ive been on with my ps3 its crap really small writing
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
24th Dec 07 at 15:38   View Garage View User's Profile U2U Member Reply With Quote

quote:
Originally posted by Ian
Got some funky ones.

Opera/9.10 (Nintendo Wii; U; ; 1621; en)
Nokia6300/2.0 (04.71) Profile/MIDP-2.0 Configuration/CLDC-1.1

Had a PS3 before as well but I didn't copy the string.


yeah have you got Twiceler on yours?

http://www.cuill.com ? tahts fairly active on mine

found some jeeves ones too

[Edited on 24-12-2007 by Steve]
Robbo
Member

Registered: 6th Aug 02
Location: London
User status: Offline
24th Dec 07 at 15:43   View User's Profile U2U Member Reply With Quote

I occasionally browse on my works Nokia E50

Steve, what are googlebots and yahoo slurps?
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
24th Dec 07 at 15:47   View Garage View User's Profile U2U Member Reply With Quote

search engine bots spidering forums
Nath
Member

Registered: 3rd Apr 02
Location: MK
User status: Offline
24th Dec 07 at 15:48   View User's Profile U2U Member Reply With Quote

quote:
Originally posted by IvIarkgraham
so you can see when people are browsing from there specific model of phone or ps3?

ive been on with my ps3 its crap really small writing


Push the left stick in (I think) and it zooms.

I've surfed CS on my PS3. Done it when I can't be arsed to boot my PC.
Robbo
Member

Registered: 6th Aug 02
Location: London
User status: Offline
24th Dec 07 at 15:48   View User's Profile U2U Member Reply With Quote

Que?
Ian
Site Administrator

Avatar

Registered: 28th Aug 99
Location: Liverpool
User status: Offline
24th Dec 07 at 15:56   View Garage View User's Profile U2U Member Reply With Quote

http://en.wikipedia.org/wiki/Googlebot
http://en.wikipedia.org/wiki/Slurp
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
24th Dec 07 at 16:39   View Garage View User's Profile U2U Member Reply With Quote

is it sad im programming stuff on xmas eve
Nath
Member

Registered: 3rd Apr 02
Location: MK
User status: Offline
24th Dec 07 at 16:42   View User's Profile U2U Member Reply With Quote

quote:
Originally posted by Steve
is it sad im programming stuff on xmas eve


Naa. Better than shopping.
James
Member

Registered: 1st Jun 02
Location: Surrey
User status: Offline
24th Dec 07 at 17:00   View User's Profile U2U Member Reply With Quote

I was programming stuff on xmas eve.

Oh wait, I was at work
Robbo
Member

Registered: 6th Aug 02
Location: London
User status: Offline
24th Dec 07 at 18:08   View User's Profile U2U Member Reply With Quote

quote:
Originally posted by Ian
http://en.wikipedia.org/wiki/Googlebot
http://en.wikipedia.org/wiki/Slurp
I see SO they arent malicious then?
Steve
Premium Member

Avatar

Registered: 30th Mar 02
Location: Worcestershire Drives: Defender
User status: Offline
24th Dec 07 at 18:13   View Garage View User's Profile U2U Member Reply With Quote

not those particular bots, but you can get malicious bots
Ian
Site Administrator

Avatar

Registered: 28th Aug 99
Location: Liverpool
User status: Offline
25th Dec 07 at 00:04   View Garage View User's Profile U2U Member Reply With Quote

Guest
23:59
3m 18s
Browsing: Geek Day
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.11) Gecko/20071216 Firefox/2.0.0.11


  <<  1    2  >>
New Topic

New Poll

  Related Threads Author Forum Replies Views Last Post
Black Corsa For Sale Lawrence Classifieds 9 268
4th Apr 03 at 13:25
by J 11ESY
 
just busted theivin scum...... psycho sport General Chat 22 293
5th Sep 03 at 12:46
by Scott M
 
Operation Skyline - Newcastle AK General Chat 88 3142
6th Jan 04 at 17:04
by Andy Stocker
 
Advice with Noisey Neighbour barteh General Chat 31 1676
10th Feb 05 at 11:54
by barteh
 
2.0 16v Arden Blue Corsa SOLD!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Tom N Cars Offered 150 9431
7th Feb 06 at 14:03
by jonnycash
 

Corsa Sport » Message Board » Off Day » Geek Day » googlebot/yahoo slurp 28 database queries in 0.0161700 seconds