318ti.org forum

Go Back   318ti.org forum > Garage > Lounge
Reload this Page Yahoo! Slurp Spider ?
Register FAQ Donate Calendar Today's Posts Search

Notices

Lounge Temporary forum until new sections are suggested.

.
» Recent Threads
1995 318i M42 removal of...
Today 02:07 AM
Last post by BertrandP102
Today 02:07 AM
0 Replies, 85 Views
My 318ti build
05-21-2024 04:48 PM
Last post by two30grain
05-28-2024 06:42 PM
1 Replies, 1,989 Views
E30 trailing arms
05-28-2024 04:43 PM
Last post by packratbimmer
05-28-2024 04:43 PM
0 Replies, 254 Views
OMG!OMG!
05-28-2024 08:53 AM
Last post by Kathylaf
05-28-2024 08:53 AM
0 Replies, 431 Views
FS: Racing Dynamics RGR...
05-24-2024 03:29 AM
Last post by 7Senna8
05-24-2024 03:29 AM
0 Replies, 1,262 Views
Reply Share/Bookmark
 
Thread Tools Display Modes
Old 04-06-2006, 08:29 PM   #1
Mothman
Senior Member
 
Mothman's Avatar
 
Join Date: Apr 2005
Location: Southern California
Posts: 420
Vehicles
iTrader: (0)
Photo Gallery
Question Yahoo! Slurp Spider ?
What's a Yahoo! Slurp Spider ? Every time I come to the site I see 7 to 10 of these viewing several forms at one time?
__________________
"Success is Never Final, Defeat is Never Permanent, it is the Courage to Continue that Matters!" - Winston Churchill

Mothman

[SIGPIC]
Mothman is offline   Reply With Quote
Old 04-06-2006, 10:32 PM   #2
1996 328ti
Senior Member
 
1996 328ti's Avatar
 
Join Date: Jun 2003
Location: Greenville, SC
Posts: 9,356
Vehicles
iTrader: (1)
Photo Gallery
Default
It's indexing the message board.
Google also hits the site hard.
__________________
...steven
BMW CCA #146825
1996 BMW 328ti • 2003 MINI Cooper S • 2016 M235i
www.bmwcca.org
1996 328ti is offline   Reply With Quote
Old 04-06-2006, 11:06 PM   #3
aceyx
Senior Member
 
aceyx's Avatar
 
Join Date: Aug 2004
Location: state college, pa
Posts: 3,431
iTrader: (0)
Photo Gallery
Default
Quote:
Originally Posted by 1996 328ti
It's indexing the message board.
Google also hits the site hard.
You know about robots.txt?

I suppose you want the site to show up on search, but you could always **** tag the splash page.
__________________
I scream, you scream, we all scream for ZOMBIES.
aceyx is offline   Reply With Quote
Old 04-07-2006, 12:39 AM   #4
1996 328ti
Senior Member
 
1996 328ti's Avatar
 
Join Date: Jun 2003
Location: Greenville, SC
Posts: 9,356
Vehicles
iTrader: (1)
Photo Gallery
Default
Quote:
Originally Posted by aceyx
You know about robots.txt?

I suppose you want the site to show up on search, but you could always **** tag the splash page.
Yes. msnbots are forbidden.
There was a time that msn was consuming 30% of my bandwidth.
It caused the site to go down a few times.

http://www.318ti.org/robots.txt
__________________
...steven
BMW CCA #146825
1996 BMW 328ti • 2003 MINI Cooper S • 2016 M235i
www.bmwcca.org
1996 328ti is offline   Reply With Quote
Reply

Bookmarks

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT +1. The time now is 08:46 AM.

Donate - Contact Us - www.318ti.org - Archive - Top

.
Powered by site supporters
vBulletin Version 3.8.8
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright ©1999 - 2024, 318ti.org
© vBadvanced CMPS v3.2.2
[page compression: 73.65 k/86.46 k (14.82%)]

318ti.org does not warrant or assume any legal liability or responsibility for the accuracy, completeness, or usefulness of any information or products discussed.