How to stop GoogleBot ?

How to stop GoogleBot ?

Posted by: dinochopins
Posted on: 2007-08-02 05:50:00

Hi,

I currently have MyBB installed on my site and seems that GoogleBot is the one who is always online and crawl the site. How do I stop it to crawl to all thread ?



Dino

Re: How to stop GoogleBot ?

Posted by: sdayman
Posted on: 2007-08-02 06:17:00

It's in their FAQ:
http://www.google.com/support/webmasters/bin/topic.py?topic=8843



-Scott

Re: How to stop GoogleBot ?

Posted by: scjessey
Posted on: 2007-08-02 06:23:00

Put this in your robots.txt file:

User-agent: Googlebot
Disallow: /

-- si-blog --

Re: How to stop GoogleBot ?

Posted by: dinochopins
Posted on: 2007-08-02 09:02:00

Thanks Scott, this is what I need !

Dino

Re: How to stop GoogleBot ?

Posted by: dinochopins
Posted on: 2007-08-02 09:02:00

In reply to:

User-agent: Googlebot
Disallow: /

Thanks SCJessey !


Dino

Re: How to stop GoogleBot ?

Posted by: wholly
Posted on: 2007-08-12 08:04:00

Call on "Voltron"?

Wholly - Use promo code WhollyMindless for full 97$ credit. Let me know if you want something else!

Tags: googlebotmybbdino