Hello There, Guest! Register

Or login with facebook connect Facebook, or Windows Live

Login or Register to remove all advertising



1 user browsing this thread: (0 members, and 1 guest).

Post Reply 
Blocking Googlebot?
Author Message
Data4
Offline
Contributes Regularly




Joined: Aug 2009
Sex: Male
Posts: 203

Reputation: 4634
Rep Post

Thanks Given: 33
Thanks received:
237 thanks in 92 posts



Post: #1
Blocking Googlebot?
05-06-2010 2:12 AM

Is there any way to block the GoogleBot? Right now, I see listed among members viewing the forums, "Mediapartners-Google, GoogleBot", and it creeps me out. Some of the stuff I've posted or will post in the future may or may not be for public consumption, other than my phero friends.
05-06-2010 2:12 AM
Find all posts by this user Quote this message in a reply
Login or register to remove all advertising

mark-in-dallas
Offline
Nobody Special




Joined: Aug 2009
Sex: Male
Posts: 2,238

Reputation: 10805
Rep Post

Thanks Given: 594
Thanks received:
1363 thanks in 728 posts



Post: #2
RE: Blocking Googlebot?
05-06-2010 7:11 AM

Blocking Google would end up with us dropping off the Google search results pages, which is where most of our traffic comes from.

The search engines can only see what unregistered guests can see though, so anything that you don't want showing up on Google can be written in your Journal and it'll be safe from search engines and the general public.


Don't be this guy!


Theme song for PheroTruth members!

05-06-2010 7:11 AM
Visit this user's website Find all posts by this user Quote this message in a reply
Data4
Offline
Contributes Regularly




Joined: Aug 2009
Sex: Male
Posts: 203

Reputation: 4634
Rep Post

Thanks Given: 33
Thanks received:
237 thanks in 92 posts



Post: #3
RE: Blocking Googlebot?
05-07-2010 6:47 AM

Ah, okay. Good to know. Thanks, Mark!
05-07-2010 6:47 AM
Find all posts by this user Quote this message in a reply
Tisha
Offline
Inactive Account




Joined: Aug 2009
Sex: Female
Posts: 240

Reputation: 2
Rep Post

Thanks Given: 148
Thanks received:
205 thanks in 157 posts



Post: #4
RE: Blocking Googlebot?
05-08-2010 8:55 AM

I dont believe google bot can get into the journal section although I am not sure of this. Maybe Mark can elaborate on this.

Either way they can not see your personal info and they are just scanning for keywords to up the rating on goggle.

Tisha
05-08-2010 8:55 AM
Find all posts by this user Quote this message in a reply
yetis
Offline
Getting comfortable




Joined: Apr 2010
Sex: Male
Posts: 32

Reputation: 75
Rep Post

Thanks Given: 6
Thanks received:
6 thanks in 4 posts



Post: #5
RE: Blocking Googlebot?
05-10-2010 12:33 PM

You can block robots with a textfile called robots.txt and put it in the root directory on the server.

Here's an example robots.txt:



# robots.txt
# URL: http://www.pherotruth.com

#allow to spider the domain
User-agent: *
Disallow:

# don't spider /logs and /stats
User-agent: *
Disallow: /logs
Disallow: /stats




Maybe this helps a little bit.

cul8er.

My Arsenal:
- A314, Instant Openness 2x, IH 4x, IS 4x, Ammunition 1x, Tuth, IG, IJ,CTTM2, Molecule A & C
- Wolf, Aqua Vitae un, Nude un, Possess, Passion
- Chikara, 3x NPA 10ml, SOE, Alter Ego, Perception, EoW-Copulins, Liquid Trust, Pheromax, P6, Contact18, Manesty's, Legend
- A-none, A-rone, B-rone, A-stanone, A-nol, B-nol, A-1, Est, Estradiol, DHEA-s
05-10-2010 12:33 PM
Find all posts by this user Quote this message in a reply
Login or register to remove all advertising


Share This Thread
Del.icio.us Digg FURL FaceBook Stumble Upon Reddit SlashDot Ask BlinkBits BlinkList Co.mments Delirious Feed Me Links Google Bookmarks Linkagogo Ma.gnolia MSN Live Netscape Netvouz Newsvine RawSugar Rojo Smarking Socializer Sphinn Spurl Squidoo Tailrank Technorati Yahoo My Web
Post Reply 


Forum Jump:


Login or Register to remove all advertising
True Pheromones
Current time: 05-23-2012, 1:45 PM
Contact Us Home Return to Content Lite (Archive) Mode RSS Syndication Forum Disclaimer