Hello There, Guest! Register

Or login with facebook connect Facebook, or Windows Live

Login or Register to remove all advertising



1 user browsing this thread: (0 members, and 1 guest).

Post Reply 
Blocking Googlebot?
Author Message
Data4
Away
Contributes Regularly




Joined: Aug 2009
Sex: Male
Posts: 112

Reputation: 4456
Rep Post

Thanks Given: 3
Thanks received:
75 thanks in 33 posts



Post: #1
Blocking Googlebot?
05-06-2010 2:12 AM

Is there any way to block the GoogleBot? Right now, I see listed among members viewing the forums, "Mediapartners-Google, GoogleBot", and it creeps me out. Some of the stuff I've posted or will post in the future may or may not be for public consumption, other than my phero friends.
05-06-2010 2:12 AM
Find all posts by this user Quote this message in a reply
Login or register to remove all advertising

mark-in-dallas
Offline
Nobody Special




Joined: Aug 2009
Sex: Male
Posts: 1,983

Reputation: 10727
Rep Post

Thanks Given: 510
Thanks received:
1062 thanks in 579 posts



Post: #2
RE: Blocking Googlebot?
05-06-2010 7:11 AM

Blocking Google would end up with us dropping off the Google search results pages, which is where most of our traffic comes from.

The search engines can only see what unregistered guests can see though, so anything that you don't want showing up on Google can be written in your Journal and it'll be safe from search engines and the general public.

[Image: vipersig.jpg]
In the end, your legacy should be what you've accomplished and what you left behind, not what battles you fought and who you drove into the dust.
05-06-2010 7:11 AM
Visit this user's website Find all posts by this user Quote this message in a reply
Data4
Away
Contributes Regularly




Joined: Aug 2009
Sex: Male
Posts: 112

Reputation: 4456
Rep Post

Thanks Given: 3
Thanks received:
75 thanks in 33 posts



Post: #3
RE: Blocking Googlebot?
05-07-2010 6:47 AM

Ah, okay. Good to know. Thanks, Mark!
05-07-2010 6:47 AM
Find all posts by this user Quote this message in a reply
Tisha
Offline
Inactive Account




Joined: Aug 2009
Sex: Female
Posts: 240

Reputation: 1
Rep Post

Thanks Given: 148
Thanks received:
197 thanks in 155 posts



Post: #4
RE: Blocking Googlebot?
05-08-2010 8:55 AM

I dont believe google bot can get into the journal section although I am not sure of this. Maybe Mark can elaborate on this.

Either way they can not see your personal info and they are just scanning for keywords to up the rating on goggle.

Tisha
05-08-2010 8:55 AM
Find all posts by this user Quote this message in a reply
yetis
Offline
Getting comfortable




Joined: Apr 2010
Sex: Male
Posts: 32

Reputation: 75
Rep Post

Thanks Given: 6
Thanks received:
6 thanks in 4 posts



Post: #5
RE: Blocking Googlebot?
05-10-2010 12:33 PM

You can block robots with a textfile called robots.txt and put it in the root directory on the server.

Here's an example robots.txt:



# robots.txt
# URL: http://www.pherotruth.com

#allow to spider the domain
User-agent: *
Disallow:

# don't spider /logs and /stats
User-agent: *
Disallow: /logs
Disallow: /stats




Maybe this helps a little bit.

cul8er.

My Arsenal:
- A314, Instant Openness 2x, IH 4x, IS 4x, Ammunition 1x, Tuth, IG, IJ,CTTM2, Molecule A & C
- Wolf, Aqua Vitae un, Nude un, Possess, Passion
- Chikara, 3x NPA 10ml, SOE, Alter Ego, Perception, EoW-Copulins, Liquid Trust, Pheromax, P6, Contact18, Manesty's, Legend
- A-none, A-rone, B-rone, A-stanone, A-nol, B-nol, A-1, Est, Estradiol, DHEA-s
05-10-2010 12:33 PM
Find all posts by this user Quote this message in a reply
Login or register to remove all advertising


Share This Thread
Del.icio.us Digg FURL FaceBook Stumble Upon Reddit SlashDot Ask BlinkBits BlinkList Co.mments Delirious Feed Me Links Google Bookmarks Linkagogo Ma.gnolia MSN Live Netscape Netvouz Newsvine RawSugar Rojo Smarking Socializer Sphinn Spurl Squidoo Tailrank Technorati Yahoo My Web
Post Reply 


Forum Jump:


Login or Register to remove all advertising
True Pheromones
Current time: 02-06-2012, 7:48 PM
Contact Us Home Return to Content Lite (Archive) Mode RSS Syndication Forum Disclaimer