It shows that you are unregistered. Please register with us by clicking Here
![]() |
|
![]() |
![]() | Register - FAQ - Today's Posts - New Posts - Support - Search | ![]() |
|
|
#1 (permalink) |
|
Junior Member
Join Date: Jul 2006
Posts: 6
|
For some reason we don't allow search engines on our forum. We do have it in our joomla and would like to implement it also in the smf.
My question: google does get information about content and we do block unwanted ad-sites. Would it run accurately within smf even w/o letting google examine the forum? If we had to allow google: is there a way to tell the bot not to cache the content but just examine it for the ad? |
|
|
|
|
|
|
|
#2 (permalink) |
|
Posts: n/a
|
On paper, the answer is that you can use robots.txt to diallow Googlebot while allowing the Adsense bot.
http://www.google.com/support/webmas...366&topic=8846 However, There's recently been a change where all the various google bots feed a common cache, to reduce the need for multiple spiderings of the same page. So it really depends on your goal for keeping out the bots. If all you want to do is stop caching, there's a meta tag for that. see also http://www.mattcutts.com/blog/crawl-caching-proxy/ http://www.mattcutts.com/blog/bot-ob...ing-googlebot/ |
|
![]() |
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Default access permissions | yvsanil | Site and Server Administration | 1 | 10-12-2006 08:46 AM |
| Understanding access permissions | yvsanil | Site and Server Administration | 1 | 10-12-2006 08:44 AM |
| Table Access Slow | jason | Site and Server Administration | 0 | 07-29-2006 04:14 PM |
| Automatic Hyperlinking and OCR Ms Access | jason | ASP | 0 | 07-27-2006 07:32 PM |
| What is code access security (CAS)? | agaba175 | .NET | 1 | 07-21-2006 01:24 PM |