Originally Posted by Oliver
With all due respect Sam, are you living in a dream world? Unless your robots file specifies indexing for SE's over users, then pages that are unavailable will not be indexed.
|
When google and other se bots come onto the site they are automatically recognized as bots and are hooked up to the members group. So Googlebot and other SE's doesn't browse like a guest.
Standard setting you can change in IPB.
Download User Agent Switcher for Firefox to see if I really live in a dreamworld... Seems fine here