Most BB software allows you to add all the IPs of the search engines so they show up as users. That way you can see when they are indexing and you can easily allow or restrict what forums they can index. A lot easier than creating .htaccess rules.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.