PDA

View Full Version : robots.txt for addon domains?



user777
12-05-2006, 11:38 AM
Hi,

I have "Disallow :/ all user-agent" on my main account's domain as follow:


User-agent: *
Disallow: /

But I have addon domains that I'd like to index by search engines. So, I'm wondering can I make another separate robots.txt for my addon domains or do I have to modify the main account's domain robots.txt to allow search engine to search addon domains ?

Thanks.

Pethens
12-05-2006, 02:38 PM
Each addon domain needs a separate robots.txt which is stored in the root directory of that domain. The main domain's robots.txt will not affect bot access to your addon domains except in the rare case that somebody accesses an addon domain as www.maindomain.com/addon/stuff. Since you presumably have no links to such an address, this case should never come up.

Hope that helps,

Stephen

user777
12-05-2006, 04:56 PM
That answers my question. Thanks a million.