Robots.txt file
Search engines such as Google, crawl the web to index the web content for users to search. You may not want your installation of Moxie's Channels software to be indexed.
The installer in Channels 9.4 CU11 inserts a robots.txt file which gives instructions about your site to web crawlers; using the Robots Exclusion Protocol.
It is configured to prevent indexing for the following directories and their child directories.
- netagent
- proactive
- email portal
- survey (beginning with 9.4 CU 11 QFE 1)
- Multi-Channel Web Service (beginning with 9.4 CU 11 QFE 1)
If your installation uses other installation paths, you may want to copy and add the robots.txt file to those root directories. A copy may be found the <Channels Install Path>\http\wwwroot location
If your default website has the root directory different from the <install path>/http/wwwroot, you must find the root and copy the file into it as follows:
- Open inetmgr
- Right click on “Default Web Site” and select Explore. This is the root directory in which the robots.txt has to be placed.
- Copy the robots.txt available in the <Channels Install Path>\http\wwwroot.
- Paste the file in the root directory (see step 2 above).
- If your installation includes Survey and Multi-Channel-Web-Service, right-click the respective web site and paste the robots.txt in the root directory.
- Restart IIS