Site Management, Site Design
How do I add a robots.txt file in order to prevent web spiders from accessing part of my website?
You may complete the following steps in order to add a robots.txt file.
- Create a new Page Style and paste the contents of your robots.txt file into it.
- Create a Page and apply the new Page Style to it.
- Set the Short Link for the new Page to "robots.txt".
Now, you should be able to view the robots.txt at the example URL below.