Knowledge Base

Answers to Common liveSite Questions

Back to Knowledge Base

 
Site Management, Site Design

How do I add a robots.txt file in order to prevent web spiders from accessing part of my website?

You may complete the following steps in order to add a robots.txt file.

  • Create a new Page Style and paste the contents of your robots.txt file into it.
  • Create a Page and apply the new Page Style to it.
  • Set the Short Link for the new Page to "robots.txt".

Now, you should be able to view the robots.txt at the example URL below.

http://www.example.com/robots.txt

 


 
Add Feedback:
Was this page helpful? Please let us know how we can improve it.
Please login or register to add your feedback.