robots txt. file
Category: Premium Website Builder
How do i create a robots txt file? Then what do i do with it after i create it.
Thanks for contacting us. I'm more than happy to assist you. Website owners that wish to instruct search engines on which pages to crawl and index on their website's can use a robots.text file to do so. You can do a lot with a robots.txt file so if you'd like to know more please feel free to review our article:
<a href="http://www.inmotionhosting.com/support/website/how-to/how-to-stop-search-engines-from-crawling-your-website">Robots.txt Files</a>
Once you have created the robots.txt file it will need to be uploaded to your document root for that domain.
If you need further assistance or have questions please feel free to contact us.
Like this Question? Tweet
Related ArticlesVideo Tutorial on How to Use the Builder to Build a Website
FAQ: Adding Images or Graphics in the Builder
Understanding the Image Gallery in the Builder
Dealing with comment spam
Changing the Page and File names in the Builder