InMotion Hosting Support Center

Googlebot Error

Category: Google Tools

2013-05-15 7:28 pm EST

Hits: 2,183
I've gotten a message from Google that "Googlebot can't access your site". The first one was for 5/13 with an error rate of 100%. Second one 5/14 with error rate of 42.9%.

The only thing I might have done to change anything is update my sitemap.xml yesterday before I knew about this problem.

You must login before you can ask a follow up question.

You must login before you can submit an answer.

Hi AngelElegance, did Google report the same on 5/15 as well?
5,399 Points
2013-05-16 01:21 pm EST
No other emails since 5/14. Hoping that whatever happened may be gone.
11 Points
2013-05-17 03:22 pm EST



40,316 Points
2013-05-15 7:39 pm EST
Hello AngelElegance,

You may not have been aware, but the ecommerce software that you are using (PrestaShop) automatically generates a ROBOTS.TXT file. This file is used to limit access from bots (like Googlebot). The file is located in your PUBLIC_HTML folder. You can edit it using the cPanel File Manager. In some cases, this using the ROBOTS.TXT file is necessary and a good thing. It just depends on how you want to set it. If you want learn more about how to use the Robots.txt file, go to Stop Search Engines from Crawling your website, or you may want to review this web page from for much more indepth usage of the ROBOTS.TXT file . The advantage of allowing something like googlebot is that it can help with search engine issues. The downside is that multiple bots like googlebot can have a marked effect on the performance of your website. Please review the documentation on Robots.txt and then decide how you want to use those settings.

If you have any further questions, please contact technical support available 24 hours a day / 7 days a week.

Arnel C.
InMotion Hosting
Community Support Team

You must login before you can post a comment about this answer.

The robots.txt file hasn't changed since September, 2012 and everything worked fine until 2 days ago.
11 Points
2013-05-15 7:55 pm EST
Hello AngelElegance,

I'm sorry that the issue with Googlebot is occurring. We do not block the bot. The only way that it is blocked is typically through the robots.txt, .htaccess file, or possible issue DNS or the server being down itself. In this case your server is operational, and the DNS is okay. You do have quite a few entries in your .htaccess file that may be affecting it. You can actually find out what's causing the Googlebot issues by logging into your Google Webmaster Tools account and then checking your website there. We have a series of articles on using the Google Webmaster Tools starting with an introduction on its use. Google will be able to provide particular information on your site that should give you the details you need to determine why it's happening.

If you have any further questions, please leave a comment with more details and and we will be happy to review the issue for you.

Arnel C.
Community Support Team
40,316 Points
2013-05-15 8:07 pm EST

2016-07-05 1:07 am EST
May be be you din't followed the procedure or your URL is wrong submitted so please cross check .

You must login before you can post a comment about this answer.

Like this Question?

Support Center Login

Our Login page has moved, Click the button below to be taken to the login page.

Social Media Login

Social Login Joomla

Need more Help?


Ask the Community!

Get help with your questions from our community of like-minded hosting users and InMotion Hosting Staff.

Current Customers

Chat: Click to Chat Now E-mail:
Call: 888-321-HOST (4678) Ticket: Submit a Support Ticket

Not a Customer?

Get web hosting from a company that is here to help. Sign up today!