Googlebot Error

Category: Google Tools

AngelElegance
Asked:
2013-05-15 7:28 pm EST

Hits: 1,836
I've gotten a message from Google that "Googlebot can't access your site". The first one was for 5/13 with an error rate of 100%. Second one 5/14 with error rate of 42.9%.

The only thing I might have done to change anything is update my sitemap.xml yesterday before I knew about this problem.

You must login before you can ask a follow up question.

You must login before you can submit an answer.

Hi AngelElegance, did Google report the same on 5/15 as well?
BradM
5,399 Points
2013-05-16 01:21 pm EST
No other emails since 5/14. Hoping that whatever happened may be gone.
AngelElegance
11 Points
2013-05-17 03:22 pm EST

OTHER ANSWERS

1

Arn
Staff
17,351 Points
2013-05-15 7:39 pm EST
Hello AngelElegance,

You may not have been aware, but the ecommerce software that you are using (PrestaShop) automatically generates a ROBOTS.TXT file. This file is used to limit access from bots (like Googlebot). The file is located in your PUBLIC_HTML folder. You can edit it using the cPanel File Manager. In some cases, this using the ROBOTS.TXT file is necessary and a good thing. It just depends on how you want to set it. If you want learn more about how to use the Robots.txt file, go to Stop Search Engines from Crawling your website, or you may want to review this web page from Robotstxt.org for much more indepth usage of the ROBOTS.TXT file . The advantage of allowing something like googlebot is that it can help with search engine issues. The downside is that multiple bots like googlebot can have a marked effect on the performance of your website. Please review the documentation on Robots.txt and then decide how you want to use those settings.

If you have any further questions, please contact technical support available 24 hours a day / 7 days a week.

Arnel C.
InMotion Hosting
Community Support Team

You must login before you can post a comment about this answer.

The robots.txt file hasn't changed since September, 2012 and everything worked fine until 2 days ago.
AngelElegance
11 Points
2013-05-15 7:55 pm EST
Hello AngelElegance,

I'm sorry that the issue with Googlebot is occurring. We do not block the bot. The only way that it is blocked is typically through the robots.txt, .htaccess file, or possible issue DNS or the server being down itself. In this case your server is operational, and the DNS is okay. You do have quite a few entries in your .htaccess file that may be affecting it. You can actually find out what's causing the Googlebot issues by logging into your Google Webmaster Tools account and then checking your website there. We have a series of articles on using the Google Webmaster Tools starting with an introduction on its use. Google will be able to provide particular information on your site that should give you the details you need to determine why it's happening.

If you have any further questions, please leave a comment with more details and and we will be happy to review the issue for you.

Arnel C.
Community Support Team
Arn
17,351 Points
Staff
2013-05-15 8:07 pm EST
Like this Question?

Related Articles

It looks like there are no related articles.
Would you like to ask a question about this page? If so, click the button below!
Ask a Question

Need more Help?

Search

Ask the Community!

Get help with your questions from our community of like-minded hosting users and InMotion Hosting Staff.

Current Customers

Chat: Click to Chat Now E-mail: support@InMotionHosting.com
Call: 888-321-HOST (4678) Ticket: Submit a Support Ticket

Not a Customer?

Get web hosting from a company that is here to help. Sign up today!