Jump to content
Sign in to follow this  

Google Can No Longer Reach My Robot.txt

Recommended Posts


I am not a pro-user by any means. I am more intermediate. If I am given detailed instructions I can usually figure something out. That said, on November 6th my hosting company, dotster.com, switched over to some new fancy system on their end. Since then Google has not been able to access the robot.txt file that wordpress automatically sets up for you. Since they can no longer reach that file my site can not be crawled and sitemaps can not be submitted. I have practically disappeared from search results for all my keywords.

Google says that it could be a problem with my hosting company. So I called them and they said that since they made the switch to the new system on november 6th my site has been submitting to many php's or scripts or something. This is where things start feeling a bit over my head. They said that my mysql is getting jammed because my site is going over the limit and is shutting down access to google for some reason. I can reach my robot.txt file if i type it in but google cannot for some reason. They said that it may be my theme that I am using. Has anyone had this problem before? Is there anyway I can figure out what scripts or php file is sending too much information to my host?

I recently installed W3 Total Cache plugin to my site because that was recommended to shrink down the files or something but that hasn't done anything.

Can anyone help me? I need to get my site searchable ASAP!


Share this post

Link to post
Share on other sites


I am 100% certain this is not a PageLines related issue. For assistance with this issue, you're best contacting Wordpress support or your host. We are unable to provide support for Wordpress related issues or server configuration issues.

If your site was working perfectly before your host decided to move you, then I think you need to ask your host why this is. Also ask them for your server info, what PHP version, MySQL, your PHP memory limit etc...

Please search our forums, before posting!

Share this post

Link to post
Share on other sites

Alright thanks. I just wanted to make sure that there wasn't anything I could do on my end.

Share this post

Link to post
Share on other sites

The topic was marked as resolved.

Mackenzie - PageLines Help Desk

The Centsible Family - Writer, Photographer and Coffee Addict


Kindly search this forum and read the documentation before posting. It will help you resolve many issues.

For CSS help be sure to check out W3Schools first and be sure to download FireBug for FireFox for troubleshooting.

Share this post

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this  

  • Similar Content

    • tuciudadenred
      By tuciudadenred+
      Hi everyone, what happens is that the web page metrosalarmas.com has a google tags which I have not attacked where I can look to remove those tags and be able to locate the correct ones.
    • Michael Kummer
      By Michael Kummer+
      Hi guys,
      It seems like the H1 tag in the Pagelines 5 framework is missing the entry-title tag. Google Search Console complains about that and it seems like it needs to be fixed in the theme. Based on another thread, this looks like a known issue but I haven't seen any updates from the framework team.
      Any indication of what the status on this issue is?
      The site in question that I have that issue with is michaelkummer.com.
    • kellid
    • gerolan
      By gerolan+
      Whenever I try to use the maps section the map doesn't display and the console throws a MissingKeyMapError.
    • richardjacruz
      By richardjacruz+
      I noticed that the cached version of the website from a Google SERP has broken CSS:
      Any idea why? The site looks fine elsewhere.
      Also, when using the Web Developer Toolbar in Mozilla Firefox, there are a BUNCH of warnings regarding CSS. I'm wondering that's the problem with the Google cache.
      In a prior post, I had experienced similar "breaking" of the CSS, but that was due to some errors in DNS. I thought we resolved all of that, so this perplexes me.