can't upload sitemap to google

Status
Not open for further replies.
U

ubaidabcd

Banned
Dec 12, 2006
1,030
7
0
I'm using Google's webmaster tool to upload a sitemap. The sitemap was created on my WP blog from the Google sitemap plug-in. The sitemap.xml is in the root directory, but when I try to upload I'm getting this error:

"URL restricted by robots.txt
We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit. "

I tried renaming robots.txt and uploading but it didn't work.

Any suggestions?

Thanks
 


never ran into that before. post your robots.txt (even though you renamed it, it might still be using the old version).
 
User-agent: Googlebot

Disallow: /wp-content/
Disallow: /trackback/
Disallow: /wp-admin/
Disallow: /feed/
Disallow: /archives/
Disallow: /sitemap.xml
Disallow: /index.php
Disallow: /*?
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: */feed/
Disallow: */trackback/
Disallow: /page/
Disallow: /tag/
Disallow: /category/

User-agent: Googlebot-Image
Disallow: /wp-includes/

User-agent: Mediapartners-Google*
Disallow:

User-agent: ia_archiver
Disallow: /

User-agent: duggmirror
Disallow: /

User-Agent: Googlebot
Disallow: /link.php
Disallow: /gallery2
Disallow: /gallery2/
Disallow: /category/
Disallow: /page/
Disallow: /pages/
Disallow: /feed/
Disallow: /feed
# BEGIN XML-SITEMAP-PLUGIN
Sitemap: http://xxxxxx.com/sitemap.xml.gz
# END XML-SITEMAP-PLUGIN
 
you're blocking a lot of things that shouldn't be blocked if you want to get the best indexing possible. though i also block archive.org (ia_archiver) from my sites as well.
 
ubaidabcd said:
should I just delete it?
Click to expand...

Here's what I would recommend you have:

Code: 
Sitemap: http://xxxxxx.com/sitemap.xml.gz

User-agent: ia_archiver
Disallow: /
You said in your original post your sitemap was sitemap.xml, but your robots is saying it's sitemap.xml.gz (compressed file). So fix that line accordingly.
 
are you saying to just add that ia-archiver disallow to the current robots.txt?

or are you talking about just having those 2 lines for robot.txt? and delete everything else?
 
ubaidabcd said:
are you saying to just add that ia-archiver disallow to the current robots.txt?

or are you talking about just having those 2 lines for robot.txt? and delete everything else?
Click to expand...
I'm saying just have those 3 lines I wrote be your whole robots.txt. And fix the sitemap line based on what the extension of your sitemap file actually is.
 
ChuckleFuck said:
I'm saying just have those 3 lines I wrote be your whole robots.txt. And fix the sitemap line based on what the extension of your sitemap file actually is.
Click to expand...

Thanks for clearing that up, sorry I'm not the most tuned in person. I'll change my robots.txt to what you suggested and as far as sitemap.xml or sitemap.xml.gz I'm not sure which one is the correct one since they were created by the "google sitemap" plug-in for WP and it created both of them. I think maybe the one with .gz could just be a backup?


Thanks again
 
Also how long do I have to wait until I can resubmit my sitemap? Last night I deleted robots.txt while I was waiting for your response and Google is still giving the same error.
 
If you're using the google sitemap plugin, its probably in the form of yourdomain/sitemap.xml or yourdomain/blog/sitemap.xml (basically whichever directory you uploaded your blog to).

You can resubmit your sitemap right now if you want to. Has google re-analyzed your robots.txt file since the last time? That could be why you still have the same error.
 
That plugin has a checkbox if you want to use GZ compression or not.
If checked, /sitemap.xml.gz
If not checked, /sitemap.xml

Now, there are also setting for when to notify Google. Look at the 'Change Frequencies' section. There are only hints, but they help.
 
Status
Not open for further replies.
Top Bottom