PDA

View Full Version : Error with robots text


EdHarrison
21-Mar-2009, 01:07 PM
I am worried I have made a serious error adding a robot text meta found on the knowledge base, I added this to head section on the layout of my cart pages - or so I thought but now I cant find the code and theres worse:

Webmaster tools is showing errors for 45 pages so my fear is that I am denying google access to lots of my content, I have tried searching for the code and checked where I think it would be, is there a way of finding this??


Ed

grantglendinnin
21-Mar-2009, 01:11 PM
Ed, I presume you are talking about your signature-linked site.

If so, I did not locate a robots.txt file on the server, nor could I find a trace of a meta robots tag. What are the errors that Google WMT report?

EdHarrison
21-Mar-2009, 01:18 PM
Thanks for looking - This is whats baffled me as I cant find what I put in there. Heres the code I dropped in : <META NAME="robots" CONTENT="none"> but now cant find,

Google is showing 1 4xxx error and unable to find 45 pages linked from:

http://www.harrisontelescopes.co.uk/acatalog/Astro_Imaging.html


I did have some serious issues on the date this error shows which were solved with a complete site refresh so theres some chance this may clear on the next crawl, my immediate concern is finding the above code and removing it!

Ed

grantglendinnin
21-Mar-2009, 01:24 PM
I see no reference to robot-blocking on any of your pages.

Your meta tags are:

<META name="y_key" content="c75cf4c497f17cee">
<meta name="verify-v1" content="FrXPOO14/x9Pc7JA3SFPsIosXMgCiHD/CIKyi3PqJ7k=" />
<meta name="msvalidate.01" content="E8D81D38C64315511380CFF12792968B" />

Meta keywords+description too.

I assume the code you placed to block robots (meta robots tag) was wrapped in a block so it is only active on the defined pages? It certainly isn't there now anyway. Unless you've wrongly inverted the block conditions.

EdHarrison
21-Mar-2009, 01:48 PM
Thanks for looking, I will resubmit a sitemap and wait until the next crawl..



Ed

grantglendinnin
21-Mar-2009, 01:59 PM
This thread about sitemaps (http://community.actinic.com/showthread.php?t=38291) may be of interest.

EdHarrison
21-Mar-2009, 07:38 PM
Interesting reading thanks, I was skeptical about sitemaps and left well alone for about a week then got impatient - I use the free Mole End one whic seems well regarded but all is left default and Im hoping my errors stem from an issue a couple of days ago. Submitted a fresh sitemap a couple of hours ago so I will wait and see...as a matter of interest heres the sitemap errors..

Errors for URLs in Sitemaps ‎(2)‎
HTTP errors ‎(1)‎ Not found ‎(1)‎

Errors for URLs in Sitemaps1 – 2 of 2
URL Detail Linked From Problem Detected On
http://www.harrisontelescopes.co.uk/acatalog/ 4xx error Mar 17, 2009
http://www.harrisontelescopes.co.uk/acatalog/Astro_Imaging.html 404 (Not found) 45 pages Mar 18, 2009



Thanks Ed