View Full Version : Error with robots text
EdHarrison
21-Mar-2009, 01:07 PM
I am worried I have made a serious error adding a robot text meta found on the knowledge base, I added this to head section on the layout of my cart pages - or so I thought but now I cant find the code and theres worse:
Webmaster tools is showing errors for 45 pages so my fear is that I am denying google access to lots of my content, I have tried searching for the code and checked where I think it would be, is there a way of finding this??
Ed
grantglendinnin
21-Mar-2009, 01:11 PM
Ed, I presume you are talking about your signature-linked site.
If so, I did not locate a robots.txt file on the server, nor could I find a trace of a meta robots tag. What are the errors that Google WMT report?
EdHarrison
21-Mar-2009, 01:18 PM
Thanks for looking - This is whats baffled me as I cant find what I put in there. Heres the code I dropped in : <META NAME="robots" CONTENT="none"> but now cant find,
Google is showing 1 4xxx error and unable to find 45 pages linked from:
http://www.harrisontelescopes.co.uk/acatalog/Astro_Imaging.html
I did have some serious issues on the date this error shows which were solved with a complete site refresh so theres some chance this may clear on the next crawl, my immediate concern is finding the above code and removing it!
Ed
grantglendinnin
21-Mar-2009, 01:24 PM
I see no reference to robot-blocking on any of your pages.
Your meta tags are:
<META name="y_key" content="c75cf4c497f17cee">
<meta name="verify-v1" content="FrXPOO14/x9Pc7JA3SFPsIosXMgCiHD/CIKyi3PqJ7k=" />
<meta name="msvalidate.01" content="E8D81D38C64315511380CFF12792968B" />
Meta keywords+description too.
I assume the code you placed to block robots (meta robots tag) was wrapped in a block so it is only active on the defined pages? It certainly isn't there now anyway. Unless you've wrongly inverted the block conditions.
EdHarrison
21-Mar-2009, 01:48 PM
Thanks for looking, I will resubmit a sitemap and wait until the next crawl..
Ed
grantglendinnin
21-Mar-2009, 01:59 PM
This thread about sitemaps (http://community.actinic.com/showthread.php?t=38291) may be of interest.
EdHarrison
21-Mar-2009, 07:38 PM
Interesting reading thanks, I was skeptical about sitemaps and left well alone for about a week then got impatient - I use the free Mole End one whic seems well regarded but all is left default and Im hoping my errors stem from an issue a couple of days ago. Submitted a fresh sitemap a couple of hours ago so I will wait and see...as a matter of interest heres the sitemap errors..
Errors for URLs in Sitemaps (2)
HTTP errors (1) Not found (1)
Errors for URLs in Sitemaps1 – 2 of 2
URL Detail Linked From Problem Detected On
http://www.harrisontelescopes.co.uk/acatalog/ 4xx error Mar 17, 2009
http://www.harrisontelescopes.co.uk/acatalog/Astro_Imaging.html 404 (Not found) 45 pages Mar 18, 2009
Thanks Ed
vBulletin® v3.8.4, Copyright ©2000-2012, Jelsoft Enterprises Ltd.