Comments on: Googlebot gave up http://www.jlh-design.com/2007/09/googlebot-gave-up/ Terrible writing and mere conjecture Fri, 25 Jul 2008 20:47:48 +0000 http://wordpress.org/?v=abc By: John Honeck "JLH" http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5303 John Honeck "JLH" Wed, 26 Sep 2007 11:07:29 +0000 http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5303 I'd imagine they need a lot of load balancing servers just to keep up with the editors deleting their competition's submissions, they sure don't need them for approving new submissions. Then again, it is run by AOL, so that can mean just about anything is possible. I’d imagine they need a lot of load balancing servers just to keep up with the editors deleting their competition’s submissions, they sure don’t need them for approving new submissions.

Then again, it is run by AOL, so that can mean just about anything is possible.

]]> By: Webado http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5302 Webado Wed, 26 Sep 2007 10:45:28 +0000 http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5302 It's funny, I am not getting your page using IE7 (Internet explorer cannot display the page ...) but I am getting it in Firefox, with header shown as "301 OK". Oy-oy believes it's an actual redirection and times out after 2 such "redirections". Googlebot is probbaly getting mislead the same way. Maybe DMOZ had a redirection to take care of canonical form or index back to root and messed it up for a while. Theres'a always a rookie webmaster everywhere, isn't there? Been there, done that ... LOL But look at http://oyoy.eu/page/headers/?full=1&url=http%3a%2f%2fdmoz.org%2f . See how for dmoz.org it shows the server as ArtBlast/3.5.5 and after the 301 redirection to the www form it's now an Apache/2.0.59 (Unix) server... Huh??? It’s funny, I am not getting your page using IE7 (Internet explorer cannot display the page …) but I am getting it in Firefox, with header shown as “301 OK”. Oy-oy believes it’s an actual redirection and times out after 2 such “redirections”. Googlebot is probbaly getting mislead the same way.

Maybe DMOZ had a redirection to take care of canonical form or index back to root and messed it up for a while. Theres’a always a rookie webmaster everywhere, isn’t there? Been there, done that … LOL

But look at http://oyoy.eu/page/headers/?full=1&url=http%3a%2f%2fdmoz.org%2f .

See how for dmoz.org it shows the server as ArtBlast/3.5.5 and after the 301 redirection to the www form it’s now an Apache/2.0.59 (Unix) server… Huh???

]]> By: John Honeck "JLH" http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5301 John Honeck "JLH" Wed, 26 Sep 2007 03:40:20 +0000 http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5301 Webado, I've managed to create just such a page. It shows a 301 as the response, but then lets the user see the content. It's at: <a href="http://www.jlh-design.com/PHPredirect-broken.php" rel="nofollow">www.jlh-design.com/PHPredirect-broken.php</a> Checking the headers shows the 301 response. http://oyoy.eu/page/headers/?full=1&url=http://www.jlh-design.com/PHPredirect-broken.php Is it possible that DMOZ could have screwed up their code this much? Webado, I’ve managed to create just such a page. It shows a 301 as the response, but then lets the user see the content. It’s at:

http://www.jlh-design.com/PHPredirect-broken.php

Checking the headers shows the 301 response.

http://oyoy.eu/page/headers/?full=1&url=http://www.jlh-design.com/PHPredirect-broken.php

Is it possible that DMOZ could have screwed up their code this much?

]]> By: Webado http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5300 Webado Wed, 26 Sep 2007 03:15:24 +0000 http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5300 Oh pooh! My carefully crafted php script got annihilated LOL but my typos were left behind ;) Well, it was: header ( "HTTP/1.1 301 Moved Permanently" ); Oh pooh!

My carefully crafted php script got annihilated LOL but my typos were left behind ;)

Well, it was:

header ( “HTTP/1.1 301 Moved Permanently” );

]]> By: Webado http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5299 Webado Wed, 26 Sep 2007 03:13:35 +0000 http://www.jlh-design.com/2007/09/googlebot-gave-up/#comment-5299 Well, I havent' tried sending throygh a 301 header without also sending a redirections. But I have sent through 404 headers whiel continuing to serve a page. A robots will get a 404 and not bother with the page's content. I supspoe the same thing could be done with a 301. Just add this at the top of a page: and then continue merrily with the actual content. Why they'd do it? Who knows .... self-sabotage? Error? Well, I havent’ tried sending throygh a 301 header without also sending a redirections. But I have sent through 404 headers whiel continuing to serve a page. A robots will get a 404 and not bother with the page’s content. I supspoe the same thing could be done with a 301. Just add this at the top of a page:

and then continue merrily with the actual content.

Why they’d do it? Who knows …. self-sabotage? Error?

]]>