This page is for testing what web crawlers will manage to index a site that is only available on IPv6.
For a while now I have been wondering if Google, Bing, e.t.c. have crawlers that are IPv6 enabled. I'm fairly certain that they won't try to access dual stacked sites using IPv6 but that doesn't neccesarily mean that they are incapable of indexing IPv6 only sites.
I will look at the access log for this site from time to time and report here what I find out.
2011-02-06
The page is now live. W3C can't validate IPv6 only pages yet, so using the buttons in the lower right corner of this page just takes you to an error page. Tsk Tsk.
Within a few hours I got a visit from Googlebot:
2001:4860:4801:1408:0:6006:1300:b075 - - [06/Feb/2011:21:09:33 +0100] "GET / HTTP/1.1" 200 2288 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
2011-02-20
Googlebot visits the page a few times each day but I have yet to see any other web crawler find its way to the page.
I can't seem to find the page when searching on google.com. I wonder if they just stash the index of IPv6 only sites somewhere secret and do not use it for anything.
2012-04-03
I received a mail from Chris telling me that the page is now found when searching on Google for "google ipv6 only index"..
This is very nice and a great step forward.
2012-04-03
I just checked the W3C validators once again. They are still not capable of handling IPv6 only pages.
2015-10-26
I just checked the W3C validators once again. They are still not capable of handling IPv6 only pages. This is disappointing.
2015-10-26
A few crawlers have found their way to this page. Bing bot, however, has not yet been spotted.
|
|