{"id":367,"date":"2003-10-27T19:52:08","date_gmt":"2003-10-27T22:52:08","guid":{"rendered":"http:\/\/www.hoogervorst.ca\/arthur\/?p=367"},"modified":"2003-10-27T19:52:08","modified_gmt":"2003-10-27T22:52:08","slug":"shark-bites-slurp-googlebot","status":"publish","type":"post","link":"http:\/\/www.hoogervorst.ca\/arthur\/?p=367","title":{"rendered":"Shark bites. Slurp. Googlebot."},"content":{"rendered":"<p><span class=dropcap>J<\/span>ust when I was planning to start off a rant about searchengines and bots, an article (item?) from one of the Gillmor brothers caught my eye. He noticed the <a href=\"http:\/\/weblog.siliconvalley.com\/column\/dangillmor\/archives\/001450.shtml\">extraordinary number of directories<\/a> that have been excluded for searchbots: most of the directories have something to do with Iraq.\n<\/p>\n<p class=quote>&nbsp;&nbsp;&nbsp;&#8220;Perhaps the White House doesn&#8217;t want to make it easy for people to compare its older statements about Iraq with current realities &#8212; though that doesn&#8217;t explain why the pages are searchable on the White House site itself. Maybe, then, the White House wants to know who&#8217;s looking for these things (e.g. by tracking IP addresses of people who query the government site).&#8221;\n<\/p>\n<p>Naturally, his comments aren&#8217;t really appreciated by all of the readers. Should technologists stay far away from making these remarks, I wonder?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Just when I was planning to start off a rant about searchengines and bots, an article (item?) from one of the Gillmor brothers caught my eye. He noticed the extraordinary number of directories that have been excluded for searchbots: most &hellip; <a href=\"http:\/\/www.hoogervorst.ca\/arthur\/?p=367\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[13],"tags":[],"_links":{"self":[{"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=\/wp\/v2\/posts\/367"}],"collection":[{"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=367"}],"version-history":[{"count":0,"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=\/wp\/v2\/posts\/367\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=367"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=367"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.hoogervorst.ca\/arthur\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=367"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}