在google站长工具中测试robots.txt对相应URL的限制情况

google实际对这些URL的收录情况

看来google对robots.txt协议遵守的并不好,相反MSN、yahoo在这个测试中做的还不错啊。
在google站长工具的remove URLs一栏中有提到,如果想要google不收录某些页面,可以通过几个方式:
To remove content from the Google index, do one of the following:
* Ensure requests for the page return an HTTP status code of either 404 or 410. [?]
* Block the page using a robots.txt file. [?]
* Block the page using a meta noindex tag. [?]Your content will then be removed from the index the next time Google crawls your site. If you need to expedite your content removal, make sure you have met one of the requirements listed above, and then select the New Removal Request button below to use this automated tool.
那么如果google不遵守robots.txt协议的话,我使用站长工具中的网址删除功能是否会有效?