问HN:为什么Reddit禁止所有自动访问,但所有URL都有.json格式?
Reddit 正在积极阻止所有自动访问(请参见他们的 robots.txt),并使用大量启发式方法来阻止不遵守该规定的爬虫。<p>然而,与此同时,所有 Reddit 的 URL 通过在末尾添加 .json 可以变得可机器读取。<p>有人能解释一下这样做的意义吗?
查看原文
Reddit is aggressively blocking all automated access (see their robots.txt) and uses a lot of heuristics to block crawlers that do not honor it.<p>However, at the same time all Reddit URLs can be made machine readable by adding a .json to the end.<p>Can anyone explain what's the point of that?