请问HN：有没有人跟踪他们网站的AI流量？我们应该关注吗？
最近，我们注意到日志中出现了相当数量的流量，这些流量看起来与典型的爬虫不同。<p>不是通常的嘈杂爬虫或明显的抓取工具。它们的行为有所不同，访问次数较少，页面访问更具选择性。<p>一些用户代理表明可能是人工智能爬虫，但有些则不是。我们该如何追踪这些访客呢？
查看原文
Lately we've been noticing a non-trivial amount of traffic in our logs that doesn't look like typical bots.<p>Not the usual noisy crawlers or obvious scrapers. The behavior is different with fewer hits, more selective page access.<p>Some of the user agents suggest AI crawlers, but some do not. How can we track these visitors?