问HN：你们如何分析产品中与AI代理的对话？
向拥有聊天界面的开发者提问：你们是否监控用户的提问？你们是如何做到的？
昨天，一个朋友问我这个问题；他想了解一些事情，比如“用户询问但我的代理无法完成的是什么？”、“用户讨厌什么？”、“他们喜欢什么？”。
来自另一家小型初创公司的快速见解——他们规模较小，所以直接从数据库中复制了所有对话，并请ChatGPT进行分析。他们发现，用户最希望的缺失功能是能够在消息中使用URL。
我还发现有一个尝试围绕这个需求构建产品的项目，但似乎该项目已经被搁置： [链接](https://web.archive.org/web/20240307011502/https://simplyanalyze.ai)。
如果确实没有解决方案，并且除了我的朋友之外还有更多人希望实现这个功能，我很乐意为此构建一个开源工具。
查看原文
Question to devs who have chat interfaces in their products. Do you monitor what your users are asking for? How do you do it?<p>Yesterday, a friend asked me this question; he would like to know things like "What users ask that my agent can't accomplish?", "What users hate?", "What do they love?".<p>A quick insight from another small startup - they are quite small so they just copied all the conversations from their database and asked ChatGPT to analyze them. They found out that the most requested missing feature was being able to use URLs in messages.<p>I also found an attempt to build a product around this but it looks like the project has been abandoned: https://web.archive.org/web/20240307011502/https://simplyanalyze.ai/<p>If there's indeed no solution to this and there are more people other than my friends who want this, I'd be happy to build an open-source tool for this.