展示HN：带有人类反馈循环的文档提取
关于这个功能：<p>我们开发了一款工具，可以从复杂的管理财务文件和银行对账单中自动评估企业健康状况。<p>为了使其可靠运行，我们在字段级别的结构化输出提示上进行了大量迭代。<p>这促使我们构建了一个功能，允许用户也能改进这些提示，并通过一些上下文工程，我们得到了我们所称的“反馈循环”。<p>这里有一个2分钟的演示 <a href="https://www.youtube.com/watch?v=ZDNlEZydoXU" rel="nofollow">https://www.youtube.com/watch?v=ZDNlEZydoXU</a><p>它是如何工作的（视频展示了这些步骤）：<p>1. 创建一个目标表单以进行提取（AI帮助创建）<p>2. 上传文件（从不同模型中选择）<p>3. 审查提取的质量（并检查PDF引用）<p>4. 如果有错误，进行更正并在字段级别提供反馈<p>5. 一旦您觉得已经看到足够的错误并提供了足够的更正，使用反馈工作流程来完善您的字段描述。<p>您可以在这里尝试该应用 <a href="https://app.sea.dev/" rel="nofollow">https://app.sea.dev/</a><p>（在提示优化之间进行至少2-3次合理的提取时效果最佳）<p>反馈功能目前处于测试阶段。如果您进行了一些更正，然后访问 <a href="https://app.sea.dev/feedback" rel="nofollow">https://app.sea.dev/feedback</a>，您将看到它们准备好进行审查和优化。<p>我非常希望能收到关于如何改进这个想法的反馈。这个视频是一个玩具示例，但它已经上线并与一些早期的信用分析师客户合作，他们似乎很喜欢它。
查看原文
About the feature:<p>We built a tool for automatically assessing business health from complex management financial documents and bank statements.<p>In order to get this working reliably, we had to iterate extensively on the prompts for the structured output at the field level.<p>This led us to building a feature to allow users to improve them too, and with some context engineering, we have what we are calling “feedback loops”.<p>Here is a 2 min demo <a href="https://www.youtube.com/watch?v=ZDNlEZydoXU" rel="nofollow">https://www.youtube.com/watch?v=ZDNlEZydoXU</a><p>How it works (video runs through these steps):<p>1. Create a target form for your extraction (AI helps create it)<p>2. Upload a document (choose from different models)<p>3. Review the quality of the extraction (and check the PDF citations)<p>4. If there are any mistakes, correct them and give feedback at the field level<p>5. Once you feel like you've seen enough errors and provided enough corrections, use the Feedback workflow to refine your field descriptions.<p>You can try the app here <a href="https://app.sea.dev/" rel="nofollow">https://app.sea.dev/</a><p>(it works best when you do at least 2-3 reasonable extractions between prompt refinements)<p>The feedback feature is currently in beta. If you make some corrections and then go to <a href="https://app.sea.dev/feedback" rel="nofollow">https://app.sea.dev/feedback</a> you'll see them ready for review and refinement.<p>I would love to get feedback on how we might improve this idea. The video was a toy example but it is live and working with a few early credit analysts customers and they seem to like it.