请问HN:有没有什么好的开源模型具备可靠的自主能力?
我不想一直将我的数据发送给第三方供应商。但根据我的经验,语言模型需要相当强大才能理解工具调用,尤其是在较长的上下文中(超过20万字)。<p>在我全力以赴地调查这个问题并在一个注定要失败的项目上花钱之前,有人有经验使用能够处理这种工作负载的本地模型吗?我打算在一台配备64-128GB内存的高性能游戏CPU上运行它。
查看原文
I don't want to send my data to third party vendors all the time. But from my experience, the LLMs needs to be quite beefy in order to understand tool-calling, especially at longer contexts (200k+).<p>Before I dive headlong into investigating this and spend money on a project doomed to fail, do anyone have experience with a local model which can handle this sort of workload? I intend to run it on decent gaming CPU with 64-128GB ram.