请问HN：你们在生产环境中使用什么进行大语言模型（LLM）推理？
我在GPT-3时代就开始了与OpenAI的合作，随后在主要实验室之间辗转（期间短暂参与了Workers AI）。<p>最终，我选择了Gemini 2.5 Flash Lite作为我的工作工具，主要用它处理结构化数据/向量，作为聊天机器人。它价格便宜，性能足够好，最重要的是，<i>速度快</i>——但现在它即将停用，我不确定在哪里可以找到类似的性能。<p>Groq看起来很有前景，但开发者访问权限已经好几个月没有开放了。我很想使用开源软件，但从未找到过性价比（成本/性能/速度）相当的替代品。<p>期待听到你的建议。
查看原文
I started with OpenAI back in the GPT-3 days, then bounced between the major labs (with a brief interlude with Workers AI).<p>I eventually settled on Gemini 2.5 Flash Lite as my workhorse, using it against structured data/vectors as a chatbot. It was cheap, good enough, and most importantly, <i>fast</i> - but it's now being sunset and I'm not sure where to go to find similar performance.<p>Groq seems promising but developer access hasn't been available for months. I'd love to use open source, but I never found anything comparable (cost/performance/speed).<p>Would love to hear your suggestions.