本地大型语言模型（LLM）适用于私营公司
你觉得在公司内部托管一个本地大型语言模型（LLM）怎么样？我们有MS365订阅和内置的Copilot来学习流程和进行问答。但是，针对内部系统，比如包含敏感数据的特定部门软件，我没有其他想法，除了使用本地LLM。不过到目前为止，我发现GPU的价格很高。GPT告诉我，我可以使用配备RTX 6000 Pro 96GB的36B本地LLM，价格大约是12000美元。而我认为我们在浏览器上使用的普通GPT（GPT 5.4扩展版）比36B的LLM要强得多。我很好奇是否还有其他人有类似的想法，或者有什么专业的建议。
查看原文
what do you think to host a local LLM for company businness? ok we have ms365 subscription and built-in copilot for learn procedur, and Q/A. but to use the llm internal systems like special department softwares, which contains sensitive data, i do not have any idea other than local LLM. but so far what i found is gpus are expensive. gpt told me i can use 36B local LLM with rtx 6000 pro 96gb which costs 12k$. and i think the normal gpt that we are using on browser, gpt 5.4 extended think is much more stronger than 36B llm. i am curious if there are others that have similar ideas, or any proffessional advices.