问HN:M5 MacBook Pro的买家们,花钱购买是否值得,可能在本地运行大型语言模型(LLMs)?

5作者: tpurves11 天前原帖
对于今年升级日常使用的Mac的朋友们,你们是否考虑过选择Max+高内存配置?例如,希望能够在主机上有效地运行代理/大型语言模型(LLMs),无论是现在还是不久的将来? 或者,基础款与高配款的几千美元差价,是否更适合投资于其他实际的选择(比如不同的硬件、远程硬件、云AI订阅或积分)?还是等看看明年是否会有M5 Studio,或者M6的推理性能会带来什么? 我很有兴趣,但即使一些新型号变得更轻薄、更高效,我也不确定摩尔定律和M5这一代是否已经足够成熟,值得为此付出努力? 你们的决定是什么,为什么?
查看原文
To anyone upgrading their daily driver Mac this year, are you considering going to a Max + high memory config? eg. with the hope (now or in near future) of being able to do usefully run agents&#x2F;LLMs locally on your main machine?<p>Or is the few extra thousand dollars difference between a base and max-spec MBP still just better spent on literally any other practical option (like different harware, remote hardware, cloud AI subscriptions or credits). Or wait to see if there will be an M5 Studio or what inferencing performance next year&#x27;s M6 may bring?<p>I am tempted, but even with some new models getting skinnier and more efficient, I am not sure moore&#x27;s law and the M5 generation is quite there yet to be worth the trouble?<p>What call&#x27;s are ya&#x27;ll making and why?