苹果在A19 Pro GPU中增加了矩阵乘法加速功能。

3作者: aurareturn3 个月前原帖
这相当于英伟达的张量核心。这意味着在苹果设备上,提示处理将获得显著提升,使得本地大语言模型在未来的Mac(可能是M5)上变得更加可行。
查看原文
It's equivalent to Tensor cores from Nvidia. This means prompt processing will get a significant boost on Apple devices, making local LLMs far more viable on future Macs (as soon as M5).