特斯拉专利:不要重复,直接相加。这可以节省时间和精力。
特斯拉已申请了一项专利,标题为“基于8位计算硬件的高精度复数旋转位置编码计算”(US20260017019)。<p>该专利中包含多个概念,但似乎这项技术将在最新的AI5芯片中应用。一个很好的介绍可以在这里找到:https://www.youtube.com/watch?v=GG9yOsPEGek<p>其中一个关键思想是使用对数和加法,而不是乘法。这种方法更快且能耗更低。<p>这将对NVIDIA造成影响。
查看原文
Tesla has filed a patent "High Precision Complex Number Based Rotary Positional Encoding Calculation On 8-Bit Compute Hardware"
(US20260017019)<p>There are several ideas in the patent but it appears that this work will be available in the latest AI5 chip.
A good introduction is https://www.youtube.com/watch?v=GG9yOsPEGek<p>One of the key ideas is to use logarithms and addition rather than multiplication. Faster and less power needed.<p>NVIDIA is going to hurt from this.