问HN:为什么我们不再讨论上下文窗口大小了?
上下文长度曾经是新模型的一个重要指标。我几乎不再听到关于它的讨论,但我无法想象它在实际性能中不再发挥重要作用。<p>这真的不再是一个瓶颈了吗,还是说它现在只是被包含在主要基准数字中?
查看原文
Context length used to be one of the headline metrics for new models. I hardly hear about it anymore, but I can't imagine it doesn't still play a huge role in practical performance.<p>Is this truly no longer a bottleneck, or does it just get rolled up in the headline benchmark numbers now?