请问HN:您是否注意到在禁用记忆功能的情况下,AI的回答有所改善?
我在每月20美元的计划下使用Claude,主要用于研究、进行“橡皮鸭对话”,以及作为创意的反馈平台(之前我使用Fable,但现在只能使用Opus 4.8或Sonnet 5)。最近我注意到,在高上下文情况下,Opus 4.8的响应质量严重下降。为了解决这个问题,我禁用了记忆系统(现在被称为“遗留”系统,尽管据我所知并没有替代品)。
在禁用此设置后,除了每次继续任务时输入必要上下文的略微乏味外,我注意到响应质量和准确性有了显著改善。我是那种在Opus 4.7发布后抱怨的人,我的理论是某些更改旨在增加记忆上下文,但导致实际响应质量下降。总的来说,我在想,当前最先进的思维模型的高上下文能力是否被夸大了。
作为一个简短的轶事,我在处理一个包含超过30个提示的研究任务时,切换到新的聊天并将讨论的要点浓缩成一个新的提示,得到了比继续提示之前的聊天更好的结果,尽管(或者我认为是由于)之前的对话在该主题上有丰富的上下文。
顺便提一下,我希望“项目”和“聊天”的记忆是独立的设置。禁用记忆增强了聊天的能力,但严重削弱了项目,因为禁用了它们的内部记忆,导致模型每次你要求它引用某个文件时都要摸索。 我想一个变通的解决办法可能是为每个项目创建一个项目,但这似乎很繁琐。
这是一个已知现象吗?最近的更改是否加剧了这种情况?任何想法和建议都非常感谢。谢谢!
查看原文
I use Claude on the $20/mo plan, mainly for research, "rubber duckying," and as an idea soundboard (I was using Fable for this but am now relegated to Opus 4.8 or Sonnet 5), and recently noticed a severe downturn in Opus 4.8 response quality in high-context situations. To attempt to remedy this, I disabled the memory system (now labeled "Legacy" even though to my knowledge there is no replacement).<p>With this setting disabled, aside from the slight tedium of inputting the necessary context each time for task continuations, I have noticed a drastic improvement in response quality and accuracy—I'm one of those shmucks who whined a bit after Opus 4.7 came out, and my theory is some change was made to increase memory context that resulted in a decrease in actual response quality. In general, I wonder if the high-context abilities of SOTA thinking models are overstated.<p>As a brief anecdote, I was working through a research task with upwards of 30 prompts. Switching to a new chat and condensing the gist of the discussion into a single new prompt yielded superior results than continuing to prompt the prior chat, despite (or due to, I would argue) the prior conversation's wealth of context on the subject.<p>Aside: I wish that "project" and "chat" memory were separate settings. Disabling memory boosts the capabilities of chat, but severely nerfs projects by disabling their internal memory, leading the model to grope around for files each time you ask it to reference one. I suppose a hacky solution could just be to create a project for everything, but this seems tedious.<p>Is this a known phenomenon? Have recent changes exacerbated things? Any thoughts and tips are appreciated. Thanks!