请问HN:关于AMD Ryzen AI MAX+ 395用于本地AI的看法?
想知道是否有人尝试过使用带有128GB统一内存的Strix Halo系统进行本地AI,并且他们在运行不同模型时的体验如何:
- 参数数量与量化的实际限制
- 你们用它做了什么
- 哪些模型和推理引擎搭配得很好
查看原文
Wondering if anyone has played around with the Strix Halo based systems with 128GB of unified memory for local AI, and what their experience has been so far in running different models:
- Practical limit on number of parameters x quantization
- What you've been using it for
- Which models and inference engines combine well