黑客基础设施
长期潜水者,拥有多个账户,逐个使用,没有滥用。你好。昨天关于在 Hugging Face 上流行的开放权重模型的层重复和调整的讨论,促使我提交了这个内容。
自从 GPT ~3.5 以来,计算机能够模拟人类的能力变得显而易见,就计算机而言。所谓的“死互联网理论”实际上起源于2012年左右,但我一直难以找到验证,包括在 archive.org 上搜索。
所有这些动荡使得离线本地部署变得如此重要。
以下是当前的黑客基础设施:
1. 选择一个平台,然后决定使用哪个 Linux 内核。
2. qemu/kvm 可能是 incus,或者 docker 或 lxc/lxd,关键是:第二步要与第一步选择的平台隔离。
3. 选择使用 kvm,因为它拥有最大的开发社区。相信我:你不想被 bhyve 或 jails 的相关依赖所困扰,或者说 WSL2(或1)。
4. 主流、主线、主要,全天候。
5. 选择 libvirt,或者干脆选择简单的选项,使用 q 模拟。
6. 如果与主机内核的交互经过调整,主机操作系统可以以非常小的开销或引入的延迟来模拟虚拟机的内核。
7. 在主机上整理好一切后(使用 incus?),将一些裸金属资源传递给你的宠物,包括一些性能核心和几十个 GB 的内存,可能还有一两块 6000 系列 GPU,几个网卡,没关系,所有主机硬件都可以传递。
8. 除了虚拟机监控器。是 xen 吗?不可能,不理想,市场份额在下降。很可能是 qemu/kvm = LINUX。
9. 虚拟机监控器最佳状态已实现。局部和全局的最小最大值已测量,达到最佳全局顶点...
10. 盈利???
查看原文
Long time lurker, many accounts, one at a time, no abuse. Hi. Yesterday's recount about layer duplication and adjustment for popular open weight models on huggingface, led to this submission.
Since GPT ~3.5 it has been apparent that computers can simulate human, as far as a computer is concerned. The dead-internet theory actually originated circa 2012, but I've had difficulty finding verification, including searching the archive.org .
All this turmoil makes offline on prem so important.
Here is the current hacker infra:
1. choose a platform, then decide on the linux kernel.
2. qemu/kvm maybe incus, or docker or lxc/lxd, point being: step two is isolate from the platform chosen in step one
3. choose to use kvm, because it has the largest development community. believe me: you don't want to get bogged down with the associated dependencies of bhyve or jails, or, for that matter, WSL2 (or 1).
4. mainstream, mainline, main, all day.
5. either libvirt or, maybe just choose the easy option and q emulate.
6. the host os can emulate the virtual machine's kernel with very little overhead or introduced latency if the interactions with the host kernel are tailored.
7. after sorting everything out on the host (use incus?) pass through some bare metal to your pet, some performance cores and a couple dozen gigs of ram, maybe a 6000 gpu or two, some nics, doesn't matter, all the host hardware is passed through
8. except the hypervisor. is it xen>? Can't be, not ideal, losing market share. Likellllly qemu/kvm = LINUX.
9. HYPERVISOR OPTIMUM ACHieved. Local and global minmax measured and optimal global apex...
10. profit???