核心信息
一位开发者回应关于AI风险研究的呼吁,认为真正的稳定来自“混乱、有机、自下而上”的系统,而非精心设计的规则;让所有人完全访问模型、数据集、训练代码和智能体追踪,可能是唯一真正有效的做法。
要点
- 他将严密的顶层设计与有机系统的“混乱”现实相对比,认为后者才是稳定的来源。
- 他主张公开模型、数据集、训练代码与智能体追踪,不是天真,而是务实的安全手段。
- 这种“彻底透明”可能令人不适,但或许是对高级AI风险最可靠的实际保障。
一位开发者回应关于AI风险研究的呼吁,认为真正的稳定来自“混乱、有机、自下而上”的系统,而非精心设计的规则;让所有人完全访问模型、数据集、训练代码和智能体追踪,可能是唯一真正有效的做法。
this is what i was talking about earlier when you're young you try to design the perfect system with neat rules that guarantee stability eventually you learn that real stability comes from messy, organic, bottom up systems that feel chaotic and uncomfortable sounds wild to let everyone have full access to this stuff but it's probably the only thing that will actually work
If they truly believe the risk is that high, and I think they do, then we need 100x more research and understanding of it. That requires them to openly share their models, datasets, training code, and agent traces.