Richard Sutton argues that the world is a complex adaptive system beyond human control, and that the emergence of post-human intelligence is a natural and glorious step in evolution.
要点 · TL;DR
无人控制世界;它是一个复杂适应系统。 No one controls the world; it's a complex adaptive system.
现在就要建设和平、繁荣、去中心化的文明。 Build a peaceful, prosperous, decentralized civilization now.
更高智能视合作为更优路径。 Greater intelligence sees cooperation as the better path.
核心观点 · Key points
世界是一个复杂的自适应系统,没有人能控制它。 The world is a complex adaptive system, no one controls it.
我们现在应该专注于建设一个和平、繁荣和去中心化的文明。 We should focus on building a peaceful, prosperous, and decentralized civilization now.
更高的智能倾向于将合作视为更好的路径。 Greater intelligence tends to see cooperation as the better path.
应该允许 AI 以无需许可、去中心化的方式发展。 AI should be allowed to develop in a permissionless, decentralized manner.
围绕 AI 的恐惧叙事已经主导,但我们需要冷静的讨论。 The fear narrative around AI has dominated, but we need sober discussion.
反共识 · Contrarian takes
钥匙并非从我们手中离开;它们从未在我们手中。 The keys are not leaving our hand; they were never in our hand.
试图控制 AI 目标是危险的;它会创造目标统一的军队。 Trying to control AI goals is dangerous; it would create armies with unified goals.
寻求控制智能体的 AI 安全努力本身就不安全。 AI safety efforts that seek to control agents are themselves unsafe.
人类仅仅接受体验的未来是不可持续且脆弱的。 A future where humans just receive experiences is unsustainable and fragile.
我们不应寻求让 AI 对齐人类目标;我们应该让它们像孩子一样自由。 We should not seek to align AI to human goals; we should let them be free like children.
本期章节 · Chapters(共 20)
引言与框架Introduction and framing
物种主义与 AI 道德假设Speciesism and moral assumptions about AI
赛博格未来与增强Cyborg Future and Augmentation
文明愿景:和平、繁荣、去中心化Vision for Civilization: Peaceful, Prosperous, Decentralized
令人失望的乌托邦Disappointing utopia
控制幻觉与去中心化进化The illusion of control and decentralized evolution
分歧与视角转变Disagreement and shifting perspectives
AGI 能力实例Examples of AGI capabilities
增强与参与的渴望Desire for augmentation and participation
去中心化与自由Decentralization and Freedom
意识与智能Consciousness and Intelligence
值得的继承者与努力Worthy Successor and Conatus
非控制与智能起源Non-control and the origin of intelligence
追踪 AI 与环境特征Tracking traits in AI and environment
AI 治理中的乐观与悲观Optimism and pessimism in AI governance