Roman Yampolskiy vs Joscha Bach: Can Anyone Control Superintelligence?

Roman Yampolskiy says keeping a superintelligence safe forever is as impossible as building a perpetual motion machine. Joscha Bach says today's AI is more controllable than anyone expected, and that shutting it down would doom us anyway. 📬 Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/ai Roman Yampolskiy is a computer scientist at the University of Louisville who has spent more than a decade on the AI control problem. Joscha Bach is a cognitive scientist who studies how minds, biological and artificial, build a model of reality. We cover: why a perpetual safety device may be as impossible as perpetual motion, what happens when AI research automates itself (Roman puts it at 28 percent today), whether nuclear deterrence is the right analogy, who really benefits when AI labs ask to be regulated, and why consciousness may have nothing to do with whether AI is safe. Being conscious does not make you kind. 00:00 Simulation theory meets certain doom 03:25 Is P(doom) even a real number? 06:05 Why a simulated world still matters 09:26 Should we have skipped the Trinity test? 13:04 Did nukes actually keep the peace? 17:32 Why haven't we wiped out the spiders? 22:35 Is AI doom falsifiable? 25:48 Why a self-driving car isn't the threat 29:27 Roman's 28% automation number 34:46 Intelligence is not agency 39:20 Can superintelligence be proven safe? 42:40 Who wins when AI labs ask for regulation? 47:45 Does consciousness make AI safer? 53:48 Would a perfect mind discover God? 58:37 The Tower of Babel, read backward 1:03:52 Can you control a mind a million times smarter? 1:04:43 The narrow AI path Roman wants instead 🏄‍♂️ Twitter: @plinz 🏄‍♂️ Twitter: @romanyam 📬 Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/ai 🌠 Have a .edu email and live in the USA 🇺🇸? You automatically win a meteorite: https://BrianKeating.com/edu 🎯 Support Into the Impossible on Patreon: get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: patreon.com/drbriankeating ⭐ Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: youtube.com/@drbriankeating 📚 My books: Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U Galileo's Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un 🌐 More: 🏄‍♂️ Twitter: @BrianKeating 📚 Substack: https://briankeating.substack.com/ ✍️ Blog: https://briankeating.com/blog 🎙️ Audio-only: https://briankeating.com/podcast #intotheimpossible #briankeating #science #physics #astronomy #cosmology #podcast #universe Learn more about your ad choices. Visit megaphone.fm/adchoices