{"id":180719,"date":"2024-01-17T16:22:59","date_gmt":"2024-01-17T22:22:59","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2024\/01\/dangers-of-superintelligence-separating-sci-fi-from-plausible-speculation"},"modified":"2024-01-17T16:22:59","modified_gmt":"2024-01-17T22:22:59","slug":"dangers-of-superintelligence-separating-sci-fi-from-plausible-speculation","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2024\/01\/dangers-of-superintelligence-separating-sci-fi-from-plausible-speculation","title":{"rendered":"Dangers of superintelligence | Separating sci-fi from plausible speculation"},"content":{"rendered":"<p><\/p>\n<p><iframe style=\"display: block; margin: 0 auto; width: 100%; aspect-ratio: 4\/3; object-fit: contain;\" src=\"https:\/\/www.youtube.com\/embed\/VvVVO3SZn4I?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope;\n   picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>Just after filming this video, Sam Altman, CEO of OpenAI published a blog post about the governance of superintelligence in which he, along with Greg Brockman and Ilya Sutskever, outline their thinking about how the world should prepare for a world with superintelligences. And just before filming Geoffrey Hinton quite his job at Google so that he could express more openly his concerns about the imminent arrival of an artificial general intelligence, an AGI that could soon get beyond our control if it became superintelligent. So, the basic idea is moving from sci-fi speculation into being a plausible scenario, but how powerful will they be and which of the concerns about superAI are reasonably founded? In this video I explore the ideas around superintelligence with Nick Bostrom\u2019s 2014 book, Superintelligence, as one of our guides and Geoffrey Hinton\u2019s interviews as another, to try to unpick which aspects are plausible and which are more like speculative sci-fi. I explore what are the dangers, such as Eliezer Yudkowsky\u2019s notion of a rapid \u2018foom\u2019 take over of humanity, and also look briefly at the control problem and the alignment problem. At the end of the video I then make a suggestion for how we could maybe delay the arrival of superintelligence by withholding the ability of the algorithms to self-improve themselves, withholding what you could call, meta level agency.<\/p>\n<p>\u25ac\u25ac Chapters \u25ac\u25ac<\/p>\n<p>00:00 \u2014 Questing for an Infinity Gauntlet.<br \/> 01:38 \u2014 Just human level AGI<br \/> 02:27 \u2014 Intelligence explosion.<br \/> 04:10 \u2014 Sparks of AGI<br \/> 04:55 \u2014 Geoffrey Hinton is concerned.<br \/> 06:14 \u2014 What are the dangers?<br \/> 10:07 \u2014 Is \u2018foom\u2019 just sci-fi?<br \/> 13:07 \u2014 Implausible capabilities.<br \/> 14:35 \u2014 Plausible reasons for concern.<br \/> 15:31 \u2014 What can we do?<br \/> 16:44 \u2014 Control and alignment problems.<br \/> 18:32 \u2014 Currently no convincing solutions.<br \/> 19:16 \u2014 Delay intelligence explosion.<br \/> 19:56 \u2014 Regulating meta level agency.<\/p>\n<p>\u25ac\u25ac Other videos about AI and Society \u25ac\u25ac<\/p>\n<p>AI wants your job | Which jobs will AI automate? | Reports by OpenAI and Goldman Sachs.<br \/> \u2022 Which jobs will AI automate? | Report\u2026<\/p>\n<p>How ChatGPT Works (a non technical explainer):<\/p>\n<div class=\"more-link-wrapper\"> <a class=\"more-link\" href=\"https:\/\/lifeboat.com\/blog\/2024\/01\/dangers-of-superintelligence-separating-sci-fi-from-plausible-speculation\">Continue reading \u201cDangers of superintelligence | Separating sci-fi from plausible speculation\u201d | &gt;<\/a><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Just after filming this video, Sam Altman, CEO of OpenAI published a blog post about the governance of superintelligence in which he, along with Greg Brockman and Ilya Sutskever, outline their thinking about how the world should prepare for a world with superintelligences. And just before filming Geoffrey Hinton quite his job at Google so [\u2026]<\/p>\n","protected":false},"author":661,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1878,1759,41,6],"tags":[],"class_list":["post-180719","post","type-post","status-publish","format-standard","hentry","category-employment","category-governance","category-information-science","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/180719","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/661"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=180719"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/180719\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=180719"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=180719"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=180719"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}