Toggle light / dark theme

Ben Goertzel — Open Ended vs Closed Minded Conceptions of Superintelligence

Abstract: Superintelligence, the next phase beyond today’s narrow AI and tomorrow’s AGI, almost intrinsically evades our attempts at detailed comprehension. Yet very different perspectives on superintelligence exist today and have concrete influence on thinking about matters ranging from AGI architectures to technology regulation.
One paradigm considers superintelligences as resembling modern deep reinforcement learning systems, obsessively concerned with optimizing particular goal functions. Another considers superintelligences as open-ended, complex evolving systems, ongoingly balancing drives.
toward individuation and radical self-transcendence in a paraconsistent way. In this talk I will argue that the open-ended conception of superintelligence is both more desirable and more realistic, and will discuss how concrete work being done today on projects like OpenCog Hyperon, SingularityNET and Hypercycle potentially paves the way for a path through beneficial decentralized integrative AGI and on to open-ended superintelligence and ultimately the Singularity.

Bio: In May 2007, Goertzel spoke at a Google tech talk about his approach to creating artificial general intelligence. He defines intelligence as the ability to detect patterns in the world and in the agent itself, measurable in terms of emergent behavior of “achieving complex goals in complex environments”. A “baby-like” artificial intelligence is initialized, then trained as an agent in a simulated or virtual world such as Second Life to produce a more powerful intelligence. Knowledge is represented in a network whose nodes and links carry probabilistic truth values as well as “attention values”, with the attention values resembling the weights in a neural network. Several algorithms operate on this network, the central one being a combination of a probabilistic inference engine and a custom version of evolutionary programming.

This talk is part of the ‘Stepping Into the Future‘conference. http://www.scifuture.org/open-ended-vs-closed-minded-concept…elligence/

Many thanks for tuning in!

Have any ideas about people to interview? Want to be notified about future events? Any comments about the STF series?
Please fill out this form: https://docs.google.com/forms/d/1mr9PIfq2ZYlQsXRIn5BcLH2onbiSI7g79mOH_AFCdIk/
Consider supporting SciFuture by:
a) Subscribing to the SciFuture YouTube channel: http://youtube.com/subscription_center?add_user=TheRationalFuture b) Donating.
- Bitcoin: 1BxusYmpynJsH4i8681aBuw9ZTxbKoUi22
- Ethereum: 0xd46a6e88c4fe179d04464caf42626d0c9cab1c6b.
- Patreon: https://www.patreon.com/scifuture c) Sharing the media SciFuture creates.

Kind regards.

AI robot painter holds an exhibition and her art is really cool

The way she uses dots and strokes looks a bit like ones and zeroes.


Artificial intelligence is playing a huge role in the development of all kinds of technologies. It can be combined with deep learning techniques to do amazing things that have the potential to improve all our lives. Things like learning how to safely control nuclear fusion (opens in new tab), or making delicious pizzas (opens in new tab).

One of the many questions surrounding AI is its use in art. There’s no denying AI can have some amazing abilities when it comes to producing images. Nvidia’s GuaGan2 that can take words and turn them into photorealistic pictures (opens in new tab) is one example of this. Or Ubisoft’s ZooBuilder AI (opens in new tab), which is a prototype for animating animals.

AI’s Threats to Jobs and Human Happiness Are Very Real

There’s a movement afoot to counter the dystopian and apocalyptic narratives of artificial intelligence. Some people in the field are concerned that the frequent talk of AI as an existential risk to humanity is poisoning the public against the technology and are deliberately setting out more hopeful narratives. One such effort is a book that came out last fall called AI 2041: Ten Visions for Our Future.

The book is cowritten by Kai-Fu Lee, an AI expert who leads the venture capital firm Sinovation Ventures, and Chen Qiufan, a science fiction author known for his novel Waste Tide. It has an interesting format. Each chapter starts with a science fiction story depicting some aspect of AI in society in the year 2041 (such as deepfakes, self-driving cars, and AI-enhanced education), which is followed by an analysis section by Lee that talks about the technology in question and the trends today that may lead to that envisioned future. It’s not a utopian vision, but the stories generally show humanity grappling productively with the issues raised by ever-advancing AI.

IEEE Spectrum spoke to Lee about the book, focusing on the last few chapters, which take on the big issues of job displacement, the need for new economic models, and the search for meaning and happiness in an age of abundance. Lee argues that technologists need to give serious thought to such societal impacts, instead of thinking only about the technology.

AI solution makes the quest for elusive monolayers a lot simpler

One of the most tedious, daunting tasks for undergraduate assistants in university research labs involves looking hours on end through a microscope at samples of material, trying to find monolayers.

These —less than 1/100,000th the width of a human hair—are highly sought for use in electronics, photonics, and because of their unique properties.

“Research labs hire armies of undergraduates to do nothing but look for monolayers,” says Jaime Cardenas, an assistant professor of optics at the University of Rochester. “It’s very tedious, and if you get tired, you might miss some of the monolayers or you might start making misidentifications.”

Elon Musk says humans could eventually download their brains into robots — and Grimes thinks Jeff Bezos would do it

“I think it is possible,” Musk, 50, recently told Insider. “Yes, we could download the things that we believe make ourselves so unique. Now, of course, if you’re not in that body anymore, that is definitely going to be a difference, but as far as preserving our memories, our personality, I think we could do that.”

By Musk’s account, such technology will be a gradual evolution from today’s forms of computer memory. “Our memories are stored in our phones and computers with pictures and video,” he said. “Computers and phones amplify our ability to communicate, enabling us to do things that would have been considered magical … We’ve already amplified our human brains massively with computers.”

The concept of prolonging human life by downloading consciousnesses into synthetic bodies has been a fixture of science-fiction for decades, with the 1964 sci-fi novel “Dune” terming such beings as “cymeks.” Some experts today believe that “mind uploading” technology could, in fact, be feasible one day — but the timeline is incredibly unclear.

AI Expedites Digital Mapping Of Electricity Cables

Google’s AI division is creating digital versions of – normally hand-drawn – maps of electricity cables, in a move that could benefit the global utility industry.

The firm’s DeepMind engineers have partnered with UK Power Networks which delivers electricity across London, the East and South East, to create digital versions of maps covering more than 180,000km of electricity cables.

The work involves new image recognition software scanning thousands of maps – some of which date back decades – and automatically remastering them into a digital format for future use.

Top 10 AI Development and Implementation Challenges

Serhii Pospielov is Lead Software Engineer at Exadel. Serhii has more than a decade of developer and engineering experience. Prior to joining Exadel he was a game developer at Mayplay Games. He holds a Master’s Degree in Computer Software Engineering from Donetsk National Technical University.

Get the latest industry news, expert insights and market research tailored to your interests!

Researchers use Overcooked to train AI to be a better gaming buddy

These new, more diverse approaches to training AI let it adapt to different play-styles, to make it a better team mate.


DeepMind researchers have been using the chaotic cooking game Overcooked (opens in new tab) to teach AI to better collaborate with humans. MIT researchers have followed suit, gifting their AI the ability to distinguish between a diverse range of play-styles. What’s amazing is that it’s actually working—the humans involved actually preferred playing with the AI.

Have you ever been dropped into a game with strangers only to find their play-style totally upends your own? There’s a reason we’re better at gaming with people we know—they get us. As a team, you make a point of complementing each other’s play-style so you can cover all bases, and win.

AI is Ushering In a New Scientific Revolution

By making remarkable breakthroughs in a number of fields, unlocking new approaches to science, and accelerating the pace of science and innovation.


In 2020, Google’s AI team DeepMind announced that its algorithm, AlphaFold, had solved the protein-folding problem. At first, this stunning breakthrough was met with excitement from most, with scientists always ready to test a new tool, and amusement by some. After all, wasn’t this the same company whose algorithm AlphaGo had defeated the world champion in the Chinese strategy game Go, just a few years before? Mastering a game more complex than chess, difficult as that is, felt trivial compared to the protein-folding problem. But AlphaFold proved its scientific mettle by sweeping an annual competition in which teams of biologists guess the structure of proteins based only on their genetic code. The algorithm far outpaced its human rivals, posting scores that predicted the final shape within an angstrom, the width of a single atom. Soon after, AlphaFold passed its first real-world test by correctly predicting the shape of the SARS-CoV-2 ‘spike’ protein, the virus’ conspicuous membrane receptor that is targeted by vaccines.

The success of AlphaFold soon became impossible to ignore, and scientists began trying out the algorithm in their labs. By 2021 Science magazine crowned an open-source version of AlphaFold the “Method of the Year.” Biochemist and Editor-in-Chief H. Holden Thorp of the journal Science wrote in an editorial, “The breakthrough in protein-folding is one of the greatest ever in terms of both the scientific achievement and the enabling of future research.” Today, AlphaFold’s predictions are so accurate that the protein-folding problem is considered solved after more than 70 years of searching. And while the protein-folding problem may be the highest profile achievement of AI in science to date, artificial intelligence is quietly making discoveries in a number of scientific fields.

By turbocharging the discovery process and providing scientists with new investigative tools, AI is also transforming how science is done. The technology upgrades research mainstays like microscopes and genome sequencers 0, adding new technical capacities to the instruments and making them more powerful. AI-powered drug design and gravity wave detectors offer scientists new tools to probe and control the natural world. Off the lab bench, AI can also deploy advanced simulation capabilities and reasoning systems to develop real-world models and test hypotheses using them. With manifold impacts stretching the length of the scientific method, AI is ushering in a scientific revolution through groundbreaking discoveries, novel techniques and augmented tools, and automated methods that advance the speed and accuracy of the scientific process.