Toggle light / dark theme

A single real-world datapoint may stop AI model collapse, analysis suggests

New work explaining the inner workings of artificial intelligence could provide a way around the threat of AI “model collapse,” potentially averting growing numbers of AI hallucinations in the future.

First coined in 2024, “model collapse” refers to a scenario where an AI model trained on AI-produced data ceases to provide accurate results, instead producing inaccurate “gibberish” because of the poor quality of its training data.

Some have warned that high-quality text data to train systems like Large Language Models (LLMs) is set to run out as early as this year, and so data produced by models themselves has taken a larger training role—inviting the threat of model collapse.

Data-driven model captures dynamics of turbulence at scale

Whether the dust borne on the violent winds of a tornado or the sugar grains in a swirled cup of coffee, the behavior of particles carried along in turbulence is subject to some similarities—all of them difficult to predict at scale. As described in a recent publication in the Proceedings of the National Academy of Sciences, a research team led by Los Alamos National Laboratory scientists has developed a first-of-its-kind machine learning framework that models chaotic particle motions in a turbulent flow.

“Modeling turbulence is a big, open problem, and it’s probably the hardest problem in classical physics,” said Daniel Livescu, Los Alamos scientist and one of the leaders of the work. “A subset of that challenge is modeling particle motions within turbulence. To meet that challenge, our artificial intelligence approach offers an innovative theoretical construct tested with a real-world application.”

The team has developed and applied the first data-driven, auto-regressive machine learning framework to capture the dynamics of turbulence at scale. The research demonstrates that machine learning can overcome longstanding barriers in modeling chaotic particle motions.

Teaching thermodynamic laws to AI unlocks a polymer modeling challenge

For more than half a century, materials scientists have struggled with how to simulate the complexity of polymer materials. An individual chain can comprise tens of thousands of atoms, a melt or composite contains billions, and the properties engineers actually care about, such as how an adhesive grips a surface, how a self-assembling block copolymer locks into a nanostructure, or how a biopolymer film stretches without tearing, emerge only over length and time scales that forcible atomistic simulation cannot reach.

The standard workaround is coarse-graining: replacing groups of atoms with simpler mesoscopic particles so the model is fast enough to run. The catch is that this compression almost always sacrifices physics. Conventional coarse-grained polymer models can usually reproduce equilibrium structure or large-scale dynamics, but rarely both, and they routinely fail to capture the entropic and viscous forces that govern how polymers actually flow, relax, and dissipate energy. Those are the forces that dictate mechanical performance, and they are the forces that traditional machine-learning approaches, despite their flexibility, also tend to break.

A research paper recently published in Proceedings of the National Academy of Sciences introduces a new machine-learning framework that lets coarse-grained models achieve both at once. A team from Carnegie Mellon University and the University of Pennsylvania has built an AI architecture that learns coarse-grained dynamics directly from data, whether simulated or experimental, while being mathematically incapable of violating the laws of thermodynamics.

BI 109 Mark Bickhard: Interactivism

Patreon support: / braininspired.

Free Video Series: Open Questions in AI and Neuroscience:
https://braininspired.co/open/

Show notes: https://braininspired.co/podcast/109/

Mark and I discuss a wide range of topics surrounding his Interactivism framework for explaining cognition. Interactivism stems from Mark’s account of representations and how what we represent in our minds is related to the external world — a challenge that has plagued the mind-body problem since the beginning. Basically, representations are anticipated interactions with the world, that can be true (if enacting one helps an organism maintain its thermodynamic relation with the world) or false (if it doesn’t). And representations are functional, in that they function to maintain far from equilibrium thermodynamics for the organism for self-maintenance. Over the years, Mark has filled out Interactivism, starting with a process metaphysics foundation and building from there to account for representations, how our brains might implement representations, and why AI is hindered by our modern \.

AI-powered spectrometer chip shrinks lab technology to the size of a grain of sand

A new AI-powered chip from UC Davis can analyze light and chemicals using a device tiny enough to fit almost anywhere. By combining smart silicon sensors with machine learning, it achieves lab-style spectral analysis without the bulky equipment.

DeepMind’s Insane AI Breakthroughs With CEO Demis Hassabis

Thank you to Google DeepMind for the invite. 🙏

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambda.ai/papers.

Our Patreon if you wish to support us: / twominutepapers.

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Adam Bridges, Benji Rabhan, B Shang, Cameron Navor, Charles Ian Norman Venn, Christian Ahlin, Eric T, Fred R, Gordon Child, Juan Benet, Michael Tedder, Owen Skarpness, Richard Sundvall, Ryan Stankye, Shawn Becker, Steef, Taras Bobrovytsky, Tazaur Sagenclaw, Tybie Fitzhugh, Ueli Gallizzi.

My research: https://cg.tuwien.ac.at/~zsolnai/
Thumbnail design: https://felicia.hu.

00:00 Intro.

Panel on Representational Paradigms for Cognitive AI

There is a wide gap between current machine learning representations and the way in which our minds represent reality. Our mental representations are dynamic, coherent, unified (in the sense that we establish relationships between all our domains of knowledge, in the context of a global universe), and they are updated on the fly. In this panel, we bring some important thinkers and practitioners of cognitive science, robotics, AI and philosophy together to discuss representations for future generations of AI systems.

This is the first in a series of events on Cognitive Artificial Intelligence. The goal of Cognitive AI is to build and understand systems that can make sense of their environment, combine knowledge and perception, learn to act on domains they have not encountered before, make autonomous decisions and explain them, interact deeply with people and human society.

We are proud to welcome our panelists:

Mark Bickhard: Cognition and Truth Value.

Stephen grossberg: how each brain makes a mind: from brain resonances to conscious experiences.

Yulia Sandamirskaya: Memory, intentionality, and autonomy enabled by neuronal attractor dynamics.

/* */