Lifeboat Foundation

Greg Yang is a mathematician and AI researcher at Microsoft Research who for the past several years has done incredibly original theoretical work in the understanding of large artificial neural networks. Greg received his bachelors in mathematics from Harvard University in 2018 and while there won the Hoopes prize for best undergraduate thesis. He also received an Honorable Mention for the Morgan Prize for Outstanding Research in Mathematics by an Undergraduate Student in 2018 and was an invited speaker at the International Congress of Chinese Mathematicians in 2019.

In this episode, we get a sample of Greg’s work, which goes under the name “Tensor Programs” and currently spans five highly technical papers. The route chosen to compress Tensor Programs into the scope of a conversational video is to place its main concepts under the umbrella of one larger, central, and time-tested idea: that of taking a large N limit. This occurs most famously in the Law of Large Numbers and the Central Limit Theorem, which then play a fundamental role in the branch of mathematics known as Random Matrix Theory (RMT). We review this foundational material and then show how Tensor Programs (TP) generalizes this classical work, offering new proofs of RMT. We conclude with the applications of Tensor Programs to a (rare!) rigorous theory of neural networks.

Continue reading “Greg Yang | Large N Limits: Random Matrices & Neural Networks | The Cartesian Cafe w/ Timothy Nguyen” »

Although dark matter is a central part of the standard cosmological model, it’s not without its issues. There continue to be nagging mysteries about the stuff, not the least of which is the fact that scientists have found no direct particle evidence of it. Despite numerous searches, we have yet to detect dark matter particles. So some astronomers favor an alternative, such as Modified Newtonian Dynamics (MoND) or modified gravity model. And a new study of galactic rotation seems to support them.

The idea of MoND was inspired by galactic rotation. Most of the visible matter in a galaxy is clustered in the middle, so you’d expect that stars closer to the center would have faster orbital speeds than stars farther away, similar to the planets of our solar system. We observe that stars in a galaxy all rotate at about the same speed. The rotation curve is essentially flat rather than dropping off. The dark matter solution is that galaxies are surrounded by a halo of invisible matter, but in 1983 Mordehai Milgrom argued that our gravitational model must be wrong.

Australian scientists have created the most detailed map ever of the communication links between the hippocampus, the brain’s memory control center, and the rest of the brain, potentially revolutionizing our understanding of human memory.

“We were surprised to find fewer connections between the hippocampus and frontal cortical areas, and more connections with early visual processing areas than we expected to see,” said Dr. Marshall Dalton, a Research Fellow in the School of Psychology at the University of Sydney. “Although, this makes sense considering the hippocampus plays an important role not only in memory but also imagination and our ability to construct mental images in our mind’s eye.”

Continue reading “Scientists Have Created the Most Detailed Map of the Brain’s Memory Hub — And It Could Change Our Understanding of Memory” »

In quantum physics, particles exist in many states at once until you measure them. Can reality really work that way?

It’s all part of an in-space manufacturing initiative that could drastically reduce costs for future space missions.

A new experiment does away with one of the biggest hindrances manufacturers face here on Earth — Gravity.

MIT scientists are collaborating with NASA to build test parts in space as part of a research program aimed at unleashing the full potential of microgravity manufacturing.

Metamorworks/iStock.

Safe and helpful answers.

Though OpenAI CEO Sam Altman recently said it would be “a mistake” to use ChatGPT for anything important.

Microsoft aims to integrate OpenAI’s ChatGPT chatbot into its Bing search engine in order to boost its user count and rival Google, as per a report from The Information.

Could OpenAI enhance Microsoft’s search engine credibility?

Continue reading “Microsoft aims to boost its search engine with OpenAI’s ChatGPT to rival Google” »

Just like the distant galaxies, the deep seas continue to bring us wonder and awe.

Beyond every shoreline lies a sea, a seemingly uniform body of water with turbulent, ceaseless movement that joins the coastlines into a continuous whole, showing no sign of the borders and labels we set upon it. In many ways, these large bodies of water are as mysterious to us as the distant galaxies and stars in the cosmos. But they are also right here, in the midst of our own world and interacting with our planet’s atmosphere as a realm of hidden objects, shadowy dreams, and deep sea creatures.

Do you ever think about the creatures that lie deep below the seas?

Continue reading “Deep sea creatures: the amazing under-explored part of the world” »

“This research signifies an extraordinary advance in knowledge about the origin and evolution of CRISPR-Cas systems.”

An international research team reconstructed the CRISPR-Cas system for the first time, dating back to 26 billion years ago. Their findings imply that the revived systems are functional and more adaptable than the previous iterations.

Led by teams from the Spanish National Research Council, the University of Alicante, the Rare Diseases Networking Biomedical Research Center (CIBERER), the Ramón y Cajal Hospital-IRYCIS, and other national and international institutions are working with Ikerbasque research professor Rául Pérez-Jiménez of CIC nanoGUNE.