What 20+ papers and open-source projects taught me about cracking LLM inference
On this episode, Ben Goertzel joins me to discuss what distinguishes the current AI boom from previous ones, important but overlooked AI research, simplicity versus complexity in the first AGI, the feasibility of alignment, benchmarks and economic impact, potential bottlenecks to superintelligence, and what humanity should do moving forward.
Timestamps:
00:00:00 Preview and intro.
00:01:59 Thinking about AGI in the 1970s.
00:07:28 What’s different about this AI boom?
00:16:10 Former taboos about AGI
00:19:53 AI research worth revisiting.
00:35:53 Will the first AGI be simple?
00:48:49 Is alignment achievable?
01:02:40 Benchmarks and economic impact.
01:15:23 Bottlenecks to superintelligence.
01:23:09 What should we do?
Fujikawa, R., Ramsaran, A.I., Guskjolen, A. et al. Neurogenesis-dependent remodeling of hippocampal circuits reduces PTSD-like behaviors in adult mice. Mol Psychiatry 29, 3316–3329 (2024). https://doi.org/10.1038/s41380-024-02585-7
Human brains are great at sorting through a barrage of sensory information—like discerning the smell of tomato sauce upon stepping into a busy restaurant—but artificial intelligence systems are challenged by large bursts of unregulated input.
Using the brain as a model, Cornell researchers from the Department of Psychology’s Computational Physiology Lab and the Cornell University AI for Science Institute have developed a strategy for AI systems to process olfactory and other sensory data.
Human (and other mammalian) brains efficiently organize unruly input from the outside world into reliable representations that we can understand, remember and use to make long-lasting connections. With these brain mechanisms as a guide, the researchers are designing low-energy, efficient robotic systems inspired by biology and useful for a wide range of potential applications.
@AndreasGus Science Fiction AI video about Future City that Never Sleeps with relaxing ambient chillout music made with Midjourney, MiniMax Hailuo AI and Sun…