Toggle light / dark theme

Broadcom is working to integrate optical connectivity directly into GPUs

Forward-looking: We’re approaching a point where traditional copper interconnections won’t be able to carry enough data to keep GPUs and other specialized chips fully utilized. The AI market is urgently demanding a next-generation solution to this interconnection bottleneck, and Broadcom appears to be working on an optics-based solution that is closer to the chip itself.

Broadcom is developing new silicon photonics technology aimed at significantly increasing the bandwidth available to GPUs and other AI accelerators. By utilizing co-packaged optics (CPOs), the fabless chip manufacturer aims to integrate optical connectivity components directly into GPUs, enabling higher data rates while simultaneously reducing power requirements.

The company has been working on CPO solutions for several years and showcased its latest advancements at the recent Hot Chips convention. Broadcom’s “optical engine” reportedly delivers a total interconnect bandwidth of 1.6 TB/sec, equivalent to 6.4 Tbit/sec or 800 GB/sec in each direction.

The AI chip startup that could take down Nvidia

Nvidia may have a sizable lead, but money is an excellent motivator, and tech companies old and new are striving to end its dominance of the AI chip market — or at least secure themselves a sizable slice of it.

While some of these groups, including AMD, are following Nvidia’s lead and optimizing GPUs for generative AI, others are exploring alternative chip architectures.

Intel, for example, markets field programmable gate arrays (FPGAs) — an architecture with reprogrammable circuitry — as AI accelerators. Startup Groq, meanwhile, is developing a brand new kind of AI chip architecture it calls a “language processing unit” (LPU) — it’s optimized for large language models (LLMs), the kinds of AIs that power ChatGPT and other chatbots.

Microsoft, Apple, and NVIDIA will reportedly bail out OpenAI from the shackles of bankruptcy, pushing the ChatGPT maker’s market valuation to over $100 billion

Last month, reports emerged indicating that OpenAI is running on fumes and could be on the brink of bankruptcy within 12 months, with projections of $5 billion in losses. Despite the discounted access to Microsoft’s Azure services and approximately $3.5 billion generated in revenue, the ChatGPT maker might need another round of funding to remain afloat.

And now, according to a report by CNBC, OpenAI is in talks to raise funding which could push its market valuation to over $100 billion. The company’s valuation has significantly grown over the past years — from $29 billion in 2023 to $80 billion earlier this year.

After AGI and After the Singularity There Will Be a Computronium Universe

Humanity is on the verge of AGI (Artificial General Intelligence). Futurist Ray Kurzweil predicted decades ago that we would reach AGI in 2029. AI and Large Language Models could reach AGI sooner than 2029. However, the definitions of artificial intelligence that surpasses individual humans has issues around definitions and measurement.

Kurzweil also predicted the Singularity in 2045. He defined that as having cumulative artificial intelligence beyond the total intelligence of humanity.

Beyond the Singularity is Computronium and the limits of technology and the limits of computing.

Neural and Non-Neural AI, Reasoning, Transformers, and LSTMs

TOC 00:00:00 Intro 00:03:38 Reasoning 00:13:09 Potential AI Breakthroughs Reducing Computation Needs 00:20:39 Memorization vs. Generalization in AI 00:25:19 Approach to the ARC Challenge 00:29:10 Perceptions of Chat GPT and AGI 00:58:45 Abstract Principles of Jurgen’s Approach 01:04:17 Analogical…


Jürgen Schmidhuber, the father of generative AI shares his groundbreaking work in deep learning and artificial intelligence. In this exclusive interview, he discusses the history of AI, some of his contributions to the field, and his vision for the future of intelligent machines. Schmidhuber offers unique insights into the exponential growth of technology and the potential impact of AI on humanity and the universe.

MLST is sponsored by Brave:
The Brave Search API covers over 20 billion webpages, built from scratch without Big Tech biases or the recent extortionate price hikes on search API access. Perfect for AI model training and retrieval augmentated generation. Try it now — get 2,000 free queries monthly at http://brave.com/api.

TOC
00:00:00 Intro.
00:03:38 Reasoning.
00:13:09 Potential AI Breakthroughs Reducing Computation Needs.
00:20:39 Memorization vs. Generalization in AI
00:25:19 Approach to the ARC Challenge.
00:29:10 Perceptions of Chat GPT and AGI
00:58:45 Abstract Principles of Jurgen’s Approach.
01:04:17 Analogical Reasoning and Compression.
01:05:48 Breakthroughs in 1991: the P, the G, and the T in ChatGPT and Generative AI
01:15:50 Use of LSTM in Language Models by Tech Giants.
01:21:08 Neural Network Aspect Ratio Theory.
01:26:53 Reinforcement Learning Without Explicit Teachers.

Refs:

/* */