Lifeboat Foundation

Phones remain undefeated.

LLMs forget. Everyone knows that. The primary culprit behind this is the finity of context length of the models. Some even say that it is the biggest bottleneck when it comes to achieving AGI.

Soon, it appears that the debate over which model boasts the largest context length will become irrelevant. Microsoft, Google, and Meta, have all been taking strides in this direction – making context length infinite.

While all LLMs are currently running on Transformers, it might soon become a thing of the past. For example, Meta has introduced MEGALODON, a neural architecture designed for efficient sequence modelling with unlimited context length.

“I’m starting to see these companies and startups that are, ‘How do you optimize your cloud, and how do you manage your cloud?’ There’s a lot of people focused on questions like, ‘You’ve got a lot of data, can I store it better for you?’ Or, ‘You’ve got a lot of new applications; can I help you monitor them better?’ Because all the tools you used to have don’t work anymore,” he said. Maybe the age of digital transformation is over, he said, and we’re now in the age of cloud optimization.

United itself has bet heavily on the cloud, specifically AWS as its preferred cloud provider. Unsurprisingly, United, too, is looking at how the company can optimize its cloud usage, from both a cost and reliability perspective. Like for so many companies that are going through this process, that also means looking at developer productivity and adding automation and DevOps practices into the mix. “We’re there. We have an established presence [in the cloud], but now we’re kind of in the market to try to continue to optimize as well,” Birnbaum said.

But that also comes back to reliability. Like all airlines, United still operates a lot of legacy systems — and they still work. “Frankly, we are extra careful as we move through this journey, to make sure we don’t disrupt the operation or create self-inflicted wounds,” he said.

In this edition of TechCrunch’s Week in Review (WiR) newsletter, we cover Boston Dynamics’ new humanoid robot and more.

Concern about a generative AI bubble is growing. To defend against disillusionment, measure its concrete value.

Researchers at the University of Bristol have uncovered the secrets behind the quiet operation of futuristic aircraft equipped with innovative embedded engines.

The study sheds light on the noise generation and transmission mechanisms of boundary layer ingesting (BLI) ducted fans. These engines draw in air from both the front and the surface of the aircraft’s body and operate with high efficiency, reducing fuel consumption compared to traditional engines.

Researchers have developed a high-power hybrid sodium-ion battery that can be charged in seconds, potentially replacing lithium-ion batteries.

FineWeb: 15 trillion tokens of high quality web data the web has to offer.

The 🍷 dataset consists of more than 15T tokens of cleaned and deduplicated english web data from CommonCrawl.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

The LASSIE project is preparing for a time when people and robots explore space together.

Learn more about how the #space economy can improve life on #Earth from our new insight report, ‘Space: The $1.8 Trillion Opportunity for Global Economic Growth’:

Space is approaching a new frontier. The space economy is expected to be worth $1.8 trillion by 2035 as satellite and rocket-enabled technologies become increasingly prevalent, according to a new report.

Continue reading “Space is booming. Here’s how to embrace the $1.8 trillion opportunity” »