Lifeboat Foundation

The team has released the width-pruned version of the model on Hugging Face under the Nvidia Open Model License, which allows for commercial use. This makes it accessible to a wider range of users and developers who can benefit from its efficiency and performance.

“Pruning and classical knowledge distillation is a highly cost-effective method to progressively obtain LLMs [large language models] of smaller size, achieving superior accuracy compared to training from scratch across all domains,” the researchers wrote. “It serves as a more effective and data-efficient approach compared to either synthetic-data-style fine-tuning or pretraining from scratch.”

This work is a reminder of the value and importance of the open-source community to the progress of AI. Pruning and distillation are part of a wider body of research that is enabling companies to optimize and customize LLMs at a fraction of the normal cost. Other notable works in the field include Sakana AI’s evolutionary model-merging algorithm, which makes it possible to assemble parts of different models to combine their strengths without the need for expensive training resources.

Explore the nuances of the transformer architecture behind Llama 3 and its prospects for the GenAI ecosystem.

What does the new Llama model mean for everything AI?!

Existing patterning methods for thin metal films rely on prefabricated rigid masks incompatible with soft substrates. Here, the authors report printable and stretchable metal-vapor-desorption layers that facilitate high-fidelity patterning, enabling circuits and devices on 3D curvilinear and stretchable substrates.

AI systems mass-producing cheap research would be bad news for an already struggling scientific ecosystem.

There are two different ways to measure the expansion rate of the Universe, and they don’t agree. And no, new measurements don’t help.

A study appearing in Journal of Bioethical Inquiry explored the legal and ethical challenges expected to arise in human brain organoid research.

Human brain organoids are three-dimensional neural tissues derived from stem cells that can mimic some aspects of the human brain. Their use holds incredible promise for medical advancements, but this also raises complex ethical and legal questions that need careful consideration.

Seeking to examine the various legal challenges that might arise in the context of human brain organoid research and its applications, the team of researchers, which included a legal scholar, identified and outlined potential legal issues.

Single crystals of atomically thin sapphire have been prepared at room temperature, opening the way to miniaturized chips.

Advances in synthetic biology are moving biopharma closer to a world where treatments can be tailored while remaining cost-effective.