GaLore.
Memory-efficient LLM training by gradient low-rank projection.
V/@animaanandkumar.
For the first time, we show that the Llama 7B LLM can be trained on a single consumer-grade GPU (RTX 4090) with only 24GB memory.
Apple presents How Far Are We from Intelligent Visual Deductive Reasoning?
Join the discussion on this paper page.
Researchers observe the quantum coherence of a quintet state with four electron spins in molecular systems for the first time at room temperature.
In a study published in Science Advances, a group of researchers led by Associate Professor Nobuhiro Yanai from Kyushu University’s Faculty of Engineering, in collaboration with Associate Professor Kiyoshi Miyata from Kyushu University and Professor Yasuhiro Kobori of Kobe University, reports that they have achieved quantum coherence at room temperature: the ability of a quantum system to maintain a well-defined state over time without getting affected by surrounding disturbances.
This breakthrough was made possible by embedding a chromophore, a dye molecule that absorbs light and emits color, in a metal-organic framework, or MOF, a nanoporous crystalline material composed of metal ions and organic ligands.
The last reported case of human plague in Florida occurred in 1920 during an outbreak in Pensacola.
Cases of leprosy have increased in Florida and the southeastern United States over the last decade, according to a new report.
Leprosy, officially called Hansen’s disease, is a rare type of bacterial infection that attacks the nerves and can cause swelling under the skin. The new research paper, published in the Centers for Disease Control and Prevention’s Emerging Infectious Diseases journal, found that reported cases doubled in the Southeast over the last 10 years.
Central Florida in particular has seen a disproportionate share of cases, which indicates it might be an endemic location for the disease, meaning leprosy has a consistent presence in the region’s population rather than popping up in the form of one-off outbreaks.
Rates increased among all age groups, including newborns, and in all regions of the country. In 2022, 3,755 cases of babies born with syphilis in the U.S. were reported, which reflects an alarming 937% increase in the past decade, the CDC said.
The report continued that racial and ethnic minorities are most disproportionately affected due to “long standing social inequities that often lead to health inequalities.”
The 13th Amendment abolished slavery in the United States in 1,865, with one exception: compulsory labor in prisons.
Most humanoid robots pick things up with their hands – but that’s not how we humans do it, particularly when we’re carrying something bulky. We use our chests, hips and arms as well – and that’s the idea behind Toyota’s new soft robot.
Punyo, as it’s called, is a torso-up humanoid research platform. First and foremost, it’s adorably Japanese, with a cute and approachable looking face and a cuddly, husky look reminiscent of the Baymax robot from Disney’s Big Hero 6. Adding to the cuddle factor, he appears to be wearing a big, cosy-looking sweater.
And indeed, this “sweater” is highly hug-focused. It’s made using grippy materials that provide a squishy, compliant layer over Punyo’s hard metal skeleton, and the fabric is loaded with tactile sensors that allow it to feel exactly what it’s hugging, be it a person or an item that it’s carrying.
High-energy neutrinos are extremely rare particles that have so far proved very difficult to detect. Fluxes of these rare particles were first detected by the IceCube Collaboration back in 2013.
Recent papers featured in Physical Review D and The Astrophysical Journal Letters found that nearby supernovae, especially Galactic ones, would be promising sources of high-energy neutrinos. This has inspired new studies exploring the possibility of detecting neutrinos originating from these sources using large particle collider detectors, such as the ATLAS detector at CERN.
Researchers at Harvard University, University of Nevada and Pennsylvania State University recently demonstrated that the ATLAS detector can measure the flux of high-energy supernova neutrinos. Their new paper, published in Physical Review Letters, could inspire future efforts aimed at detecting fluxes of high-energy neutrinos.
Water and electronics don’t usually mix, but as it turns out, batteries could benefit from some H2O.
By replacing the hazardous chemical electrolytes used in commercial batteries with water, scientists have developed a recyclable ‘water battery’ – and solved key issues with the emerging technology, which could be a safer and greener alternative.
‘Water batteries’ are formally known as aqueous metal-ion batteries. These devices use metals such as magnesium or zinc, which are cheaper to assemble and less toxic than the materials currently used in other kinds of batteries.