Google presents RecurrentGemma.
Moving past transformers for efficient open language models.
We introduce RecurrentGemma, an open #language model which uses Google’s novel Griffin architecture.
Join the discussion on this paper page.
Category: futurism – Page 150
This is our Muon Shot
Posted in futurism, particle physics
In December, the Particle Physics Project Prioritization Panel, called P5, released its recommendations for the future of the field, based on the input from the Snowmass process.
The US physics community dreams of building a muon collider.
Reminds me of the world of null A by AEVan Vogh.
Many-valued logics are non-classical logics. They are similar to classical logic because they accept the principle of truth-functionality, namely, that the truth of a compound sentence is determined by the truth values of its component sentences (and so remains unaffected when one of its component sentences is replaced by another sentence with the same truth value). But they differ from classical logic by the fundamental fact that they do not restrict the number of truth values to only two: they allow for a larger set W W of truth degrees.
From MIT & Princeton.
JetMoE
Reaching Llama2 Performance with 0.1M Dollars.
Large Language Models (#LLMs) have achieved remarkable results, but their increasing resource demand has become a major obstacle to the development of powerful and accessible…
Several similar large, fossilized bone fragments have been discovered in various regions across Western and Central Europe since the 19th century. The animal group to which they belonged is still the subject of much debate to this day. A study carried out at the University of Bonn could now settle this dispute once and for all: The microstructure of the fossils indicates that they come from the lower jaw of a gigantic ichthyosaur. These animals could reach 25 to 30 meters in length, a similar size to the modern blue whale. The results have now been published in the journal PeerJ.
In 1,850, the British naturalist Samuel Stutchbury reported a mysterious find in a scientific journal: A large, cylindrical bone fragment had been discovered at Aust Cliff – a fossil deposit near to Bristol. Similar bone fragments have since been found in various different places around Europe, including Bonenburg in North Rhine-Westphalia and in the Provence region of France. More than 200 million years ago, these areas were submerged beneath a huge ocean that covered vast swathes of Western and Central Europe. Fossil remains from the animal world of that time – including marine and coastal dwellers – have been preserved in the sediment.
There is still some debate to this day about the animal group to which these large, fossilized bones belonged. Stutchbury assumed in his examination of the first finds that they came from a labyrinthodontia, an extinct crocodile-like land creature. However, this hypothesis was questioned by other researchers, who believed instead that the fossils came from long-necked dinosaurs (sauropods), stegosaurs, or a still completely unknown group of dinosaurs.
“The problems arising when interpreting the data from WASP-39b are well known from many other exoplanets — regardless whether they are observed with Kepler, TESS, James Webb, or the future PLATO spacecraft,” said Dr. Nadiia Kostogryz.
While there is currently a myriad of techniques used to both discover exoplanets and calculate their physical characteristics, could other methods be developed to overcome specific data errors? This is what a recent study published in Nature Astronomy hopes to address as an international team of researchers investigated how a star’s magnetic field can be used to ascertain additional data for an exoplanet, which is traditionally done using conventional exoplanet detection methods, specifically the transit detection method. This study holds the potential to help astronomers establish new methods for discovering and characterizing exoplanets throughout the cosmos.
For the transit method, an exoplanet passes in front of its parent star, causing its starlight to slightly decrease and has been instrumental in discovering and characterizing thousands of exoplanets. However, astronomers have also discovered that a star’s limb darkening, which is the observed edge of the star, causes errors in transit light curves for exoplanets, despite using state-of-the-art atmospheric models to predict observations.
For the study, the researchers focused on WASP-39b, which is a gas giant located approximately 700 light-years from Earth and has been studied in great detail using a myriad of space telescopes, and most recently with NASA’s James Webb Space Telescope (JWST). However, astronomers have discovered inconsistencies between models and observations, which this study hopes to overcome.
Draft-MicroPsi-JBach-07–03-30.pdf
Posted in futurism
Picture this disaster scenario in the making: At an industrial plant, a pipe cracks, spraying a cloud of tiny droplets into the air. Workers, however, are in luck. Within minutes, a laser-based device the size of a small suitcase spots the cloud and tells safety crews what’s in it so they know how to respond.
That’s the vision behind a new project from a team of engineers and chemists at the University of Colorado Boulder, California Institute of Technology, University of California Santa Barbara, and three companies. It’s funded by a new contract from the Intelligence Advanced Research Projects Activity (IARPA), part of the federal Office of the Director of National Intelligence.
The effort borrows its name, the Standoff Aerosol measUrement Remote Optical Network (SAURON), from the villain in “The Lord of the Rings” book series—a presence who often takes the form of a flaming eye and whose “gaze pierces cloud, shadow, earth.”
An international team of researchers has stumbled upon a remarkable discovery — the first regular molecular fractal in nature.
This fascinating finding, led by groups from the Max Planck Institute and the Philipps University in Marburg, Germany, has unveiled a microbial enzyme that spontaneously assembles into a pattern known as the Sierpinski triangle.
The enzyme, identified as citrate synthase from a cyanobacterium, was discovered by chance. “We stumbled on this structure completely by accident and almost couldn’t believe what we saw when we first took images of it using an electron microscope,” says Franziska Sendker, the study’s first author.
From Words to Numbers.
Your large language model is secretly a capable regressor when given in-context examples.
We analyze how well pre-trained large language models (e.g., Llama2, GPT-4, Claude 3, etc) can do linear and non-linear #regression when given…
Join the discussion on this paper page.