Toggle light / dark theme

Interpretable language modeling via induction-head ngram models.

Eunji Kim, Sriya Mantena, Weiwei Yang, Chandan Singh, Sungroh Yoon, Jianfeng Gao Microsoft Research 2024 https://arxiv.org/abs/2411.

Large language models (LLMs) have made impressive…


Official code for ‘Interpretable Language Modeling via Induction-head Ngram Models’ — ejkim47/induction-gram.

Nuclear fission has powered our world and medical advancements for decades, yet some of its secrets have remained elusive.

One of the biggest puzzles? What exactly happens when an atom’s nucleus splits apart at its “neck rupture” point.

Aurel Bulgac, a physics professor at the University of Washington, has been delving into this very question. He and his team set out to simulate the intricate particle dance during this critical moment of fission.

However, for the first time, two dark matter experiments have detected a neutrino fog, a dense cloud of neutrinos. This discovery is reported by researchers from XENON and PandaX — two scientific experiments that aim to detect dark matter, operating independently in Italy and China respectively.

“This is the first measurement of astrophysical neutrinos with a dark matter experiment,” Fei Gao, a scientist involved in the Xenon experiment, said.

Neutrinos are typically detected through coherent elastic neutrino-nucleus scattering (CEvNS), a process in which neutrinos interact with the entire nucleus rather than just a proton or electron.

A US bank is warning customers of a security “intrusion” that may have compromised Mastercard account numbers and other financial data.

Maryland-based Eagle Bank says it has received a notice from Mastercard, stating an unnamed US merchant allowed unauthorized access to account information between August 15th, 2023, and May 25th, 2024.

The bank revealed the breach in a filing with the Massachusetts state government.

Scientists claim that experimental studies of Higgs boson interactions face a fundamental challenge.


Scientists believe that interactions between Higgs bosons could unlock insights into new physics. Discovered at CERN’s Large Hadron Collider (LHC) in 2012, the elusive Higgs boson particle has been at the centre stage for exploring new possibilities in particle physics.

Scientists claimed that the production of Higgs boson pairs can occur within the Standard Model itself. It is such a rare process here that it has not been possible to observe it in the data collected so far.