InternLM2 Technical Report
Posted in robotics/AI
InternLM2
The evolution of Large Language Models (LLMs) like ChatGPT and GPT-4 has sparked discussions on the advent of Artificial General Intelligence (AGI).
Join the discussion on this paper page.
Coming hot on the heels of two massive announcements last year, last week Nvidia and Cerebras showed yet again that the pace of computing is still accelerating.
The first CS-2 based Condor Galaxy AI supercomputers went online in late 2023, and already Cerebras is unveiling its successor the CS-3, based on the newly launched Wafer Scale Engine 3, an update to the WSE-2 using 5nm fabrication and boasting a staggering 900,000 AI optimized cores with sparse compute support. CS-3 incorporates Qualcomm AI 100 Ultra processors to speed up inference.
Note: sparse compute is an optimization that takes advantage of the fact that a multiplication by zero always results in zero to skip calculations that could include dozens of operands, one of which is a zero. The result can lead to a huge speedup in performance with sparse data sets like neural networks.
A BANK of America customer was deprived of $18,000 after she answered a call she thought was from the company.
Lura Ball, of California, said she normally ignores strange texts or calls after being scammed.
She lost thousands after being ordered to use the platform, Zelle, as reported by the ABC affiliate KABC.
The first patient with a Neuralink brain-computer implant played Nintendo’s Mario Kart video game with his mind in an impressive new demo video, calling it “lifechanging” at a company-wide meeting that was posted Friday on the social media platform X-formerly-Twitter.
“It’s been a wild ride,” said Noland Arbaugh, the 29-year-old Neuralink patient, during the celebratory company meeting.
“This is going to change the world,” added Arbaugh, who’s quadriplegic, meaning he’s paralyzed below his neck from a swimming accident, and requires the use of a wheelchair.
Intel announces Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUs https://huggingface.co/papers/2403.
This paper presents a SYCL implementation of Multi-Layer Perceptrons (MLPs), which targets and is optimized for the Intel Data Center GPU Max 1550.
Join the discussion on this paper page.
Researchers at Weill Cornell Medicine have discovered a protein called SEL1L that plays a critical role in clearing collagen from tissue, and that may be a therapeutic target to help prevent fibrosis, scar tissue that interferes with organ function. The paper, published on Feb. 20 in Nature Communications, provides clues that could lead to drug development for diseases like lung fibrosis which have no therapeutic options currently.