Toggle light / dark theme

PyTorch 2.3 Release Blog

PyTorch 2.3 is here đŸ˜ŽđŸ”„

Details:


By Team PyTorch.

We are excited to announce the release of PyTorchÂź 2.3 (release note)! PyTorch 2.3 offers support for user-defined Triton kernels in torch.compile, allowing for users to migrate their own Triton kernels from eager without experiencing performance regressions or graph breaks. Tensor Parallelism improves the experience for training Large Language Models using native PyTorch functions, which has been validated on training runs for 100B parameter models. As well, semi-structured sparsity implements semi-structured sparsity as a Tensor subclass, with observed speedups of up to 1.6 over dense matrix multiplication.

This release is composed of 3,393 commits and 426 contributors since PyTorch 2.2. We want to sincerely thank our dedicated community for your contributions. As always, we encourage you to try these out and report any issues as we improve 2.3. More information about how to get started with the PyTorch 2-series can be found at our Getting Started page.

Paper page — OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Apple presents OpenELM An Efficient Language Model Family with Open-source Training and Inference Framework.

Apple presents OpenELM

An Efficient Language Model Family with Open-source Training and Inference Framework.

The reproducibility and transparency of large language models are crucial for advancing open research, ensuring the trustworthiness of results, and



Join the discussion on this paper page.

How light can vaporize water without the need for heat

It’s the most fundamental of processes—the evaporation of water from the surfaces of oceans and lakes, the burning off of fog in the morning sun, and the drying of briny ponds that leaves solid salt behind. Evaporation is all around us, and humans have been observing it and making use of it for as long as we have existed.

And yet, it turns out, we’ve been missing a major part of the picture all along.

In a series of painstakingly precise experiments, a team of researchers at MIT has demonstrated that heat isn’t alone in causing water to evaporate. Light, striking the water’s surface where air and water meet, can break water molecules away and float them into the air, causing evaporation in the absence of any source of heat.

Novel method could explore gluon saturation at the future electron-ion collider

The U.S. nuclear physics community is preparing to build the electron–ion collider (EIC), a flagship facility for probing the properties of matter and the strong nuclear force that holds matter together. The EIC will allow scientists to study how nucleons (protons and neutrons) arise from the complex interactions of quarks and gluons.

/* */