Toggle light / dark theme

Researchers using NASA

Established in 1958, the National Aeronautics and Space Administration (NASA) is an independent agency of the United States Federal Government that succeeded the National Advisory Committee for Aeronautics (NACA). It is responsible for the civilian space program, as well as aeronautics and aerospace research. Its vision is “To discover and expand knowledge for the benefit of humanity.” Its core values are “safety, integrity, teamwork, excellence, and inclusion.” NASA conducts research, develops technology and launches missions to explore and study Earth, the solar system, and the universe beyond. It also works to advance the state of knowledge in a wide range of scientific fields, including Earth and space science, planetary science, astrophysics, and heliophysics, and it collaborates with private companies and international partners to achieve its goals.

(The Conversation is an independent and nonprofit source of news, analysis and commentary from academic experts.) (THE CONVERSATION) As with weeds in a garden, it is a challenge to fully get rid of cancer cells in the body once they arise. They have a relentless need to continuously expand, even when they are significantly cut back by therapy or surgery.

Over the last decade, the landscape of machine learning software development has undergone significant changes. Many frameworks have come and gone, but most have relied heavily on leveraging Nvidia’s CUDA and performed best on Nvidia GPUs. However, with the arrival of PyTorch 2.0 and OpenAI’s Triton, Nvidia’s dominant position in this field, mainly due to its software moat, is being disrupted.

This report will touch on topics such as why Google’s TensorFlow lost out to PyTorch, why Google hasn’t been able to capitalize publicly on its early leadership of AI, the major components of machine learning model training time, the memory capacity/bandwidth/cost wall, model optimization, why other AI hardware companies haven’t been able to make a dent in Nvidia’s dominance so far, why hardware will start to matter more, how Nvidia’s competitive advantage in CUDA is wiped away, and a major win one of Nvidia’s competitors has at a large cloud for training silicon.