{"id":133209,"date":"2021-12-28T20:23:44","date_gmt":"2021-12-29T04:23:44","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2021\/12\/dram-that-thinks-will-accelerate-ai"},"modified":"2021-12-28T20:23:44","modified_gmt":"2021-12-29T04:23:44","slug":"dram-that-thinks-will-accelerate-ai","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2021\/12\/dram-that-thinks-will-accelerate-ai","title":{"rendered":"DRAM That Thinks Will Accelerate AI"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/dram-that-thinks-will-accelerate-ai2.jpg\"><\/a><\/p>\n<p><strong>John von Neumann\u2019s<\/strong> original computer architecture, where logic and memory are separate domains, has had a good run. But some companies are betting that it\u2019s time for a change.<\/p>\n<p>In recent years, the shift toward more parallel processing and a massive increase in the size of neural networks mean processors need to access more data from memory more quickly. And yet \u201cthe performance gap between DRAM and processor is wider than ever,\u201d says <a href=\"https:\/\/en.wikipedia.org\/wiki\/Joungho_Kim\" rel=\"noopener noreferrer\" target=\"_blank\" class=\"\">Joungho Kim<\/a>, an expert in 3D memory chips at Korea Advanced Institute of Science and Technology, in Daejeon, and an IEEE Fellow. The von Neumann architecture has become the von Neumann bottleneck.<\/p>\n<p>What if, instead, at least some of the processing happened in the memory? Less data would have to move between chips, and you\u2019d save energy, too. It\u2019s not a new idea. But its moment may finally have arrived. Last year, Samsung, the world\u2019s largest maker of dynamic random-access memory (DRAM), started rolling out processing-in-memory (PIM) tech. Its first PIM offering, unveiled in February 2021, integrated AI-focused compute cores inside its <a href=\"https:\/\/spectrum.ieee.org\/samsung-ai-memory-chips\" target=\"_self\" class=\"\">Aquabolt-XL<\/a> high-bandwidth memory. HBM is the kind of specialized DRAM that surrounds some top AI accelerator chips. The new memory is designed to act as a \u201cdrop-in replacement\u201d for ordinary HBM chips, said <a href=\"https:\/\/en.wikipedia.org\/wiki\/Nam_Sung_Kim\" rel=\"noopener noreferrer\" target=\"_blank\" class=\"\">Nam Sung Kim<\/a>, an IEEE Fellow, who was then senior vice president of Samsung\u2019s memory business unit.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>John von Neumann\u2019s original computer architecture, where logic and memory are separate domains, has had a good run. But some companies are betting that it\u2019s time for a change. In recent years, the shift toward more parallel processing and a massive increase in the size of neural networks mean processors need to access more data [\u2026]<\/p>\n","protected":false},"author":396,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[43,6],"tags":[],"class_list":["post-133209","post","type-post","status-publish","format-standard","hentry","category-business","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/133209","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/396"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=133209"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/133209\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=133209"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=133209"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=133209"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}