{"id":179996,"date":"2024-01-06T16:22:27","date_gmt":"2024-01-06T22:22:27","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2024\/01\/how-lightmatter-breaks-bandwidth-bottlenecks-with-silicon-photonics"},"modified":"2024-01-06T16:22:27","modified_gmt":"2024-01-06T22:22:27","slug":"how-lightmatter-breaks-bandwidth-bottlenecks-with-silicon-photonics","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2024\/01\/how-lightmatter-breaks-bandwidth-bottlenecks-with-silicon-photonics","title":{"rendered":"How Lightmatter Breaks Bandwidth Bottlenecks With Silicon Photonics"},"content":{"rendered":"<p style=\"padding-right: 20px\"><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/how-lightmatter-breaks-bandwidth-bottlenecks-with-silicon-photonics.jpg\"><\/a><\/p>\n<p>Without question, the biggest bottleneck in artificial intelligence and for a lot of HPC workloads today is bandwidth. Bandwidth at the network level; bandwidth at the socket level; bandwidth at the compute and memory level. No matter how many teraflops one single chip can push at high precision, once your workload scales beyond a single accelerator, node, or rack, bandwidth quickly becomes the limiting factor.<\/p>\n<p>We have seen chipmakers grapple with this on a number of levels, by packing more high-bandwidth memory onto their chips, boosting interconnect speeds, and by using chiplets to push beyond reticle limits. <a href=\"https:\/\/www.nextplatform.com\/2023\/05\/23\/aurora-rising-a-massive-machine-for-hpc-and-ai\/\">Intel\u2019s \u201cPonte Vecchio\u201d Max Series GPU<\/a> and <a href=\"https:\/\/www.nextplatform.com\/2023\/12\/06\/amd-is-the-undisputed-datacenter-gpu-performance-champ-for-now\/\">AMD\u2019s recently announced \u201cAntares\u201d Instinct MI300X GPU<\/a> are prime examples of the latter. Driving data between chiplets does introduce I\/O bottlenecks in its own right, but we can\u2019t exactly make the dies any bigger.<\/p>\n<p>Aside from needing a socket that is bigger than the reticle limit of lithography machines, we still need more capacity to satiate the demands of modern AI and HPC workloads. Over the past few years, we\u2019ve seen a trend toward denser boxes, racks, and clusters. Cloud providers, hyperscalers, and GPU bit barns are now deploying clusters with <a href=\"https:\/\/www.nextplatform.com\/2023\/07\/05\/the-1-billion-and-higher-ante-to-play-the-ai-game\/\">tens of thousands<\/a> of accelerators to keep up with demand for AI applications. It\u2019s at this beach head that silicon photonics startup Lightmatter, now valued at more than $1 billion, believes it has the market cornered.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Without question, the biggest bottleneck in artificial intelligence and for a lot of HPC workloads today is bandwidth. Bandwidth at the network level; bandwidth at the socket level; bandwidth at the compute and memory level. No matter how many teraflops one single chip can push at high precision, once your workload scales beyond a single [\u2026]<\/p>\n","protected":false},"author":511,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-179996","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/179996","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/511"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=179996"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/179996\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=179996"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=179996"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=179996"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}