{"id":172850,"date":"2023-09-26T14:23:35","date_gmt":"2023-09-26T19:23:35","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/09\/sambanovas-new-chip-runs-ai-models-to-5-trillion-parameters"},"modified":"2023-09-26T14:23:35","modified_gmt":"2023-09-26T19:23:35","slug":"sambanovas-new-chip-runs-ai-models-to-5-trillion-parameters","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/09\/sambanovas-new-chip-runs-ai-models-to-5-trillion-parameters","title":{"rendered":"SambaNova\u2019s new chip runs AI models to 5 trillion parameters"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/sambanovas-new-chip-runs-ai-models-to-5-trillion-parameters2.jpg\"><\/a><\/p>\n<p>The SN40L chip will allow for improved enterprise solutions.<\/p>\n<p>Palo Alto-based AI chip startup SambaNova has introduced a new semiconductor that can be used in running high-performance computing applications, like the company\u2019s LLM platform SambaNova Suite, with faster training of models at a lower total cost.<\/p>\n<p>SambaNova announced the chip, SN40L, can serve a 5 trillion parameter model with 256k+ sequence length possible on a single system node. It is being touted as an alternative to NVIDIA, which is a frontrunner in the chip race and recently unveiled what will possibly be the most powerful chip in the market \u2013 GH200 \u2013 which can support 480 GB of CPU RAM and 96 GB of GPU RAM.<\/p>\n<p>A \u2018game changer\u2019<\/p>\n<p>The\u2026 More<\/p>\n<hr>\n<p>X<\/p>\n<div class=\"more-link-wrapper\"> <a class=\"more-link\" href=\"https:\/\/lifeboat.com\/blog\/2023\/09\/sambanovas-new-chip-runs-ai-models-to-5-trillion-parameters\">Continue reading \u201cSambaNova\u2019s new chip runs AI models to 5 trillion parameters\u201d | &gt;<\/a><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The SN40L chip will allow for improved enterprise solutions. Palo Alto-based AI chip startup SambaNova has introduced a new semiconductor that can be used in running high-performance computing applications, like the company\u2019s LLM platform SambaNova Suite, with faster training of models at a lower total cost. SambaNova announced the chip, SN40L, can serve a 5 [\u2026]<\/p>\n","protected":false},"author":578,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-172850","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/172850","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/578"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=172850"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/172850\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=172850"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=172850"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=172850"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}