{"id":131617,"date":"2021-12-02T03:22:27","date_gmt":"2021-12-02T11:22:27","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2021\/12\/amazon-announces-graviton3-processors-for-ai-inferencing"},"modified":"2021-12-02T03:22:27","modified_gmt":"2021-12-02T11:22:27","slug":"amazon-announces-graviton3-processors-for-ai-inferencing","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2021\/12\/amazon-announces-graviton3-processors-for-ai-inferencing","title":{"rendered":"Amazon announces Graviton3 processors for AI inferencing"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/amazon-announces-graviton3-processors-for-ai-inferencing.jpg\"><\/a><\/p>\n<p>At its <a href=\"https:\/\/venturebeat.com\/tag\/reinvent\">re: Invent 2021 conference<\/a> today, Amazon announced Graviton3, the next generation of its custom ARM-based chip for AI inferencing applications. Soon to be available in Amazon Web Services (AWS) C7g instances, the company says that the processors are optimized for workloads including high-performance compute, batch processing, media encoding, scientific modeling, ad serving, and distributed analytics.<\/p>\n<p>Alongside Graviton3, Amazon unveiled Trn1, a new instance for training deep learning models in the cloud \u2014 including models for apps like <a href=\"https:\/\/venturebeat.com\/2021\/11\/22\/nvidias-latest-ai-tech-translates-text-into-landscape-images\/\">image recognition<\/a>, <a href=\"https:\/\/venturebeat.com\/2021\/09\/21\/enterprise-nlp-budgets-are-up-10-in-2021\/\">natural language processing<\/a>, fraud detection, and forecasting. It\u2019s powered by <a href=\"https:\/\/venturebeat.com\/2020\/12\/01\/amazon-debuts-trainium-a-custom-chip-for-machine-learning-training-workloads\/\">Trainium<\/a>, an Amazon-designed chip that the company last year claimed would offer the most teraflops of any machine learning instance in the cloud. (A teraflop translates to a chip being able to process 1 trillion calculations per second.) <\/p>\n<p>As companies face pandemic headwinds including worker shortages and supply chain disruptions, they\u2019re increasingly turning to AI for efficiency gains. According to a <a href=\"https:\/\/www.forbes.com\/sites\/louiscolumbus\/2021\/01\/17\/76-of-enterprises-prioritize-ai--machine-learning-in-2021-it-budgets\/\">recent<\/a> Algorithmia survey, 50% of enterprises plan to spend more on AI and machine learning in 2021, with 20% saying they will be \u201csignificantly\u201d increasing their budgets for AI and ML. AI adoption is, in turn, <a href=\"https:\/\/venturebeat.com\/2021\/07\/30\/ai-weekly-ai-adoption-is-driving-cloud-growth\/\">driving cloud growth<\/a> \u2014 a trend of which Amazon is acutely aware, hence the continued investments in technologies like Graviton3 and Trn1.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>At its re: Invent 2021 conference today, Amazon announced Graviton3, the next generation of its custom ARM-based chip for AI inferencing applications. Soon to be available in Amazon Web Services (AWS) C7g instances, the company says that the processors are optimized for workloads including high-performance compute, batch processing, media encoding, scientific modeling, ad serving, and [\u2026]<\/p>\n","protected":false},"author":662,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,6],"tags":[],"class_list":["post-131617","post","type-post","status-publish","format-standard","hentry","category-information-science","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/131617","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/662"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=131617"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/131617\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=131617"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=131617"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=131617"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}