{"id":141246,"date":"2022-06-28T03:12:13","date_gmt":"2022-06-28T08:12:13","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2022\/06\/near-linear-scaling-of-gigantic-model-training-on-aws"},"modified":"2022-06-28T03:12:13","modified_gmt":"2022-06-28T08:12:13","slug":"near-linear-scaling-of-gigantic-model-training-on-aws","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2022\/06\/near-linear-scaling-of-gigantic-model-training-on-aws","title":{"rendered":"Near-linear scaling of gigantic-model training on AWS"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/near-linear-scaling-of-gigantic-model-training-on-aws3.jpg\"><\/a><\/p>\n<p>Linear scaling is often difficult to achieve because the communication required to coordinate the work of the cluster nodes eats into the gains from paralleliza\u2026 See more.<\/p>\n<hr>\n<p>A new distributed-training library achieves near-linear efficiency in scaling from tens to hundreds of GPUs.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Linear scaling is often difficult to achieve because the communication required to coordinate the work of the cluster nodes eats into the gains from paralleliza\u2026 See more. A new distributed-training library achieves near-linear efficiency in scaling from tens to hundreds of GPUs.<\/p>\n","protected":false},"author":359,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1523,1506],"tags":[],"class_list":["post-141246","post","type-post","status-publish","format-standard","hentry","category-computing","category-food"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/141246","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/359"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=141246"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/141246\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=141246"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=141246"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=141246"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}