{"id":179403,"date":"2023-12-28T16:25:22","date_gmt":"2023-12-28T22:25:22","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/12\/giga-ml-wants-to-help-companies-deploy-llms-offline"},"modified":"2023-12-28T16:25:22","modified_gmt":"2023-12-28T22:25:22","slug":"giga-ml-wants-to-help-companies-deploy-llms-offline","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/12\/giga-ml-wants-to-help-companies-deploy-llms-offline","title":{"rendered":"Giga ML wants to help companies deploy LLMs offline"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/giga-ml-wants-to-help-companies-deploy-llms-offline2.jpg\"><\/a><\/p>\n<p>AI is all the rage \u2014 particularly text-generating AI, also known as large language models (think models along the lines of <a href=\"https:\/\/techcrunch.com\/tag\/chatgpt\/\">ChatGPT<\/a>). In one recent <a href=\"https:\/\/ai-infrastructure.org\/enterprise-generative-ai-adoption-report-aug-2023\/\" target=\"_blank\" rel=\"noopener\">survey<\/a> of ~1,000 enterprise organizations, 67.2% say that they see adopting large language models (LLMs) as a top priority by early 2024.<\/p>\n<p>But barriers stand in the way. According to the same survey, a lack of customization and flexibility, paired with the inability to preserve company knowledge and IP, were \u2014 and are \u2014 preventing many businesses from deploying LLMs into production.<\/p>\n<p>That got Varun Vummadi and Esha Manideep Dinne thinking: What might a solution to the enterprise LLM adoption challenge look like? In search of one, they founded <a href=\"https:\/\/gigaml.com\/\" target=\"_blank\" rel=\"noopener\">Giga ML<\/a>, a startup building a platform that lets companies deploy LLMs on-premise \u2014 ostensibly cutting costs and preserving privacy in the process.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI is all the rage \u2014 particularly text-generating AI, also known as large language models (think models along the lines of ChatGPT). In one recent survey of ~1,000 enterprise organizations, 67.2% say that they see adopting large language models (LLMs) as a top priority by early 2024. But barriers stand in the way. According to [\u2026]<\/p>\n","protected":false},"author":578,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[43,6],"tags":[],"class_list":["post-179403","post","type-post","status-publish","format-standard","hentry","category-business","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/179403","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/578"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=179403"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/179403\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=179403"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=179403"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=179403"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}