{"id":158578,"date":"2023-02-20T14:51:39","date_gmt":"2023-02-20T20:51:39","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/02\/now-build-chatgpt-on-your-own-device"},"modified":"2023-02-20T14:51:39","modified_gmt":"2023-02-20T20:51:39","slug":"now-build-chatgpt-on-your-own-device","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/02\/now-build-chatgpt-on-your-own-device","title":{"rendered":"Now Build ChatGPT On Your Own Device"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/now-build-chatgpt-on-your-own-device2.jpg\"><\/a><\/p>\n<p>Since <a href=\"https:\/\/analyticsindiamag.com\/openai-launches-chatgpt-plus-a-new-paid-model\/\">OpenAI<\/a> has not open-sourced the code for <a href=\"https:\/\/analyticsindiamag.com\/how-chatgpt-broke-the-ai-hype-cycle\/\">ChatGPT<\/a>, replicating the chatbot is a herculean task, and even the big-tech are struggling. But, AI startup <a href=\"https:\/\/colossalai.org\/\" target=\"_blank\" rel=\"follow\">Colossal-AI<\/a> has found a way to build your own ChatGPT with less computing resources.<\/p>\n<p>Towards this goal, the company has leveraged a PyTorch-based implementation that covers <strong>all three stages<\/strong> from pre-training, reward model training, and reinforcement learning. They offer a demo version of the training process that requires only <strong>1.62 GB<\/strong> of GPU memory and can be done on a single consumer-grade GPU, with <strong>10.3x growth<\/strong> on one GPU model capacity.<\/p>\n<p>Check out the GitHub repository <a href=\"https:\/\/github.com\/hpcaitech\/ColossalAI\" target=\"_blank\" rel=\"follow\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Since OpenAI has not open-sourced the code for ChatGPT, replicating the chatbot is a herculean task, and even the big-tech are struggling. But, AI startup Colossal-AI has found a way to build your own ChatGPT with less computing resources. Towards this goal, the company has leveraged a PyTorch-based implementation that covers all three stages from [\u2026]<\/p>\n","protected":false},"author":599,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-158578","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/158578","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/599"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=158578"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/158578\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=158578"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=158578"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=158578"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}