{"id":147544,"date":"2022-10-04T19:24:32","date_gmt":"2022-10-05T00:24:32","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2022\/10\/new-technique-enables-on-device-training-using-less-than-a-quarter-of-a-megabyte-of-memory"},"modified":"2022-10-04T19:24:32","modified_gmt":"2022-10-05T00:24:32","slug":"new-technique-enables-on-device-training-using-less-than-a-quarter-of-a-megabyte-of-memory","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2022\/10\/new-technique-enables-on-device-training-using-less-than-a-quarter-of-a-megabyte-of-memory","title":{"rendered":"New technique enables on-device training using less than a quarter of a megabyte of memory"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/new-technique-enables-on-device-training-using-less-than-a-quarter-of-a-megabyte-of-memory.jpg\"><\/a><\/p>\n<p>Microcontrollers, miniature computers that can run simple commands, are the basis for billions of connected devices, from internet-of-things (IoT) devices to sensors in automobiles. But cheap, low-power microcontrollers have extremely limited memory and no operating system, making it challenging to train artificial intelligence models on \u201cedge devices\u201d that work independently from central computing resources.<\/p>\n<p>Training a <a href=\"https:\/\/techxplore.com\/tags\/machine-learning+model\/\" rel=\"tag\" class=\"\">machine-learning model<\/a> on an intelligent edge device allows it to adapt to new data and make better predictions. For instance, training a model on a smart keyboard could enable the keyboard to continually learn from the user\u2019s writing. However, the training process requires so much memory that it is typically done using powerful computers at a data center, before the model is deployed on a device. This is more costly and raises privacy issues since user data must be sent to a central server.<\/p>\n<p>To address this problem, researchers at MIT and the MIT-IBM Watson AI Lab have developed a new technique that enables on-device training using less than a quarter of a megabyte of memory. Other training solutions designed for connected devices can use more than 500 megabytes of memory, greatly exceeding the 256-kilobyte capacity of most microcontrollers (there are 1,024 kilobytes in one <a href=\"https:\/\/techxplore.com\/tags\/megabyte\/\" rel=\"tag\" class=\"\">megabyte<\/a>).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microcontrollers, miniature computers that can run simple commands, are the basis for billions of connected devices, from internet-of-things (IoT) devices to sensors in automobiles. But cheap, low-power microcontrollers have extremely limited memory and no operating system, making it challenging to train artificial intelligence models on \u201cedge devices\u201d that work independently from central computing resources. Training [\u2026]<\/p>\n","protected":false},"author":427,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[418,6],"tags":[],"class_list":["post-147544","post","type-post","status-publish","format-standard","hentry","category-internet","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/147544","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/427"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=147544"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/147544\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=147544"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=147544"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=147544"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}