{"id":171826,"date":"2023-09-12T00:25:15","date_gmt":"2023-09-12T05:25:15","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/09\/machine-learning-masters-massive-data-sets"},"modified":"2023-09-12T00:25:15","modified_gmt":"2023-09-12T05:25:15","slug":"machine-learning-masters-massive-data-sets","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/09\/machine-learning-masters-massive-data-sets","title":{"rendered":"Machine learning masters massive data sets"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/machine-learning-masters-massive-data-sets2.jpg\"><\/a><\/p>\n<p>A machine-learning algorithm demonstrated the capability to process data that exceeds a computer\u2019s available memory by identifying a massive data set\u2019s key features and dividing them into manageable batches that don\u2019t choke computer hardware. Developed at Los Alamos National Laboratory, the algorithm set a world record for factorizing huge data sets during a test run on Oak Ridge National Laboratory\u2019s Summit, the world\u2019s fifth-fastest supercomputer.<\/p>\n<p>Equally efficient on laptops and supercomputers, the highly scalable <a href=\"https:\/\/techxplore.com\/tags\/algorithm\/\" rel=\"tag\" class=\"\">algorithm<\/a> solves hardware bottlenecks that prevent processing information from data-rich applications in <a href=\"https:\/\/techxplore.com\/tags\/cancer+research\/\" rel=\"tag\" class=\"\">cancer research<\/a>, <a href=\"https:\/\/techxplore.com\/tags\/satellite+imagery\/\" rel=\"tag\" class=\"\">satellite imagery<\/a>, social media networks, national security science and earthquake research, to name just a few.<\/p>\n<p>\u201cWe developed an \u2018out-of-memory\u2019 implementation of the non-negative matrix factorization method that allows you to factorize larger <a href=\"https:\/\/techxplore.com\/tags\/data+sets\/\" rel=\"tag\" class=\"\">data sets<\/a> than previously possible on a given hardware,\u201d said Ismael Boureima, a computational physicist at Los Alamos National Laboratory. Boureima is first author of the <a href=\"https:\/\/link.springer.com\/article\/10.1007\/s11227-023-05587-4\">paper<\/a> in <i>The Journal of Supercomputing<\/i> on the record-breaking algorithm.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A machine-learning algorithm demonstrated the capability to process data that exceeds a computer\u2019s available memory by identifying a massive data set\u2019s key features and dividing them into manageable batches that don\u2019t choke computer hardware. Developed at Los Alamos National Laboratory, the algorithm set a world record for factorizing huge data sets during a test run [\u2026]<\/p>\n","protected":false},"author":359,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11,41,6,2028,1492,44],"tags":[],"class_list":["post-171826","post","type-post","status-publish","format-standard","hentry","category-biotech-medical","category-information-science","category-robotics-ai","category-satellites","category-security","category-supercomputing"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/171826","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/359"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=171826"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/171826\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=171826"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=171826"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=171826"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}