{"id":243072,"date":"2026-08-22T21:03:26","date_gmt":"2026-08-23T02:03:26","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2026\/08\/the-dangers-of-trusting-blackbox-machine-learning"},"modified":"2026-08-22T21:03:26","modified_gmt":"2026-08-23T02:03:26","slug":"the-dangers-of-trusting-blackbox-machine-learning","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2026\/08\/the-dangers-of-trusting-blackbox-machine-learning","title":{"rendered":"The dangers of trusting blackbox machine learning"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/the-dangers-of-trusting-blackbox-machine-learning2.jpg\"><\/a><\/p>\n<p>The success of <a href=\"https:\/\/bdtechtalks.com\/2019\/02\/15\/what-is-deep-learning-neural-networks\/\">deep learning<\/a> in the past decade has increased interest in the field of artificial intelligence. But the rising popularity of AI has also highlighted some of the key problems of the field, including the \u201cblack box problem,\u201d the challenge of making sense of the way complex machine learning algorithms make decisions. The Apple Card disaster is one of many manifestations of the black-box problem coming to light in the past years.<\/p>\n<p>The increased attention to black-box machine learning has given rise to a body of research on <a href=\"https:\/\/bdtechtalks.com\/2018\/09\/25\/explainable-interpretable-ai\/\">explainable AI<\/a>. And a lot of the work done in the field involves developing techniques that try to explain the decision made by a <a href=\"https:\/\/bdtechtalks.com\/2017\/08\/28\/artificial-intelligence-machine-learning-deep-learning\/\">machine learning algorithm<\/a> without breaking open the black box. But explaining AI decisions after they happen can have dangerous implications, argues Cynthia Rudin, professor of computer science at Duke University, in a <a href=\"https:\/\/www.nature.com\/articles\/s42256-019-0048-x\" target=\"_blank\" rel=\"noopener noreferrer\">paper<\/a> published in the <em>Nature Machine Intelligence<\/em> journal.<\/p>\n<p>\u201cRather than trying to create models that are inherently interpretable, there has been a recent explosion of work on \u2018explainable ML\u2019, where a second (post hoc) model is created to explain the first black box model. This is problematic. Explanations are often not reliable,\u201d Rudin writes. and can be misleading, as we discuss below.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The success of deep learning in the past decade has increased interest in the field of artificial intelligence. But the rising popularity of AI has also highlighted some of the key problems of the field, including the \u201cblack box problem,\u201d the challenge of making sense of the way complex machine learning algorithms make decisions. The [\u2026]<\/p>\n","protected":false},"author":732,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,6],"tags":[],"class_list":["post-243072","post","type-post","status-publish","format-standard","hentry","category-information-science","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/243072","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/732"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=243072"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/243072\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=243072"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=243072"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=243072"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}