{"id":117762,"date":"2020-12-29T17:23:54","date_gmt":"2020-12-30T01:23:54","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2020\/12\/exploring-the-notion-of-shortcut-learning-in-deep-neural-networks"},"modified":"2020-12-29T17:23:54","modified_gmt":"2020-12-30T01:23:54","slug":"exploring-the-notion-of-shortcut-learning-in-deep-neural-networks","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2020\/12\/exploring-the-notion-of-shortcut-learning-in-deep-neural-networks","title":{"rendered":"Exploring the notion of shortcut learning in deep neural networks"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/exploring-the-notion-of-shortcut-learning-in-deep-neural-networks2.jpg\"><\/a><\/p>\n<p>Over the past few years, artificial intelligence (AI) tools, particularly deep neural networks, have achieved remarkable results on a number of tasks. However, recent studies have found that these computational techniques have a number of limitations. In a recent paper published in <i>Nature Machine Intelligence<\/i>, researchers at T\u00fcbingen and Toronto universities explored and discussed a problem known as \u2018shortcut learning\u2019 that appears to underpin many of the shortcomings of deep neural networks identified in recent years.<\/p>\n<p>\u201cI decided to start working on this project during a science-related travel in the U.S., together with Claudio Michaelis, a dear colleague and friend of mine,\u201d Robert Geirhos, one of the researchers who carried out the study, told TechXplore. \u201cWe first attended a deep learning conference, then visited an animal research laboratory, and finally, a human vision conference. Somewhat surprisingly, we noticed the very same pattern in very different settings: \u2018shortcut learning,\u2019 or \u2018cheating,\u2019 appeared to be a common characteristic across both artificial and biological intelligence.\u201d<\/p>\n<p>Geirhos and Michaelis believed that shortcut learning, the phenomenon they observed, could explain the discrepancy between the excellent performance and iconic failures of many deep neural networks. To investigate this idea further, they teamed up with other colleagues, including J\u00f6rn-Henrik Jacobsen, Richard Zemel, Wieland Brendel, Matthias Bethge and Felix Wichmann.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Over the past few years, artificial intelligence (AI) tools, particularly deep neural networks, have achieved remarkable results on a number of tasks. However, recent studies have found that these computational techniques have a number of limitations. In a recent paper published in Nature Machine Intelligence, researchers at T\u00fcbingen and Toronto universities explored and discussed a [\u2026]<\/p>\n","protected":false},"author":427,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,6],"tags":[],"class_list":["post-117762","post","type-post","status-publish","format-standard","hentry","category-biological","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/117762","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/427"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=117762"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/117762\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=117762"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=117762"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=117762"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}