{"id":36087,"date":"2017-04-13T12:23:12","date_gmt":"2017-04-13T19:23:12","guid":{"rendered":"http:\/\/lifeboat.com\/blog\/2017\/04\/ai-picks-up-racial-and-gender-biases-when-learning-from-what-humans-write"},"modified":"2017-06-04T07:05:03","modified_gmt":"2017-06-04T14:05:03","slug":"ai-picks-up-racial-and-gender-biases-when-learning-from-what-humans-write","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2017\/04\/ai-picks-up-racial-and-gender-biases-when-learning-from-what-humans-write","title":{"rendered":"AI picks up racial and gender biases when learning from what humans write"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/ai-picks-up-racial-and-gender-biases-when-learning-from-what-humans-write.jpg\"><\/a><\/p>\n<p>Artificial intelligence picks up racial and gender biases when learning language from text, researchers say. Without any supervision, a machine learning algorithm learns to associate female names more with family words than career words, and black names as being more unpleasant than white names.<\/p>\n<p>For a study <a href=\"http:\/\/science.sciencemag.org\/cgi\/doi\/10.1126\/science.aal4230\">published today in <em>Science<\/em><\/a>, researchers tested the bias of a common AI model, and then matched the results against a well-known psychological test that measures bias in humans. The team replicated in the algorithm all the psychological biases they tested, according to study co-author <a href=\"https:\/\/www.princeton.edu\/~aylinc\/\">Aylin Caliskan<\/a>, a post-doc at Princeton University. Because machine learning algorithms are so common, influencing everything from translation to scanning names on resumes, this research shows that the biases are pervasive, too.<\/p>\n<p>\u201cLanguage is a bridge to ideas, and a lot of algorithms are built on language in the real world,\u201d says <a href=\"https:\/\/www.newamerica.org\/our-people\/megan-e-garcia\/\">Megan Garcia<\/a>, the director of New America\u2019s California branch who has written about this so-called <a href=\"http:\/\/wpj.dukejournals.org\/content\/33\/4\/111.full\">algorithmic bias<\/a>. \u201cSo unless an alg is making a decision based only on numbers, this finding is going to be important.\u201d<\/p>\n<p><!-- Link: <a href=\"https:\/\/www.theverge.com\/2017\/4\/13\/15287678\/machine-learning-language-processing-artificial-intelligence-race-gender-bias\">https:\/\/www.theverge.com\/2017\/4\/13\/15287678\/machine-learning...ender-bias<\/a> --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Artificial intelligence picks up racial and gender biases when learning language from text, researchers say. Without any supervision, a machine learning algorithm learns to associate female names more with family words than career words, and black names as being more unpleasant than white names. For a study published today in Science, researchers tested the bias [\u2026]<\/p>\n","protected":false},"author":368,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,6],"tags":[],"class_list":["post-36087","post","type-post","status-publish","format-standard","hentry","category-information-science","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/36087","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/368"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=36087"}],"version-history":[{"count":2,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/36087\/revisions"}],"predecessor-version":[{"id":58087,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/36087\/revisions\/58087"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=36087"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=36087"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=36087"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}