{"id":157852,"date":"2023-02-12T20:24:07","date_gmt":"2023-02-13T02:24:07","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/02\/we-found-an-neuron-in-gpt-2"},"modified":"2023-02-12T20:24:07","modified_gmt":"2023-02-13T02:24:07","slug":"we-found-an-neuron-in-gpt-2","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/02\/we-found-an-neuron-in-gpt-2","title":{"rendered":"We Found An Neuron in GPT-2"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/we-found-an-neuron-in-gpt-23.jpg\"><\/a><\/p>\n<p>I notice that the token in question happens to be segmented as \u201c_an\u201d and \u201c_a\u201d and not \u201c_an_\u201d or \u201c_a_\u201d.<\/p>\n<p>So continuations like [_a, moral,_fruit] or [_an, tagonist, ic,_monster, s] could be possible (assuming those are all legal tokens).<\/p>\n<p>I am reminded of the wonderful little nuggest in linguistics, where people are supposed to have said something like \u201ca narange\u201d (because that kind of fruit came from the spanish province of \u201cnaranja\u201d). The details on these claims are often not well documented.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I notice that the token in question happens to be segmented as \u201c_an\u201d and \u201c_a\u201d and not \u201c_an_\u201d or \u201c_a_\u201d. So continuations like [_a, moral,_fruit] or [_an, tagonist, ic,_monster, s] could be possible (assuming those are all legal tokens). I am reminded of the wonderful little nuggest in linguistics, where people are supposed to have [\u2026]<\/p>\n","protected":false},"author":599,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30,1496,47],"tags":[],"class_list":["post-157852","post","type-post","status-publish","format-standard","hentry","category-ethics","category-law","category-neuroscience"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/157852","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/599"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=157852"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/157852\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=157852"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=157852"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=157852"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}