For more than 150 years, doctors and scientists have mapped the functions of various brain regions by studying people with brain injuries and determining how those injuries contributed to specific behavioral deficits. Now, a team of researchers that specializes in poststroke language and speech difficulties reports that the same framework can be applied to the study of large language models (LLMs).
The research, published in Patterns, shows that inducing “injury” in these models and then administering tests given to patients with brain injury provides insight into how these models use language and could help patients with communication challenges in the future.
“LLMs are being deployed in situations where failure has consequences, but we have very little ability to say why a given system fails the way it does,” says corresponding author Julius Fridriksson of the University of South Carolina. “It turns out that methods used in clinical neurology can be applied to understanding artificial intelligence. This is the first paper to use these methods in this way.”
