Artificial intelligence chatbots need to work on their social judgment, recent events suggest. At one end of the spectrum, they’re facing lawsuits for recommending dangerous actions. At the other end, the models can be so nice they’re considered sycophantic.

The problem could get worse as AI bots work more with humans, such as handling customer complaints, says Yan Leng, assistant professor of information, risk, and operations management at the McCombs School of Business at The University of Texas at Austin.

But help may be on the way. In new research, Leng has devised a sort of personality test—more precisely, a behavioral audit —for large language models (LLMs), the technology that drives products such as ChatGPT. The paper is published in the journal Information Systems Research.