Jun 272024 Finding GPT-4’s mistakes with GPT-4 …a new neural network based on GPT-4 finds errors in its work and fixes them. CriticGPT, a model based on GPT-4, writes critiques of ChatGPT responses to help human trainers spot mistakes during RLHF .