By apparently overtraining them, researchers have seen neural networks discover novel solutions to problems.