Dopaminergic action prediction error signals are used by mice as a value-free teaching signal to reinforce stable sound–action associations in the tail of the striatum.