There is substantial variation across people in navigation ability, which is shaped by multiple factors. In this Review, Yavuz and Spiers organize these factors into lifetime, lifestyle and personal attributes, and discuss the cognitive and neural mechanisms of their influences on navigation.