When children develop into adults, how they learn changes a lot. While children show a lot of random behaviour, adults perform more goal-directed actions. An influential theory describes these changes as being similar to the behaviour of an optimisation algorithm commonly used in machine learning. This empirical test shows that there are striking similarities but also important differences between human development and machine learning algorithms.