A new study uses deep linear networks to prove that language undergoes iterated learning to become structured and learnable.