The more crops there are, that means that there's gonna be more resources. Which will mean that more people will be able to live in a town, because if there are less resources and less crops then more people will starve and die out way before they can reproduce. If they cant keep reproducing and be able to feed their children, then the town will become smaller and smaller until its completely vanished.
