Winter is cold and very hard on most villagers: if the harvest season was not good then difficult times come once the snow starts falling down from the sky.
What other choice is there, then, for those who are less fortunate? Consecutive years of bad crops sometimes push those people to seek better lands. Maybe lands were the Gods of the Multiverse have not abandoned their people.