Counter-intuitive population crisis

Population increases when famine hits or when hard times occur.Population stabilizes to 2 or even drops below that even when there is proper education well-being and life expectancy compared to above mentioned. Why is this Counter-intuitive?