Reusing stadiums every 3-4 olympics wouldn't be super helpful. That is 12-16 years between hosting again. You'd realistically only get 2 games out of your locations before you'd be rebuilding it. Which admittedly is 2x as many times as you get out of most games, but its not a particularly big drop in the bucket in the grand scheme.