On the rise and fall of Earth's strong clear-sky hemispheric albedo asymmetry