Climate model simulations of past and future climate invariably contain prescribed zonal mean stratospheric ozone. While the effects of zonal asymmetry in ozone have been examined in the Northern Hemisphere, much greater zonal asymmetry occurs in the Southern Hemisphere during the break up of the Antarctic ozone hole. We prescribe a realistic three-dimensional distribution of ozone in a high vertical resolution atmospheric model and compare results with a simulation containing zonal mean ozone. Prescribing the three dimensional ozone distribution results in a cooling of the stratosphere and upper troposphere comparable to that caused by ozone depletion itself. Our results suggest that changes in the zonal asymmetry of ozone have had important impacts on Southern Hemisphere climate, and will continue to do so in the future.