Climate change mitigation via a reduction in the anthropogenic emissions of carbon dioxide (CO2) is the principle requirement for reducing global warming, its impacts, and the degree of adaptation required. We present a simple conceptual model of anthropogenic CO2 emissions to highlight the trade off between delay in commencing mitigation, and the strength of mitigation then required to meet specific atmospheric CO2 stabilization targets. We calculate the effects of alternative emission profiles on atmospheric CO2 and global temperature change over a millennial timescale using a simple coupled carbon cycle-climate model. For example, if it takes 50 years to transform the energy sector and the maximum rate at which emissions can be reduced is -2.5% year-1, delaying action until 2020 would lead to stabilization at 540 ppm. A further 20 year delay would result in a stabilization level of 730 ppm, and a delay until 2060 would mean stabilising at over 1,000 ppm. If stabilization targets are met through delayed action, combined with strong rates of mitigation, the emissions profiles result in transient peaks of atmospheric CO2 (and potentially temperature) that exceed the stabilization targets. Stabilization at 450 ppm requires maximum mitigation rates of -3% to -5% year-1, and when delay exceeds 2020, transient peaks in excess of 550 ppm occur. Consequently tipping points for certain Earth system components may be transgressed. Avoiding dangerous climate change is more easily achievable if global mitigation action commences as soon as possible. Starting mitigation earlier is also more effective than acting more aggressively once mitigation has begun.