A rigorous inter-comparison of ground-level ozone predictions

Uwe Schlink, Stephen R. Dorling, Emil Pelikan, Giuseppe Nunnari, Gavin Cawley, Heikki Junninen, Alison J. Greig, Rob Foxall, Krystof Eben, Tim Chatterton, Jiri Vondracek, Matthias Richter, Michal Dostal, Libero Bertucco, Mikko Kolehmainen, Martin Doyle

Research output: Contribution to journalArticlepeer-review

133 Citations (Scopus)


Novel statistical approaches to prediction have recently been shown to perform well in several scientific fields but have not, until now, been comprehensively evaluated for predicting air pollution. In this paper we report on a model inter-comparison exercise in which 15 different statistical techniques for ozone forecasting were applied to ten data sets representing different meteorological and emission conditions throughout Europe. We also attempt to compare the performance of the statistical techniques with a deterministic chemical trajectory model. Likewise, our exercise includes comparisons of sites, performance indices, forecasting horizons, etc. The comparative evaluation of forecasting performance (benchmarking) produced 1340 yearly time series of daily predictions and the results are described in terms of predefined performance indices. Through analysing associations between the performance indices, we found that the success index is of outstanding significance. For models that are excellent in predicting threshold exceedances and have a high success index, we also observe high performance in the overall goodness of fit. The 8-h average ozone concentration forecast accuracy was found to be superior to the 1-h mean ozone concentration forecast, which makes the former very significant for operational forecasting. The best forecasts were achieved for sites located in rural and suburban areas in Central Europe unaffected by extreme emissions (e.g. from industries). Our results demonstrate that a particular technique is often excellent in some respects but poor in others. For most situations, we recommend neural network and generalised additive models as the best compromise, as these can handle nonlinear associations and can be easily adapted to site specific conditions. In contrast, nonlinear modelling of the dynamical development of univariate ozone time-series was not profitable.
Original languageEnglish
Pages (from-to)3237-3253
Number of pages17
JournalAtmospheric Environment
Issue number23
Publication statusPublished - 2003

Cite this