Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

Abstract: Projections of climate change impacts on crop performances are inherently uncertain. However, multimodel uncertainty analysis of crop responses is rare because systematic and objective comparisons among process-based crop simulation models are difficult. Here we report on the Agricultural Model Intercomparison and Improvement Project ensemble of 30 wheat models tested using both crop and climate observed data in diverse environments, including infra-red heating field experiments, for their accuracy in simulating multiple crop growth, N economy and yield variables. The relative error averaged over models in reproducing observations was 24-38% for the different end-of-season variables. Clusters of wheat models organized by their correlations with temperature, precipitation, and solar radiation revealed common characteristics of climatic responses; however, models are rarely in the same cluster when comparing across sites. We also found that the amount of information used for calibration has only a minor effect on model ensemble climatic responses, but can be large for any single model. When simulating impacts assuming a mid-century A2 emissions scenario for climate projections from 16 downscaled general circulation models and 26 wheat models, a greater proportion of the uncertainty in climate change impact projections was due to variations among wheat models rather than to variations among climate models. Uncertainties in simulated impacts increased with atmospheric [CO2] and associated warming. Extrapolating the model ensemble temperature response (at current atmospheric [CO2]) indicated that warming is already reducing yields at a majority of wheat-growing locations. Finally, only a very weak relationship was found between the models’ sensitivities to interannual temperature variability and their response to long-term warming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs. In conclusion, uncertainties in prediction of climate change impacts on crop performance can be reduced by improving temperature and CO2 relationships in models and are better quantified through use of impact ensembles. No Label