Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

Abstract: Crop models are essential tools for assessing the threat of climate change to local and global food production1. Present models used to predict wheat grain yield are highly uncertain when simulating how crops respond to temperature2. Here we systematically tested 30 different wheat crop models of the Agricultural Model Intercomparison and Improvement Project against field experiments in which growing season mean temperatures ranged from 15 °C to 32 °C, including experiments with artificial heating. Many models simulated yields well, but were less accurate at higher temperatures. The model ensemble median was consistently more accurate in simulating the crop temperature response than any single model, regardless of the input information used. Extrapolating the model ensemble temperature response indicates that warming is already slowing yield gains at a majority of wheat-growing locations. Global wheat production is estimated to fall by 6% for each °C of further temperature increase and become more variable over space and time.

Abstract: We consider predictions of the impact of climate warming on rice development times in Sri Lanka. The major emphasis is on the uncertainty of the predictions, and in particular on the estimation of mean squared error of prediction. Three contributions to mean squared error are considered. The first is parameter uncertainty that results from model calibration. To take proper account of the complex data structure, generalized least squares is used to estimate the parameters and the variance-covariance matrix of the parameter estimators. The second contribution is model structure uncertainty, which we estimate using two different models. An ANOVA analysis is used to separate the contributions of parameter and model uncertainty to mean squared error. The third contribution is model error, which is estimated using hindcasts. Mean squared error of prediction of time from emergence to maturity, for baseline +2 °C, is estimated as 108 days2, with model error contributing 86 days2, followed by model structure uncertainty which contributes 15 days2 and parameter uncertainty which contributes 7 days2. We also show how prediction uncertainty is reduced if prediction concerns development time averaged over years, or the difference in development time between baseline and warmer temperatures.