Abstract: To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT world-wide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures >24 °C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.

Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

Abstract: Even brief periods of high temperatures occurring around flowering and during grain filling can severely reduce grain yield in cereals. Recently, ecophysiological and crop models have begun to represent such phenomena. Most models use air temperature (Tair) in their heat stress responses despite evidence that crop canopy temperature (Tc) better explains grain yield losses. Tc can deviate significantly from Tair based on climatic factors and the crop water status. The broad objective of this study was to evaluate whether simulation of Tc improves the ability of crop models to simulate heat stress impacts on wheat under irrigated conditions. Nine process-based models, each using one of three broad approaches (empirical, EMP; energy balance assuming neutral atmospheric stability, EBN; and energy balance correcting for the atmospheric stability conditions, EBSC) to simulate Tc, simulated grain yield under a range of temperature conditions. The models varied widely in their ability to reproduce the measured Tc with the commonly used EBN models performing much worse than either EMP or EBSC. Use of Tc to account for heat stress effects did improve simulations compared to using only Tair to a relatively minor extent, but the models that additionally use Tc on various other processes as well did not have better yield simulations. Models that simulated yield well under heat stress had varying skill in simulating Tc. For example, the EBN models had very poor simulations of Tc but performed very well in simulating grain yield. These results highlight the need to more systematically understand and model heat stress events in wheat.