Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

Abstract: ► We compared nine crop simulation models for spring barley at seven sites in Europe. ► Applying crop models with restricted calibration leads to high uncertainties. ► Multi-crop model mean yield estimates were in good agreement with observations. ► The degree of uncertainty for simulated grain yield of barley was similar to winter wheat. ► We need more suitable data enabling us to verify different processes in the models. In this study, the performance of nine widely used and accessible crop growth simulation models (APES-ACE, CROPSYST, DAISY, DSSAT-CERES, FASSET, HERMES, MONICA, STICS and WOFOST) was compared during 44 growing seasons of spring barley (Hordeum vulgare L) at seven sites in Northern and Central Europe. The aims of this model comparison were to examine how different process-based crop models perform at multiple sites across Europe when applied with minimal information for model calibration of spring barley at field scale, whether individual models perform better than the multi-model mean, and what the uncertainty ranges are in simulated grain yields. The reasons for differences among the models and how results for barley compare to winter wheat are discussed. Regarding yield estimation, best performing based on the root mean square error (RMSE) were models HERMES, MONICA and WOFOST with lowest values of 1124, 1282 and 1325 (kg ha(-1)), respectively. Applying the index of agreement (IA), models WOFOST, DAISY and HERMES scored best having highest values (0.632, 0.631 and 0.585, respectively). Most models systematically underestimated yields, whereby CROPSYST showed the highest deviation as indicated by the mean bias error (MBE) (-1159 kg ha(-1)). While the wide range of simulated yields across all sites and years shows the high uncertainties in model estimates with only restricted calibration, mean predictions from the nine models agreed well with observations. Results of this paper also show that models that were more accurate in predicting phenology were not necessarily the ones better estimating grain yields. Total above-ground biomass estimates often did not follow the patterns of grain yield estimates and, thus, harvest indices were also different. Estimates of soil moisture dynamics varied greatly. In comparison, even though the growing cycle for winter wheat is several months longer than for spring barley, using RMSE and IA as indicators, models performed slightly, but not significantly, better in predicting wheat yields. Errors in reproducing crop phenology were similar, which in conjunction with the shorter growth cycle of barley has higher effects on accuracy in yield prediction.

Abstract: Rice models have been widely used in simulating and predicting rice phenology in contrasting climate zones, however the uncertainties from model structure (different equations or models) and/or model parameters were rarely investigated. Here, five rice phenological models/modules (Le., CERES-Rice, ORYZA2000, RCM, Beta Model and SIMRIW) were applied to simulate rice phenology at 23 experimental stations from 1992 to 2009 in two major rice cultivation regions of China: the northeastern China and the southwestern China. To investigate the uncertainties from model biophysical parameters, each model was run with randomly perturbed 50 sets of parameters. The results showed that the median of ensemble simulations were better than the simulation by most models. Models couldn’t simulate well in some specific years despite of parameters optimization, suggesting model structure limit model performance in some cases. The models adopting accumulative thermal time function (e.g., CERES-Rice and ORYZA2000) had better performance in the southwestern China, in contrast, those adopting exponential function (e.g., Beta model and RCM model) had better performance in the northeastern China. In northeastern China, the contribution of model structure and model parameters to model total variance was, respectively, about 55.90% and 44.10% in simulating heading date, and about 75.43% and 24.57% in simulating maturity date. In the southwestern China, the contribution of model structure and model parameters to model total variance was, respectively, about 79.97% and 27.03% in simulating heading date, about 92.15% and 7.85% in simulating maturity date. Uncertainty from model structure was the most relevant source. The results highlight that the temperature response functions of rice development rate under extreme climate conditions should be improved based on environment-controlled experimental data.