Abstract: ► We compared nine crop simulation models for spring barley at seven sites in Europe. ► Applying crop models with restricted calibration leads to high uncertainties. ► Multi-crop model mean yield estimates were in good agreement with observations. ► The degree of uncertainty for simulated grain yield of barley was similar to winter wheat. ► We need more suitable data enabling us to verify different processes in the models. In this study, the performance of nine widely used and accessible crop growth simulation models (APES-ACE, CROPSYST, DAISY, DSSAT-CERES, FASSET, HERMES, MONICA, STICS and WOFOST) was compared during 44 growing seasons of spring barley (Hordeum vulgare L) at seven sites in Northern and Central Europe. The aims of this model comparison were to examine how different process-based crop models perform at multiple sites across Europe when applied with minimal information for model calibration of spring barley at field scale, whether individual models perform better than the multi-model mean, and what the uncertainty ranges are in simulated grain yields. The reasons for differences among the models and how results for barley compare to winter wheat are discussed. Regarding yield estimation, best performing based on the root mean square error (RMSE) were models HERMES, MONICA and WOFOST with lowest values of 1124, 1282 and 1325 (kg ha(-1)), respectively. Applying the index of agreement (IA), models WOFOST, DAISY and HERMES scored best having highest values (0.632, 0.631 and 0.585, respectively). Most models systematically underestimated yields, whereby CROPSYST showed the highest deviation as indicated by the mean bias error (MBE) (-1159 kg ha(-1)). While the wide range of simulated yields across all sites and years shows the high uncertainties in model estimates with only restricted calibration, mean predictions from the nine models agreed well with observations. Results of this paper also show that models that were more accurate in predicting phenology were not necessarily the ones better estimating grain yields. Total above-ground biomass estimates often did not follow the patterns of grain yield estimates and, thus, harvest indices were also different. Estimates of soil moisture dynamics varied greatly. In comparison, even though the growing cycle for winter wheat is several months longer than for spring barley, using RMSE and IA as indicators, models performed slightly, but not significantly, better in predicting wheat yields. Errors in reproducing crop phenology were similar, which in conjunction with the shorter growth cycle of barley has higher effects on accuracy in yield prediction.

Abstract: • Systematic analysis of the influence of spatial soil data resolution on simulated regional yields and total growing season evapotranspiration. • The responses of four crop models of different complexity are compared. • Differences between models are larger than the effect of the chosen spatial soil data resolution. • Low influence of soil data resolution due to: high precipitation amount, methods for calculating water retention and method of data aggregation. The spatial variability of soil properties is an important driver of yield variability at both field and regional scale. Thus, when using crop growth simulation models, the choice of spatial resolution of soil input data might be key in order to accurately reproduce observed yield variability. In this study we used four crop models (SIMPLACE<LINTUL-SLIM>, DSSAT-CSM, EPIC and DAISY) differing in the detail of modeling above-ground biomass and yield as well as of modeling soil water dynamics, water uptake and drought effects on plants to simulate winter wheat in two (agro-climatologically and geo-morphologically) contrasting regions of the federal state of North-Rhine-Westphalia (Germany) for the period from 1995 to 2008. Three spatial resolutions of soil input data were taken into consideration, corresponding to the following map scales: 1:50 000, 1:300 000 and 1:1 000 000. The four crop models were run for water-limited production conditions and model results were evaluated in the form of frequency distributions, depicted by bean-plots. In both regions, soil data aggregation had very small influence on the shape and range of frequency distributions of simulated yield and simulated total growing season evapotranspiration for all models. Further analysis revealed that the small influence of spatial resolution of soil input data might be related to: (a) the high precipitation amount in the region which partly masked differences in soil characteristics for water holding capacity, (b) the loss of variability in hydraulic soil properties due to the methods applied to calculate water retention properties of the used soil profiles, and (c) the method of soil data aggregation. No characteristic “fingerprint” between sites, years and resolutions could be found for any of the models. Our results support earlier recommendation to evaluate model results on the basis of frequency distributions since these offer quick and better insight into the distribution of simulation results as compared to summary statistics only. Finally, our results support conclusions from other studies about the usefulness of considering a multi-model approach to quantify the uncertainty in simulated yields introduced by the crop growth simulation approach when exploring the effects of scaling for regional yield impact assessments.

Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.