Abstract: Croplands and grasslands are agricultural systems that contribute to land–atmosphere exchanges of carbon (C). We evaluated and compared gross primary production (GPP), ecosystem respiration (RECO), net ecosystem exchange (NEE) of CO2, and two derived outputs – C use efficiency (CUE=-NEE/GPP) and C emission intensity (IntC= -NEE/Offtake [grazed or harvested biomass]). The outputs came from 23 models (11 crop-specific, eight grassland-specific, and four models covering both systems) at three cropping sites over several rotations with spring and winter cereals, soybean and rapeseed in Canada, France and India, and two temperate permanent grasslands in France and the United Kingdom. The models were run independently over multi-year simulation periods in five stages (S), either blind with no calibration and initialization data (S1), using historical management and climate for initialization (S2), calibrated against plant data (S3), plant and soil data together (S4), or with the addition of C and N fluxes (S5). Here, we provide a framework to address methodological uncertainties and contextualize results. Most of the models overestimated or underestimated the C fluxes observed during the growing seasons (or the whole years for grasslands), with substantial differences between models. For each simulated variable, changes in the multi-model median (MMM) from S1 to S5 was used as a descriptor of the ensemble performance. Overall, the greatest improvements (MMM approaching the mean of observations) were achieved at S3 or higher calibration stages. For instance, grassland GPP MMM was equal to 1632 g C m−2 yr-1 (S5) while the observed mean was equal to 1763 m-2 yr-1 (average for two sites). Nash-Sutcliffe modelling efficiency coefficients indicated that MMM outperformed individual models in 92.3 % of cases. Our study suggests a cautious use of large-scale, multi-model ensembles to estimate C fluxes in agricultural sites if some site-specific plant and soil observations are available for model calibration. The further development of crop/grassland ensemble modelling will hinge upon the interpretation of results in light of the way models represent the processes underlying C fluxes in complex agricultural systems (grassland and crop rotations including fallow periods).

Abstract: To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT world-wide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures >24 °C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.

Abstract: ► We compared nine crop simulation models for spring barley at seven sites in Europe. ► Applying crop models with restricted calibration leads to high uncertainties. ► Multi-crop model mean yield estimates were in good agreement with observations. ► The degree of uncertainty for simulated grain yield of barley was similar to winter wheat. ► We need more suitable data enabling us to verify different processes in the models. In this study, the performance of nine widely used and accessible crop growth simulation models (APES-ACE, CROPSYST, DAISY, DSSAT-CERES, FASSET, HERMES, MONICA, STICS and WOFOST) was compared during 44 growing seasons of spring barley (Hordeum vulgare L) at seven sites in Northern and Central Europe. The aims of this model comparison were to examine how different process-based crop models perform at multiple sites across Europe when applied with minimal information for model calibration of spring barley at field scale, whether individual models perform better than the multi-model mean, and what the uncertainty ranges are in simulated grain yields. The reasons for differences among the models and how results for barley compare to winter wheat are discussed. Regarding yield estimation, best performing based on the root mean square error (RMSE) were models HERMES, MONICA and WOFOST with lowest values of 1124, 1282 and 1325 (kg ha(-1)), respectively. Applying the index of agreement (IA), models WOFOST, DAISY and HERMES scored best having highest values (0.632, 0.631 and 0.585, respectively). Most models systematically underestimated yields, whereby CROPSYST showed the highest deviation as indicated by the mean bias error (MBE) (-1159 kg ha(-1)). While the wide range of simulated yields across all sites and years shows the high uncertainties in model estimates with only restricted calibration, mean predictions from the nine models agreed well with observations. Results of this paper also show that models that were more accurate in predicting phenology were not necessarily the ones better estimating grain yields. Total above-ground biomass estimates often did not follow the patterns of grain yield estimates and, thus, harvest indices were also different. Estimates of soil moisture dynamics varied greatly. In comparison, even though the growing cycle for winter wheat is several months longer than for spring barley, using RMSE and IA as indicators, models performed slightly, but not significantly, better in predicting wheat yields. Errors in reproducing crop phenology were similar, which in conjunction with the shorter growth cycle of barley has higher effects on accuracy in yield prediction.