Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: Two independently developed simulation models – the grassland-specific PaSim and the biome-generic Biome-BGC MuSo (BBGC MuSo) – linking climate, soil, vegetation and management to ecosystem biogeochemical cycles were compared in a simulation of carbon (C) and water fluxes. The results were assessed against eddy-covariance flux data from five observational grassland sites representing a range of conditions in Europe: Grillenburg in Germany, Laqueuille in France with both extensive and intensive management, Monte Bondone in Italy and Oensingen in Switzerland. Model comparison (after calibration) gave substantial agreement, the performances being marginal to acceptable for weekly-aggregated gross primary production and ecosystem respiration (R-2 similar to 0.66 – 0.91), weekly evapotranspiration (R-2 similar to 0.78 – 0.94), soil water content in the topsoil (R-2 similar to 0.1 -0.7) and soil temperature (R-2 similar to 0.88 – 0.96). The bias was limited to the range -13 to 9 g C m(-2) week(-1) for C fluxes (-11 to 8 g C m(-2) week(-1) in case of BBGC MuSo, and -13 to 9 g C m(-2) week(-1) in case of PaSim) and -4 to 6 mm week for water fluxes (with BBGC MuSo providing somewhat higher estimates than PaSim), but some higher relative root mean square errors indicate low accuracy for prediction, especially for net ecosystem exchange The sensitivity of simulated outputs to changes in atmospheric carbon dioxide concentration ([CO2]), temperature and precipitation indicate, with certain agreement between the two models, that C outcomes are dominated by [CO2] and temperature gradients, and are less due to precipitation. ET rates decrease with increasing [CO2] in PaSim (consistent with experimental knowledge), while lack of appropriate stomatal response could be a limit in BBGC MuSo responsiveness. Results of the study indicate that some of the errors might be related to the improper representation of soil water content and soil temperature. Improvement is needed in the model representations of soil processes (especially soil water balance) that strongly influence the biogeochemical cycles of managed and unmanaged grasslands. (C) 2015 Elsevier B.V. All rights reserved.