Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: Models used for climate change impact projections are typically not tested for simulation beyond current climate conditions. Since we have no data truly reflecting future conditions, a key challenge in this respect is to rigorously test models using proxies of future conditions. This paper presents a validation framework and guiding principles applicable across earth science disciplines for testing the capability of models to project future climate change and its impacts. Model test schemes comprising split-sample tests, differential split-sample tests and proxy site tests are discussed in relation to their application for projections by use of single models, ensemble modelling and space-time-substitution and in relation to use of different data from historical time series, paleo data and controlled experiments. We recommend that differential-split sample tests should be performed with best available proxy data in order to build further confidence in model projections.

Abstract: The accurate estimation of crop grain nitrogen (N; N in grain yield) is crucial for optimizing agricultural N management, especially in crop rotations. In the present study, 12 process-based models were applied to simulate the grain N of i) seven crops in rotations, ii) across various pedo-climatic and agro-management conditions in Europe, under both continuous simulation and single year simulation, and for iv) two calibration levels, namely minimal and detailed calibration. Generally, the results showed that the accuracy of the simulations in predicting grain N increased under detailed calibration. The models performed better in predicting the grain N of winter wheat (Triticum aestivum L.), winter barley (Hordewn vulgare L.) and spring barley (Hordeum vulgare L.) compared to spring oat (Avena saliva L.), winter rye (Secale cereale L.), pea (Piswn sativum L.) and winter oilseed rape (Brassica napus L.). These differences are linked to the intensity of parameterization with better parameterized crops showing lower prediction errors. The model performance was influenced by N fertilization and irrigation treatments, and a majority of the predictions were more accurate under low N and rainfed treatments. Moreover, the multi-model mean provided better predictions of grain N compared to any individual model. In regard to the Individual models, DAISY, FASSET, HERMES, MONICA and STICS are suitable for predicting grain N of the main crops in typical European crop rotations, which all performed well in both continuous simulation and single year simulation. Our results show that both the model initialization and the cover crop effects in crop rotations should be considered in order to achieve good performance of continuous simulation. Furthermore, the choice of either continuous simulation or single year simulation should be guided by the simulation objectives (e.g. grain yield, grain N content or N dynamics), the crop sequence (inclusion of legumes) and treatments (rate and type of N fertilizer) included in crop rotations and the model formalism.