Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: Understanding the relationship between climate and crop productivity is a key component of projections of future food production, and hence assessments of food security. Climate models and crop yield datasets have errors, but the effects of these errors on regional scale crop models is not well categorized and understood. In this study we compare the effect of synthetic errors in temperature and precipitation observations on the hindcast skill of a process-based crop model and a statistical crop model. We find that errors in temperature data have a significantly stronger influence on both models than errors in precipitation. We also identify key differences in the responses of these models to different types of input data error. Statistical and process-based model responses differ depending on whether synthetic errors are overestimates or underestimates. We also investigate the impact of crop yield calibration data on model skill for both models, using datasets of yield at three different spatial scales. Whilst important for both models, the statistical model is more strongly influenced by crop yield scale than the process-based crop model. However, our results question the value of high resolution yield data for improving the skill of crop models; we find a focus on accuracy to be more likely to be valuable. For both crop models, and for all three spatial scales of yield calibration data, we found that model skill is greatest where growing area is above 10-15 %. Thus information on area harvested would appear to be a priority for data collection efforts. These results are important for three reasons. First, understanding how different crop models rely on different characteristics of temperature, precipitation and crop yield data allows us to match the model type to the available data. Second, we can prioritize where improvements in climate and crop yield data should be directed. Third, as better climate and crop yield data becomes available, we can predict how crop model skill should improve.

Abstract: Modelling N transformations within cropping systems is crucial for N management optimization in order to increase N use efficiency and reduce N losses. Such modelling remains challenging because of the complexity of N cycling in soil–plant systems. In the current study, the uncertainties of six widely used process-based models (PBMs), including APSIM, CROPSYST, DAISY, FASSET, HERMES and STICS, were tested in simulating different N managements (catch crops (CC) and different N fertilizer rates) in 12-year rotations in Western Europe. Winter wheat, sugar beet and pea were the main crops, and radish was the main CC in the tested systems. Our results showed that PBMs simulated yield, aboveground biomass, N export and N uptake well with low RMSE values, except for sugar beet, which was generally less well parameterized. Moreover, PBMs provided more accurate crop simulations (i.e. N export and N uptake) compared to simulations of soil (N mineralization and soil mineral N (SMN)) and environmental variables (N leaching). The use of multi-model ensemble mean or median of four PBMs significantly reduced the mean absolute percentage error (MAPE) between simulations and observations to less than 15% for yield, aboveground biomass, N export and N uptake. Multi-model ensemble also significantly reduced the MAPE for net N mineralization and annual N leaching to around 15%, while it was larger than 20% for SMN. Generally, PBMs well simulated the CC effects on N fluxes, i.e. increasing N mineralization and reducing N leaching in both short-term and long-term, and all PBMs correctly predicted the effects of the reduced N rate on all measured variables in the study. The uncertainties of multi-model ensemble for N mineralization, SMN and N leaching were larger, mainly because these variables are influenced by plant-soil interactions and subject to cumulative long-term effects in crop rotations, which makes them more difficult to simulate. Large differences existed between individual PBMs due to the differences in formalisms for describing N processes in soil–plant systems, the skills of modelers and the model calibration level. In addition, the model performance also depended on the simulated variables, for instance, HERMES and FASSET performed better for yield and crop biomass, APSIM, DAISY and STICS performed better for N export and N uptake, STICS provided best simulation for SMN and N leaching among the six individual PBMs in the study, but all PBMs met difficulties to well predict either average or variance of soil N mineralization. Our results showed that better calibration for soil N variables is needed to improve model predictions of N cycling in order to optimize N management in crop rotations.