Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: Understanding the relationship between climate and crop productivity is a key component of projections of future food production, and hence assessments of food security. Climate models and crop yield datasets have errors, but the effects of these errors on regional scale crop models is not well categorized and understood. In this study we compare the effect of synthetic errors in temperature and precipitation observations on the hindcast skill of a process-based crop model and a statistical crop model. We find that errors in temperature data have a significantly stronger influence on both models than errors in precipitation. We also identify key differences in the responses of these models to different types of input data error. Statistical and process-based model responses differ depending on whether synthetic errors are overestimates or underestimates. We also investigate the impact of crop yield calibration data on model skill for both models, using datasets of yield at three different spatial scales. Whilst important for both models, the statistical model is more strongly influenced by crop yield scale than the process-based crop model. However, our results question the value of high resolution yield data for improving the skill of crop models; we find a focus on accuracy to be more likely to be valuable. For both crop models, and for all three spatial scales of yield calibration data, we found that model skill is greatest where growing area is above 10-15 %. Thus information on area harvested would appear to be a priority for data collection efforts. These results are important for three reasons. First, understanding how different crop models rely on different characteristics of temperature, precipitation and crop yield data allows us to match the model type to the available data. Second, we can prioritize where improvements in climate and crop yield data should be directed. Third, as better climate and crop yield data becomes available, we can predict how crop model skill should improve.