Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: Efforts to limit global warming to below 2 degrees C in relation to the pre-industrial level are under way, in accordance with the 2015 Paris Agreement. However, most impact research on agriculture to date has focused on impacts of warming >2 degrees C on mean crop yields, and many previous studies did not focus sufficiently on extreme events and yield interannual variability. Here, with the latest climate scenarios from the Half a degree Additional warming, Prognosis and Projected Impacts (HAPPI) project, we evaluated the impacts of the 2015 Paris Agreement range of global warming (1.5 and 2.0 degrees C warming above the pre-industrial period) on global wheat production and local yield variability. A multi-crop and multi-climate model ensemble over a global network of sites developed by the Agricultural Model Intercomparison and Improvement Project (AgMIP) for Wheat was used to represent major rainfed and irrigated wheat cropping systems. Results show that projected global wheat production will change by -2.3% to 7.0% under the 1.5 degrees C scenario and -2.4% to 10.5% under the 2.0 degrees C scenario, compared to a baseline of 1980-2010, when considering changes in local temperature, rainfall, and global atmospheric CO2 concentration, but no changes in management or wheat cultivars. The projected impact on wheat production varies spatially; a larger increase is projected for temperate high rainfall regions than for moderate hot low rainfall and irrigated regions. Grain yields in warmer regions are more likely to be reduced than in cooler regions. Despite mostly positive impacts on global average grain yields, the frequency of extremely low yields (bottom 5 percentile of baseline distribution) and yield inter-annual variability will increase under both warming scenarios for some of the hot growing locations, including locations from the second largest global wheat producer-India, which supplies more than 14% of global wheat. The projected global impact of warming <2 degrees C on wheat production is therefore not evenly distributed and will affect regional food security across the globe as well as food prices and trade.