Martre, P., Wallach, D., Asseng, S., Ewert, F., Jones, J. W., Rötter, R. P., et al. (2015). Multimodel ensembles of wheat growth: many models are better than one. Glob. Chang. Biol., 21(2), 911–925.
Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.
|
Webber, H., White, J. W., Kimball, B. A., Ewert, F., Asseng, S., Rezaei, E. E., et al. (2018). Physical robustness of canopy temperature models for crop heat stress simulation across environments and production conditions. Field Crops Research, 216, 75–88.
Abstract: Despite widespread application in studying climate change impacts, most crop models ignore complex interactions among air temperature, crop and soil water status, CO2 concentration and atmospheric conditions that influence crop canopy temperature. The current study extended previous studies by evaluating Tc simulations from nine crop models at six locations across environmental and production conditions. Each crop model implemented one of an empirical (EMP), an energy balance assuming neutral stability (EBN) or an energy balance correcting for atmospheric stability conditions (EBSC) approach to simulate Tc. Model performance in predicting Tc was evaluated for two experiments in continental North America with various water, nitrogen and CO2 treatments. An empirical model fit to one dataset had the best performance, followed by the EBSC models. Stability conditions explained much of the differences between modeling approaches. More accurate simulation of heat stress will likely require use of energy balance approaches that consider atmospheric stability conditions.
|
Asseng, S., Ewert, F., Rosenzweig, C., Jones, J. W., Hatfield, J. L., Ruane, A. C., et al. (2013). Uncertainty in simulating wheat yields under climate change. Nat. Clim. Change, 3(9), 827–832.
Abstract: Projections of climate change impacts on crop yields are inherently uncertain(1). Uncertainty is often quantified when projecting future greenhouse gas emissions and their influence on climate(2). However, multi-model uncertainty analysis of crop responses to climate change is rare because systematic and objective comparisons among process-based crop simulation models(1,3) are difficult(4). Here we present the largest standardized model intercomparison for climate change impacts so far. We found that individual crop models are able to simulate measured wheat grain yields accurately under a range of environments, particularly if the input information is sufficient. However, simulated climate change impacts vary across models owing to differences in model structures and parameter values. A greater proportion of the uncertainty in climate change impact projections was due to variations among crop models than to variations among downscaled general circulation models. Uncertainties in simulated impacts increased with CO2 concentrations and associated warming. These impact uncertainties can be reduced by improving temperature and CO2 relationships in models and better quantified through use of multi-model ensembles. Less uncertainty in describing how climate change may affect agricultural productivity will aid adaptation strategy development and policymaking.
|
Rosenzweig, C., Jones, J. W., Hatfield, J. L., Ruane, A. C., Boote, K. J., Thorburn, P., et al. (2013). The Agricultural Model Intercomparison and Improvement Project (AgMIP): Protocols and pilot studies. Agricultural and Forest Meteorology, 170, 166–182.
|
Boote, K. J., Porter, C., Jones, J. W., Thorburn, P. J., Kersebaum, K. C., Hoogenboom, G., et al. (2016). Sentinel site data for crop model improvement—definition and characterization. In J. L. Hatfield, & D. Fleisher (Eds.), Improving Modeling Tools to Assess Climate Change Effects on Crop Response. Advances in Agricultural Systems Modeling, 7.
Abstract: Crop models are increasingly being used to assess the impacts of future climate change on production and food security. High quality, site-specific data on weather, soils, management, and cultivar are needed for those model applications. Also important is that model development, evaluation, improvement, and calibration require additional high quality, site-specific measurements on crop yield, growth, phenology, and ancillary traits. We review the evolution of minimum data set requirements for agroecosystem modeling and then describe the characteristics and ranking of sentinel site data needed for crop model improvement, calibration, and application. We in the Agricultural Model Intercomparison and Improvement Project (AgMIP), propose to rank sentinel site data sets as platinum, gold, silver, and copper, based on the degree of true site-specific measurement of weather, soils, management, crop yield, as well as the quality, comprehensiveness, quantity, accuracy, and value. For example, to be ranked platinum, the weather and soil characterization must be measured on-site, and all management inputs must be known. Dataset ranking will be lower for weather measured off-site or soil traits estimated from soil mapping. Ranking also depends on the intended purposes for data use. If the purpose is to improve a crop model for response to water or N, then additional observations are necessary, such as initial soil water, initial soil inorganic N, and plant N uptake during the growing season to be ranked platinum. Rankings are enhanced by presence of multiple treatments and sites. Examples of platinum-, gold-, and silver-quality data sets for model improvement and calibration uses are illustrated.
|