|
Liu, B., Asseng, S., Müller, C., Ewert, F., Elliott, J., Lobell, D. B., et al. (2016). Similar estimates of temperature impacts on global wheat yield by three independent methods. Nat. Clim. Change, 6(12), 1130–1136.
|
|
Acharya, T., Fanzo, J., Gustafson, D., Ingram, J., Schneeman, B., Allen, L., et al. (2014). Assessing Sustainable Nutrition Security: The Role of Food Systems: Working Paper. Washington, D.C., U.S.A.
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Overview paper on comprehensive framework for assessment of error and uncertainty in crop model predictions (Vol. 8).
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. Several ways of quantifying prediction uncertainty have been explored in the literature, but there have been no studies of how the different approaches are related to one another, and how they are related to some overall measure of prediction uncertainty. Here we show that all the different approaches can be related to two different viewpoints about the model; either the model is treated as a fixed predictor with some average error, or the model can be treated as a random variable with uncertainty in one or more of model structure, model inputs and model parameters. We discuss the differences, and show how mean squared error of prediction can be estimated in both cases. The results can be used to put uncertainty estimates into a more general framework and to relate different uncertainty estimates to one another and to overall prediction uncertainty. This should lead to a better understanding of crop model prediction uncertainty and the underlying causes of that uncertainty. This study was published as (Wallach et al. 2016)
|
Boote, K. J., Porter, C., Jones, J. W., Thorburn, P. J., Kersebaum, K. C., Hoogenboom, G., et al. (2016). Sentinel site data for crop model improvement—definition and characterization. In J. L. Hatfield, & D. Fleisher (Eds.), Improving Modeling Tools to Assess Climate Change Effects on Crop Response. Advances in Agricultural Systems Modeling, 7.
Abstract: Crop models are increasingly being used to assess the impacts of future climate change on production and food security. High quality, site-specific data on weather, soils, management, and cultivar are needed for those model applications. Also important is that model development, evaluation, improvement, and calibration require additional high quality, site-specific measurements on crop yield, growth, phenology, and ancillary traits. We review the evolution of minimum data set requirements for agroecosystem modeling and then describe the characteristics and ranking of sentinel site data needed for crop model improvement, calibration, and application. We in the Agricultural Model Intercomparison and Improvement Project (AgMIP), propose to rank sentinel site data sets as platinum, gold, silver, and copper, based on the degree of true site-specific measurement of weather, soils, management, crop yield, as well as the quality, comprehensiveness, quantity, accuracy, and value. For example, to be ranked platinum, the weather and soil characterization must be measured on-site, and all management inputs must be known. Dataset ranking will be lower for weather measured off-site or soil traits estimated from soil mapping. Ranking also depends on the intended purposes for data use. If the purpose is to improve a crop model for response to water or N, then additional observations are necessary, such as initial soil water, initial soil inorganic N, and plant N uptake during the growing season to be ranked platinum. Rankings are enhanced by presence of multiple treatments and sites. Examples of platinum-, gold-, and silver-quality data sets for model improvement and calibration uses are illustrated.
|
