Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
Asseng, S., Ewert, F., Martre, P., Rötter, R. P., Lobell, D. B., Cammarano, D., et al. (2014). Rising temperatures reduce global wheat production. Nat. Clim. Change, 5(2), 143–147.
Abstract: Crop models are essential tools for assessing the threat of climate change to local and global food production1. Present models used to predict wheat grain yield are highly uncertain when simulating how crops respond to temperature2. Here we systematically tested 30 different wheat crop models of the Agricultural Model Intercomparison and Improvement Project against field experiments in which growing season mean temperatures ranged from 15 °C to 32 °C, including experiments with artificial heating. Many models simulated yields well, but were less accurate at higher temperatures. The model ensemble median was consistently more accurate in simulating the crop temperature response than any single model, regardless of the input information used. Extrapolating the model ensemble temperature response indicates that warming is already slowing yield gains at a majority of wheat-growing locations. Global wheat production is estimated to fall by 6% for each °C of further temperature increase and become more variable over space and time.
|
Rivington, M., & Wallach, D. (2015). Communication strategy, including design of tools for more effective communication of uncertainty (Vol. 6).
Abstract: Communication is the key link between the generation of information by MACSUR about the uncertainty of climate change impacts on future food security and how information is used by decision makers. It is therefore important to make available the common tools for reporting uncertainty, with a discussion of the advantages or difficulties of each. That is the purpose of this report. No Label
|
Wallach, D., & Rivington, M. (2015). Identification and quantification of differences between models (Vol. 6).
Abstract: A major goal of crop model inter-comparison is model improvement, and an important intermediate step toward that goal is understanding in some detail how models differ, and the consequences of those differences. This report is intended as a first attempt at describing possible techniques for relating differences between model outputs to specific aspects of the models. No Label
|
|
Cammarano, D., Rötter, P., Ewert, F., Palosuo, T., Bindi, M., Kersebaum, K. C., et al. (2013). Challenges for Agro-Ecosystem Modelling in Climate Change Risk Assessment for major European Crops and Farming systems. (pp. 555–564).
|
