|
|
Wallach, D., Mearns, L. O., Ruane, A. C., Rötter, R. P., & Asseng, S. (2016). Lessons from climate modeling on the design and use of ensembles for crop modeling. Clim. Change, .
Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.
|
|
|
|
Webber, H., Gaiser, T., Oomen, R., Teixeira, E., Zhao, G., Wallach, D., et al. (2016). Uncertainty in future irrigation water demand and risk of crop failure for maize in Europe. Environ. Res. Lett., .
Abstract: While crop models are widely used to assess the change in crop productivity with climate change, their skill in assessing irrigation water demand or the risk of crop failure in large area impact assessments is relatively unknown. The objective of this study is to investigate which aspects of modeling crop water use (reference crop evapotranspiration (ET0), soil water extraction, soil evaporation, soil water balance and root growth) contributes most to the variability in estimates of maize crop water use and the risk of crop failure, and demonstrate the resulting uncertainty in a climate change impact study for Europe. The SIMPLACE crop modeling framework was used to couple the LINTUL5 crop model in factorial combinations of 2-3 different approaches for simulating the 5 aspects of crop water use, resulting in 51 modeling approaches. Using experiments in France and New Zeland, analysis of total sensitivity revealed that ET0 explained the most variability in both irrigated maize water use and rainfed grain yield levels, with soil evaporation also imporatant in the French experiment. In the European impact study, net irrigation requirement differed by 36% between the Penman and Hargreaves ET0 methods in the baseline period. Average EU grain yields were similar between models, but differences approached 1-2 tonnes in parts of France and Southern Europe. EU wide esimates of crop failure in the historical period ranged between 5.4 years for Priestley-Taylor to every 7.9 years for the Penman ET0 methods. While the uncertainty in absolute values between models was significant, estimates of relative changes were similar between models, confirming the utility of crop models in assessing climate change impacts. If ET0 estimates in crop models can be improved, through the use of appropriate methods, uncertainty in irrigation water demand as well as in yield estimates under drought can be reduced.
|
|
|
|
Ruane, A. C., Hudson, N. I., Asseng, S., Camarrano, D., Ewert, F., Martre, P., et al. (2016). Multi-wheat-model ensemble responses to interannual climate variability. Env. Model. Softw., 81, 86–101.
Abstract: We compare 27 wheat models’ yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981-2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models’ climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R-2 <= 0.24) was found between the models’ sensitivities to interannual temperature variability and their response to long-term warming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts. Published by Elsevier Ltd.
|
|
|
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
|
|
|
Wallach, D., Nissanka, S. P., Karunaratne, A. S., Weerakoon, W. M. W., Thorburn, P. J., Boote, K. J., et al. (2016). Accounting for both parameter and model structure uncertainty in crop model predictions of phenology: A case study on rice. European Journal of Agronomy, .
Abstract: We consider predictions of the impact of climate warming on rice development times in Sri Lanka. The major emphasis is on the uncertainty of the predictions, and in particular on the estimation of mean squared error of prediction. Three contributions to mean squared error are considered. The first is parameter uncertainty that results from model calibration. To take proper account of the complex data structure, generalized least squares is used to estimate the parameters and the variance-covariance matrix of the parameter estimators. The second contribution is model structure uncertainty, which we estimate using two different models. An ANOVA analysis is used to separate the contributions of parameter and model uncertainty to mean squared error. The third contribution is model error, which is estimated using hindcasts. Mean squared error of prediction of time from emergence to maturity, for baseline +2 °C, is estimated as 108 days2, with model error contributing 86 days2, followed by model structure uncertainty which contributes 15 days2 and parameter uncertainty which contributes 7 days2. We also show how prediction uncertainty is reduced if prediction concerns development time averaged over years, or the difference in development time between baseline and warmer temperatures.
|
|
