| Records |
| Author |
Wallach, D.; Thorburn, P.; Asseng, S.; Challinor, A.J.; Ewert, F.; Jones, J.W.; Rötter, R.; Ruane, A. |
| Title |
Estimating model prediction error: Should you treat predictions as fixed or random |
Type |
Journal Article |
| Year |
2016 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
84 |
Issue |
|
Pages |
529-539 |
| Keywords |
Crop model; Uncertainty; Prediction error; Parameter uncertainty; Input uncertainty; Model structure uncertainty |
| Abstract |
Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4773 |
| Permanent link to this record |
| |
|
| |
| Author |
Ruane, A.C.; Hudson, N.I.; Asseng, S.; Camarrano, D.; Ewert, F.; Martre, P.; Boote, K.J.; Thorburn, P.J.; Aggarwal, P.K.; Angulo, C.; Basso, B.; Bertuzzi, P.; Biernath, C.; Brisson, N.; Challinor, &rew J.; Doltra, J.; Gayler, S.; Goldberg, R.; Grant, R.F.; Heng, L.; Hooker, J.; Hunt, L.A.; Ingwersen, J.; Izaurralde, R.C.; Kersebaum, K.C.; Kumar, S.N.; Müller, C.; Nendel, C.; O’Leary, G.; Olesen, J.E.; Osborne, T.M.; Palosuo, T.; Priesack, E.; Ripoche, D.; Rötter, R.P.; Semenov, M.A.; Shcherbak, I.; Steduto, P.; Stöckle, C.O.; Stratonovitch, P.; Streck, T.; Supit, I.; Tao, F.; Travasso, M.; Waha, K.; Wallach, D.; White, J.W.; Wolf, J. |
| Title |
Multi-wheat-model ensemble responses to interannual climate variability |
Type |
Journal Article |
| Year |
2016 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
81 |
Issue |
|
Pages |
86-101 |
| Keywords |
Crop modeling; Uncertainty; Multi-model ensemble; Wheat; AgMIP; Climate; impacts; Temperature; Precipitation; lnterannual variability; simulation-model; crop model; nitrogen dynamics; winter-wheat; large-area; systems simulation; farming systems; yield response; growth; water |
| Abstract |
We compare 27 wheat models’ yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981-2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models’ climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R-2 <= 0.24) was found between the models’ sensitivities to interannual temperature variability and their response to long-term warming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts. Published by Elsevier Ltd. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4769 |
| Permanent link to this record |
| |
|
| |
| Author |
Sanna, M.; Bellocchi, G.; Fumagalli, M.; Acutis, M. |
| Title |
A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models |
Type |
Journal Article |
| Year |
2015 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
73 |
Issue |
|
Pages |
286-304 |
| Keywords |
model evaluation; performance indicators; stable correlation; solar-radiation; simulation-model; environmental-models; statistical-methods; crop nitrogen; validation; rice; uncertainty; calibration; software |
| Abstract |
The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of “stable correlation”, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools. (C) 2015 Elsevier Ltd. All rights reserved. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM LiveM, ftnotmacsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4503 |
| Permanent link to this record |
| |
|
| |
| Author |
Ewert, F.; Rötter, R.P.; Bindi, M.; Webber, H.; Trnka, M.; Kersebaum, K.C.; Olesen, J.E.; van Ittersum, M.K.; Janssen, S.; Rivington, M.; Semenov, M.A.; Wallach, D.; Porter, J.R.; Stewart, D.; Verhagen, J.; Gaiser, T.; Palosuo, T.; Tao, F.; Nendel, C.; Roggero, P.P.; Bartošová, L.; Asseng, S. |
| Title |
Crop modelling for integrated assessment of risk to food production from climate change |
Type |
Journal Article |
| Year |
2015 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
72 |
Issue |
|
Pages |
287-303 |
| Keywords |
uncertainty; scaling; integrated assessment; risk assessment; adaptation; crop models; agricultural land-use; change adaptation strategies; farming systems simulation; agri-environmental systems; enrichment face experiment; high-temperature stress; change impacts; nitrogen dynamics; atmospheric co2; spring wheat |
| Abstract |
The complexity of risks posed by climate change and possible adaptations for crop production has called for integrated assessment and modelling (IAM) approaches linking biophysical and economic models. This paper attempts to provide an overview of the present state of crop modelling to assess climate change risks to food production and to which extent crop models comply with IAM demands. Considerable progress has been made in modelling effects of climate variables, where crop models best satisfy IAM demands. Demands are partly satisfied for simulating commonly required assessment variables. However, progress on the number of simulated crops, uncertainty propagation related to model parameters and structure, adaptations and scaling are less advanced and lagging behind IAM demands. The limitations are considered substantial and apply to a different extent to all crop models. Overcoming these limitations will require joint efforts, and consideration of novel modelling approaches. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4521 |
| Permanent link to this record |
| |
|
| |
| Author |
Wallach, D.; Nissanka, S.P.; Karunaratne, A.S.; Weerakoon, W.M.W.; Thorburn, P.J.; Boote, K.J.; Jones, J.W. |
| Title |
Accounting for both parameter and model structure uncertainty in crop model predictions of phenology: A case study on rice |
Type |
Journal Article |
| Year |
2016 |
Publication |
European Journal of Agronomy |
Abbreviated Journal |
European Journal of Agronomy |
| Volume |
|
Issue |
|
Pages |
|
| Keywords |
Uncertainty; Phenology; Parameter uncertainty; Multi-model ensemble; Generalized least squares; Rice; Crop model; APSIM; DSSAT |
| Abstract |
We consider predictions of the impact of climate warming on rice development times in Sri Lanka. The major emphasis is on the uncertainty of the predictions, and in particular on the estimation of mean squared error of prediction. Three contributions to mean squared error are considered. The first is parameter uncertainty that results from model calibration. To take proper account of the complex data structure, generalized least squares is used to estimate the parameters and the variance-covariance matrix of the parameter estimators. The second contribution is model structure uncertainty, which we estimate using two different models. An ANOVA analysis is used to separate the contributions of parameter and model uncertainty to mean squared error. The third contribution is model error, which is estimated using hindcasts. Mean squared error of prediction of time from emergence to maturity, for baseline +2 °C, is estimated as 108 days2, with model error contributing 86 days2, followed by model structure uncertainty which contributes 15 days2 and parameter uncertainty which contributes 7 days2. We also show how prediction uncertainty is reduced if prediction concerns development time averaged over years, or the difference in development time between baseline and warmer temperatures. |
| Address |
2016-09-13 |
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
Language |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1161-0301 |
ISBN |
|
Medium |
Article |
| Area |
CropM |
Expedition |
|
Conference |
|
| Notes |
CropM; wos; ftnotmacsur; wsnotyet; |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4777 |
| Permanent link to this record |
