| Records |
| Author |
Wallach, D.; Thorburn, P.; Asseng, S.; Challinor, A.J.; Ewert, F.; Jones, J.W.; Rötter, R.; Ruane, A. |
| Title |
Estimating model prediction error: Should you treat predictions as fixed or random |
Type |
Journal Article |
| Year |
2016 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
84 |
Issue |
|
Pages |
529-539 |
| Keywords |
Crop model; Uncertainty; Prediction error; Parameter uncertainty; Input uncertainty; Model structure uncertainty |
| Abstract |
Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation. |
| Address |
|
| Corporate Author |
|
Thesis |
|
Publisher  |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4773 |
| Permanent link to this record |
| |
|
| |
| Author |
Wallach, D.; Nissanka, S.P.; Karunaratne, A.S.; Weerakoon, W.M.W.; Thorburn, P.J.; Boote, K.J.; Jones, J.W. |
| Title |
Accounting for both parameter and model structure uncertainty in crop model predictions of phenology: A case study on rice |
Type |
Journal Article |
| Year |
2016 |
Publication |
European Journal of Agronomy |
Abbreviated Journal |
European Journal of Agronomy |
| Volume |
|
Issue |
|
Pages |
|
| Keywords |
Uncertainty; Phenology; Parameter uncertainty; Multi-model ensemble; Generalized least squares; Rice; Crop model; APSIM; DSSAT |
| Abstract |
We consider predictions of the impact of climate warming on rice development times in Sri Lanka. The major emphasis is on the uncertainty of the predictions, and in particular on the estimation of mean squared error of prediction. Three contributions to mean squared error are considered. The first is parameter uncertainty that results from model calibration. To take proper account of the complex data structure, generalized least squares is used to estimate the parameters and the variance-covariance matrix of the parameter estimators. The second contribution is model structure uncertainty, which we estimate using two different models. An ANOVA analysis is used to separate the contributions of parameter and model uncertainty to mean squared error. The third contribution is model error, which is estimated using hindcasts. Mean squared error of prediction of time from emergence to maturity, for baseline +2 °C, is estimated as 108 days2, with model error contributing 86 days2, followed by model structure uncertainty which contributes 15 days2 and parameter uncertainty which contributes 7 days2. We also show how prediction uncertainty is reduced if prediction concerns development time averaged over years, or the difference in development time between baseline and warmer temperatures. |
| Address |
2016-09-13 |
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
Language |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1161-0301 |
ISBN |
|
Medium |
Article |
| Area |
CropM |
Expedition |
|
Conference |
|
| Notes |
CropM; wos; ftnotmacsur; wsnotyet; |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4777 |
| Permanent link to this record |
| |
|
| |
| Author |
Zhao, G.; Hoffmann, H.; van Bussel, L.G.J.; Enders, A.; Specka, X.; Sosa, C.; Yeluripati, J.; Tao, F.L.; Constantin, J.; Raynal, H.; Teixeira, E.; Grosz, B.; Doro, L.; Zhao, Z.G.; Nendel, C.; Kiese, R.; Eckersten, H.; Haas, E.; Vanuytrecht, E.; Wang, E.; Kuhnert, M.; Trombi, G.; Moriondo, M.; Bindi, M.; Lewan, E.; Bach, M.; Kersebaum, K.C.; Rotter, R.; Roggero, P.P.; Wallach, D.; Cammarano, D.; Asseng, S.; Krauss, G.; Siebert, S.; Gaiser, T.; Ewert, F. |
| Title |
Effect of weather data aggregation on regional crop simulation for different crops, production conditions, and response variables |
Type |
Journal Article |
| Year |
2015 |
Publication |
Climate Research |
Abbreviated Journal |
Clim. Res. |
| Volume |
65 |
Issue |
|
Pages |
141-157 |
| Keywords |
crop model; model comparison; spatial resolution; data aggregation; spatial heterogeneity; scaling; climate-change scenarios; sub-saharan africa; winter-wheat; spatial-resolution; yield response; input data; systems simulation; large-scale; soil data; part i |
| Abstract |
We assessed the weather data aggregation effect (DAE) on the simulation of cropping systems for different crops, response variables, and production conditions. Using 13 process-based crop models and the ensemble mean, we simulated 30 yr continuous cropping systems for 2 crops (winter wheat and silage maize) under 3 production conditions for the state of North Rhine-Westphalia, Germany. The DAE was evaluated for 5 weather data resolutions (i.e. 1, 10, 25, 50, and 100 km) for 3 response variables including yield, growing season evapotranspiration, and water use efficiency. Five metrics, viz. the spatial bias (Delta), average absolute deviation (AAD), relative AAD, root mean squared error (RMSE), and relative RMSE, were used to evaluate the DAE on both the input weather data and simulated results. For weather data, we found that data aggregation narrowed the spatial variability but widened the., especially across mountainous areas. The DAE on loss of spatial heterogeneity and hotspots was stronger than on the average changes over the region. The DAE increased when coarsening the spatial resolution of the input weather data. The DAE varied considerably across different models, but changed only slightly for different production conditions and crops. We conclude that if spatially detailed information is essential for local management decision, higher resolution is desirable to adequately capture the spatial variability for heterogeneous regions. The required resolution depends on the choice of the model as well as the environmental condition of the study area. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
0936-577x |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4754 |
| Permanent link to this record |
| |
|
| |
| Author |
Zhao, G.; Hoffmann, H.; Yeluripati, J.; Xenia, S.; Nendel, C.; Coucheney, E.; Kuhnert, M.; Tao, F.; Constantin, J.; Raynal, H.; Teixeira, E.; Grosz, B.; Doro, L.; Kiese, R.; Eckersten, H.; Haas, E.; Cammarano, D.; Kassie, B.; Moriondo, M.; Trombi, G.; Bindi, M.; Biernath, C.; Heinlein, F.; Klein, C.; Priesack, E.; Lewan, E.; Kersebaum, K.-C.; Rötter, R.; Roggero, P.P.; Wallach, D.; Asseng, S.; Siebert, S.; Gaiser, T.; Ewert, F. |
| Title |
Evaluating the precision of eight spatial sampling schemes in estimating regional means of simulated yield for two crops |
Type |
Journal Article |
| Year |
2016 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
80 |
Issue |
|
Pages |
100-112 |
| Keywords |
Crop model; Stratified random sampling; Simple random sampling; Clustering; Up-scaling; Model comparison; Precision gain; species distribution models; systems simulation; weather data; large-scale; design; soil; optimization; growth; apsim; autocorrelation |
| Abstract |
We compared the precision of simple random sampling (SimRS) and seven types of stratified random sampling (StrRS) schemes in estimating regional mean of water-limited yields for two crops (winter wheat and silage maize) that were simulated by fourteen crop models. We found that the precision gains of StrRS varied considerably across stratification methods and crop models. Precision gains for compact geographical stratification were positive, stable and consistent across crop models. Stratification with soil water holding capacity had very high precision gains for twelve models, but resulted in negative gains for two models. Increasing the sample size monotonously decreased the sampling errors for all the sampling schemes. We conclude that compact geographical stratification can modestly but consistently improve the precision in estimating regional mean yields. Using the most influential environmental variable for stratification can notably improve the sampling precision, especially when the sensitivity behavior of a crop model is known. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4724 |
| Permanent link to this record |
| |
|
| |
| Author |
Hoffmann, H.; Zhao, G.; Asseng, S.; Bindi, M.; Biernath, C.; Constantin, J.; Coucheney, E.; Dechow, R.; Doro, L.; Eckersten, H.; Gaiser, T.; Grosz, B.; Heinlein, F.; Kassie, B.T.; Kersebaum, K.-C.; Klein, C.; Kuhnert, M.; Lewan, E.; Moriondo, M.; Nendel, C.; Priesack, E.; Raynal, H.; Roggero, P.P.; Rötter, R.P.; Siebert, S.; Specka, X.; Tao, F.; Teixeira, E.; Trombi, G.; Wallach, D.; Weihermüller, L.; Yeluripati, J.; Ewert, F. |
| Title |
Impact of spatial soil and climate input data aggregation on regional yield simulations |
Type |
Journal Article |
| Year |
2016 |
Publication |
PLoS One |
Abbreviated Journal |
PLoS One |
| Volume |
11 |
Issue |
4 |
Pages |
e0151782 |
| Keywords |
systems simulation; nitrogen dynamics; winter-wheat; crop models; data resolution; scale; water; variability; calibration; weather |
| Abstract |
We show the error in water-limited yields simulated by crop models which is associated with spatially aggregated soil and climate input data. Crop simulations at large scales (regional, national, continental) frequently use input data of low resolution. Therefore, climate and soil data are often generated via averaging and sampling by area majority. This may bias simulated yields at large scales, varying largely across models. Thus, we evaluated the error associated with spatially aggregated soil and climate data for 14 crop models. Yields of winter wheat and silage maize were simulated under water-limited production conditions. We calculated this error from crop yields simulated at spatial resolutions from 1 to 100 km for the state of North Rhine-Westphalia, Germany. Most models showed yields biased by <15% when aggregating only soil data. The relative mean absolute error (rMAE) of most models using aggregated soil data was in the range or larger than the inter-annual or inter-model variability in yields. This error increased further when both climate and soil data were aggregated. Distinct error patterns indicate that the rMAE may be estimated from few soil variables. Illustrating the range of these aggregation effects across models, this study is a first step towards an ex-ante assessment of aggregation errors in large-scale simulations. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1932-6203 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4725 |
| Permanent link to this record |
