| Home | << 1 2 3 4 5 6 7 8 9 10 >> |
|
Wallach, D., Mearns, L. O., Ruane, A. C., Rötter, R. P., & Asseng, S. (2016). Lessons from climate modeling on the design and use of ensembles for crop modeling. Clim. Change, .
Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.
Keywords: Model ensembles; Crop models; Climate models; Model weighting; Super ensembles
Area: CropM
|
|
Maiorano, A., Martre, P., Asseng, S., Ewert, F., Müller, C., Rötter, R. P., et al. (2016). Crop model improvement reduces the uncertainty of the response to temperature of multi-model ensembles. Field Crops Research, 202, 5–20.
Abstract: To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT world-wide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures >24 °C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.
Keywords: Impact uncertainty; High temperature; Model improvement; Multi-model ensemble; Wheat crop model
Area: CropM
|
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
|
Ruane, A. C., Hudson, N. I., Asseng, S., Camarrano, D., Ewert, F., Martre, P., et al. (2016). Multi-wheat-model ensemble responses to interannual climate variability. Env. Model. Softw., 81, 86–101.
Abstract: We compare 27 wheat models’ yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981-2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models’ climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R-2 <= 0.24) was found between the models’ sensitivities to interannual temperature variability and their response to long-term warming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts. Published by Elsevier Ltd.
|
|
Zhao, G., Hoffmann, H., van Bussel, L. G. J., Enders, A., Specka, X., Sosa, C., et al. (2015). Effect of weather data aggregation on regional crop simulation for different crops, production conditions, and response variables. Clim. Res., 65, 141–157.
Abstract: We assessed the weather data aggregation effect (DAE) on the simulation of cropping systems for different crops, response variables, and production conditions. Using 13 process-based crop models and the ensemble mean, we simulated 30 yr continuous cropping systems for 2 crops (winter wheat and silage maize) under 3 production conditions for the state of North Rhine-Westphalia, Germany. The DAE was evaluated for 5 weather data resolutions (i.e. 1, 10, 25, 50, and 100 km) for 3 response variables including yield, growing season evapotranspiration, and water use efficiency. Five metrics, viz. the spatial bias (Delta), average absolute deviation (AAD), relative AAD, root mean squared error (RMSE), and relative RMSE, were used to evaluate the DAE on both the input weather data and simulated results. For weather data, we found that data aggregation narrowed the spatial variability but widened the., especially across mountainous areas. The DAE on loss of spatial heterogeneity and hotspots was stronger than on the average changes over the region. The DAE increased when coarsening the spatial resolution of the input weather data. The DAE varied considerably across different models, but changed only slightly for different production conditions and crops. We conclude that if spatially detailed information is essential for local management decision, higher resolution is desirable to adequately capture the spatial variability for heterogeneous regions. The required resolution depends on the choice of the model as well as the environmental condition of the study area.
|