Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
Zhao, G., Hoffmann, H., Yeluripati, J., Xenia, S., Nendel, C., Coucheney, E., et al. (2016). Evaluating the precision of eight spatial sampling schemes in estimating regional means of simulated yield for two crops. Env. Model. Softw., 80, 100–112.
Abstract: We compared the precision of simple random sampling (SimRS) and seven types of stratified random sampling (StrRS) schemes in estimating regional mean of water-limited yields for two crops (winter wheat and silage maize) that were simulated by fourteen crop models. We found that the precision gains of StrRS varied considerably across stratification methods and crop models. Precision gains for compact geographical stratification were positive, stable and consistent across crop models. Stratification with soil water holding capacity had very high precision gains for twelve models, but resulted in negative gains for two models. Increasing the sample size monotonously decreased the sampling errors for all the sampling schemes. We conclude that compact geographical stratification can modestly but consistently improve the precision in estimating regional mean yields. Using the most influential environmental variable for stratification can notably improve the sampling precision, especially when the sensitivity behavior of a crop model is known.
|
Ewert, F., Rötter, R. P., Bindi, M., Webber, H., Trnka, M., Kersebaum, K. C., et al. (2015). Crop modelling for integrated assessment of risk to food production from climate change. Env. Model. Softw., 72, 287–303.
Abstract: The complexity of risks posed by climate change and possible adaptations for crop production has called for integrated assessment and modelling (IAM) approaches linking biophysical and economic models. This paper attempts to provide an overview of the present state of crop modelling to assess climate change risks to food production and to which extent crop models comply with IAM demands. Considerable progress has been made in modelling effects of climate variables, where crop models best satisfy IAM demands. Demands are partly satisfied for simulating commonly required assessment variables. However, progress on the number of simulated crops, uncertainty propagation related to model parameters and structure, adaptations and scaling are less advanced and lagging behind IAM demands. The limitations are considered substantial and apply to a different extent to all crop models. Overcoming these limitations will require joint efforts, and consideration of novel modelling approaches.
|
Grosz, B., Dechow, R., Gebbert, S., Hoffmann, H., Zhao, G., Constantin, J., et al. (2017). The implication of input data aggregation on up-scaling soil organic carbon changes. Env. Model. Softw., 96, 361–377.
Abstract: In up-scaling studies, model input data aggregation is a common method to cope with deficient data availability and limit the computational effort. We analyzed model errors due to soil data aggregation for modeled SOC trends. For a region in North West Germany, gridded soil data of spatial resolutions between 1 km and 100 km has been derived by majority selection. This data was used to simulate changes in SOC for a period of 30 years by 7 biogeochemical models. Soil data aggregation strongly affected modeled SOC trends. Prediction errors of simulated SOC changes decreased with increasing spatial resolution of model output. Output data aggregation only marginally reduced differences of model outputs between models indicating that errors caused by deficient model structure are likely to persist even if requirements on the spatial resolution of model outputs are low. (C)2017 Elsevier Ltd. All rights reserved.
|
Webber, H., Martre, P., Asseng, S., Kimball, B., White, J., Ottman, M., et al. (2017). Canopy temperature for simulation of heat stress in irrigated wheat in a semi-arid environment: A multi-model comparison. Field Crops Research, 202, 21–35.
Abstract: Even brief periods of high temperatures occurring around flowering and during grain filling can severely reduce grain yield in cereals. Recently, ecophysiological and crop models have begun to represent such phenomena. Most models use air temperature (Tair) in their heat stress responses despite evidence that crop canopy temperature (Tc) better explains grain yield losses. Tc can deviate significantly from Tair based on climatic factors and the crop water status. The broad objective of this study was to evaluate whether simulation of Tc improves the ability of crop models to simulate heat stress impacts on wheat under irrigated conditions. Nine process-based models, each using one of three broad approaches (empirical, EMP; energy balance assuming neutral atmospheric stability, EBN; and energy balance correcting for the atmospheric stability conditions, EBSC) to simulate Tc, simulated grain yield under a range of temperature conditions. The models varied widely in their ability to reproduce the measured Tc with the commonly used EBN models performing much worse than either EMP or EBSC. Use of Tc to account for heat stress effects did improve simulations compared to using only Tair to a relatively minor extent, but the models that additionally use Tc on various other processes as well did not have better yield simulations. Models that simulated yield well under heat stress had varying skill in simulating Tc. For example, the EBN models had very poor simulations of Tc but performed very well in simulating grain yield. These results highlight the need to more systematically understand and model heat stress events in wheat.
|
