|
|
Wallach, D., Nissanka, S. P., Karunaratne, A. S., Weerakoon, W. M. W., Thorburn, P. J., Boote, K. J., et al. (2016). Accounting for both parameter and model structure uncertainty in crop model predictions of phenology: A case study on rice. European Journal of Agronomy, .
Abstract: We consider predictions of the impact of climate warming on rice development times in Sri Lanka. The major emphasis is on the uncertainty of the predictions, and in particular on the estimation of mean squared error of prediction. Three contributions to mean squared error are considered. The first is parameter uncertainty that results from model calibration. To take proper account of the complex data structure, generalized least squares is used to estimate the parameters and the variance-covariance matrix of the parameter estimators. The second contribution is model structure uncertainty, which we estimate using two different models. An ANOVA analysis is used to separate the contributions of parameter and model uncertainty to mean squared error. The third contribution is model error, which is estimated using hindcasts. Mean squared error of prediction of time from emergence to maturity, for baseline +2 °C, is estimated as 108 days2, with model error contributing 86 days2, followed by model structure uncertainty which contributes 15 days2 and parameter uncertainty which contributes 7 days2. We also show how prediction uncertainty is reduced if prediction concerns development time averaged over years, or the difference in development time between baseline and warmer temperatures.
|
|
|
|
Maiorano, A., Martre, P., Asseng, S., Ewert, F., Müller, C., Rötter, R. P., et al. (2016). Crop model improvement reduces the uncertainty of the response to temperature of multi-model ensembles. Field Crops Research, 202, 5–20.
Abstract: To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT world-wide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures >24 °C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.
|
|
|
|
Challinor, A. J., Müller, C., Asseng, S., Deva, C., Nicklin, K. J., Wallach, D., et al. (2017). Improving the use of crop models for risk assessment and climate change adaptation. Agric. Syst., 159, 296–306.
Abstract: Highlights
• 14 criteria for use of crop models in assessments of impacts, adaptation and risk • Working with stakeholders to identify timing of risks is key to risk assessments. • Multiple methods needed to critically assess the use of climate model output • Increasing transparency and inter-comparability needed in risk assessments
Abstract
Crop models are used for an increasingly broad range of applications, with a commensurate proliferation of methods. Careful framing of research questions and development of targeted and appropriate methods are therefore increasingly important. In conjunction with the other authors in this special issue, we have developed a set of criteria for use of crop models in assessments of impacts, adaptation and risk. Our analysis drew on the other papers in this special issue, and on our experience in the UK Climate Change Risk Assessment 2017 and the MACSUR, AgMIP and ISIMIP projects. The criteria were used to assess how improvements could be made to the framing of climate change risks, and to outline the good practice and new developments that are needed to improve risk assessment. Key areas of good practice include: i. the development, running and documentation of crop models, with attention given to issues of spatial scale and complexity; ii. the methods used to form crop-climate ensembles, which can be based on model skill and/or spread; iii. the methods used to assess adaptation, which need broadening to account for technological development and to reflect the full range options available. The analysis highlights the limitations of focussing only on projections of future impacts and adaptation options using pre-determined time slices. Whilst this long-standing approach may remain an essential component of risk assessments, we identify three further key components: 1. Working with stakeholders to identify the timing of risks. What are the key vulnerabilities of food systems and what does crop-climate modelling tell us about when those systems are at risk? 2. Use of multiple methods that critically assess the use of climate model output and avoid any presumption that analyses should begin and end with gridded output. 3. Increasing transparency and inter-comparability in risk assessments. Whilst studies frequently produce ranges that quantify uncertainty, the assumptions underlying these ranges are not always clear. We suggest that the contingency of results upon assumptions is made explicit via a common uncertainty reporting format; and/or that studies are assessed against a set of criteria, such as those presented in this paper.
|
|
|
|
Yin, X., Kersebaum, K. - C., Beaudoin, N., Constantin, J., Chen, F., Louarn, G., et al. (2020). Uncertainties in simulating N uptake, net N mineralization, soil mineral N and N leaching in European crop rotations using process-based models. Field Crops Research, , 107863.
Abstract: Modelling N transformations within cropping systems is crucial for N management optimization in order to increase N use efficiency and reduce N losses. Such modelling remains challenging because of the complexity of N cycling in soil–plant systems. In the current study, the uncertainties of six widely used process-based models (PBMs), including APSIM, CROPSYST, DAISY, FASSET, HERMES and STICS, were tested in simulating different N managements (catch crops (CC) and different N fertilizer rates) in 12-year rotations in Western Europe. Winter wheat, sugar beet and pea were the main crops, and radish was the main CC in the tested systems. Our results showed that PBMs simulated yield, aboveground biomass, N export and N uptake well with low RMSE values, except for sugar beet, which was generally less well parameterized. Moreover, PBMs provided more accurate crop simulations (i.e. N export and N uptake) compared to simulations of soil (N mineralization and soil mineral N (SMN)) and environmental variables (N leaching). The use of multi-model ensemble mean or median of four PBMs significantly reduced the mean absolute percentage error (MAPE) between simulations and observations to less than 15% for yield, aboveground biomass, N export and N uptake. Multi-model ensemble also significantly reduced the MAPE for net N mineralization and annual N leaching to around 15%, while it was larger than 20% for SMN. Generally, PBMs well simulated the CC effects on N fluxes, i.e. increasing N mineralization and reducing N leaching in both short-term and long-term, and all PBMs correctly predicted the effects of the reduced N rate on all measured variables in the study. The uncertainties of multi-model ensemble for N mineralization, SMN and N leaching were larger, mainly because these variables are influenced by plant-soil interactions and subject to cumulative long-term effects in crop rotations, which makes them more difficult to simulate. Large differences existed between individual PBMs due to the differences in formalisms for describing N processes in soil–plant systems, the skills of modelers and the model calibration level. In addition, the model performance also depended on the simulated variables, for instance, HERMES and FASSET performed better for yield and crop biomass, APSIM, DAISY and STICS performed better for N export and N uptake, STICS provided best simulation for SMN and N leaching among the six individual PBMs in the study, but all PBMs met difficulties to well predict either average or variance of soil N mineralization. Our results showed that better calibration for soil N variables is needed to improve model predictions of N cycling in order to optimize N management in crop rotations.
|
|
|
|
Webber, H., Martre, P., Asseng, S., Kimball, B., White, J., Ottman, M., et al. (2017). Canopy temperature for simulation of heat stress in irrigated wheat in a semi-arid environment: A multi-model comparison. Field Crops Research, 202, 21–35.
Abstract: Even brief periods of high temperatures occurring around flowering and during grain filling can severely reduce grain yield in cereals. Recently, ecophysiological and crop models have begun to represent such phenomena. Most models use air temperature (Tair) in their heat stress responses despite evidence that crop canopy temperature (Tc) better explains grain yield losses. Tc can deviate significantly from Tair based on climatic factors and the crop water status. The broad objective of this study was to evaluate whether simulation of Tc improves the ability of crop models to simulate heat stress impacts on wheat under irrigated conditions. Nine process-based models, each using one of three broad approaches (empirical, EMP; energy balance assuming neutral atmospheric stability, EBN; and energy balance correcting for the atmospheric stability conditions, EBSC) to simulate Tc, simulated grain yield under a range of temperature conditions. The models varied widely in their ability to reproduce the measured Tc with the commonly used EBN models performing much worse than either EMP or EBSC. Use of Tc to account for heat stress effects did improve simulations compared to using only Tair to a relatively minor extent, but the models that additionally use Tc on various other processes as well did not have better yield simulations. Models that simulated yield well under heat stress had varying skill in simulating Tc. For example, the EBN models had very poor simulations of Tc but performed very well in simulating grain yield. These results highlight the need to more systematically understand and model heat stress events in wheat.
|
|
