|
Maiorano, A., Martre, P., Asseng, S., Ewert, F., Müller, C., Rötter, R. P., et al. (2016). Crop model improvement reduces the uncertainty of the response to temperature of multi-model ensembles. Field Crops Research, 202, 5–20.
Abstract: To improve climate change impact estimates and to quantify their uncertainty, multi-model ensembles (MMEs) have been suggested. Model improvements can improve the accuracy of simulations and reduce the uncertainty of climate change impact assessments. Furthermore, they can reduce the number of models needed in a MME. Herein, 15 wheat growth models of a larger MME were improved through re-parameterization and/or incorporating or modifying heat stress effects on phenology, leaf growth and senescence, biomass growth, and grain number and size using detailed field experimental data from the USDA Hot Serial Cereal experiment (calibration data set). Simulation results from before and after model improvement were then evaluated with independent field experiments from a CIMMYT world-wide field trial network (evaluation data set). Model improvements decreased the variation (10th to 90th model ensemble percentile range) of grain yields simulated by the MME on average by 39% in the calibration data set and by 26% in the independent evaluation data set for crops grown in mean seasonal temperatures >24 °C. MME mean squared error in simulating grain yield decreased by 37%. A reduction in MME uncertainty range by 27% increased MME prediction skills by 47%. Results suggest that the mean level of variation observed in field experiments and used as a benchmark can be reached with half the number of models in the MME. Improving crop models is therefore important to increase the certainty of model-based impact assessments and allow more practical, i.e. smaller MMEs to be used effectively.
|
|
|
Webber, H., White, J. W., Kimball, B. A., Ewert, F., Asseng, S., Rezaei, E. E., et al. (2018). Physical robustness of canopy temperature models for crop heat stress simulation across environments and production conditions. Field Crops Research, 216, 75–88.
Abstract: Despite widespread application in studying climate change impacts, most crop models ignore complex interactions among air temperature, crop and soil water status, CO2 concentration and atmospheric conditions that influence crop canopy temperature. The current study extended previous studies by evaluating Tc simulations from nine crop models at six locations across environmental and production conditions. Each crop model implemented one of an empirical (EMP), an energy balance assuming neutral stability (EBN) or an energy balance correcting for atmospheric stability conditions (EBSC) approach to simulate Tc. Model performance in predicting Tc was evaluated for two experiments in continental North America with various water, nitrogen and CO2 treatments. An empirical model fit to one dataset had the best performance, followed by the EBSC models. Stability conditions explained much of the differences between modeling approaches. More accurate simulation of heat stress will likely require use of energy balance approaches that consider atmospheric stability conditions.
|
|
|
Sandor, R., Ehrhardt, F., Grace, P., Recous, S., Smith, P., Snow, V., et al. (2020). Ensemble modelling of carbon fluxes in grasslands and croplands. Field Crops Research, 252, 107791.
Abstract: Croplands and grasslands are agricultural systems that contribute to land–atmosphere exchanges of carbon (C). We evaluated and compared gross primary production (GPP), ecosystem respiration (RECO), net ecosystem exchange (NEE) of CO2, and two derived outputs – C use efficiency (CUE=-NEE/GPP) and C emission intensity (IntC= -NEE/Offtake [grazed or harvested biomass]). The outputs came from 23 models (11 crop-specific, eight grassland-specific, and four models covering both systems) at three cropping sites over several rotations with spring and winter cereals, soybean and rapeseed in Canada, France and India, and two temperate permanent grasslands in France and the United Kingdom. The models were run independently over multi-year simulation periods in five stages (S), either blind with no calibration and initialization data (S1), using historical management and climate for initialization (S2), calibrated against plant data (S3), plant and soil data together (S4), or with the addition of C and N fluxes (S5). Here, we provide a framework to address methodological uncertainties and contextualize results. Most of the models overestimated or underestimated the C fluxes observed during the growing seasons (or the whole years for grasslands), with substantial differences between models. For each simulated variable, changes in the multi-model median (MMM) from S1 to S5 was used as a descriptor of the ensemble performance. Overall, the greatest improvements (MMM approaching the mean of observations) were achieved at S3 or higher calibration stages. For instance, grassland GPP MMM was equal to 1632 g C m−2 yr-1 (S5) while the observed mean was equal to 1763 m-2 yr-1 (average for two sites). Nash-Sutcliffe modelling efficiency coefficients indicated that MMM outperformed individual models in 92.3 % of cases. Our study suggests a cautious use of large-scale, multi-model ensembles to estimate C fluxes in agricultural sites if some site-specific plant and soil observations are available for model calibration. The further development of crop/grassland ensemble modelling will hinge upon the interpretation of results in light of the way models represent the processes underlying C fluxes in complex agricultural systems (grassland and crop rotations including fallow periods).
|
|
|
Yin, X., Kersebaum, K. - C., Beaudoin, N., Constantin, J., Chen, F., Louarn, G., et al. (2020). Uncertainties in simulating N uptake, net N mineralization, soil mineral N and N leaching in European crop rotations using process-based models. Field Crops Research, , 107863.
Abstract: Modelling N transformations within cropping systems is crucial for N management optimization in order to increase N use efficiency and reduce N losses. Such modelling remains challenging because of the complexity of N cycling in soil–plant systems. In the current study, the uncertainties of six widely used process-based models (PBMs), including APSIM, CROPSYST, DAISY, FASSET, HERMES and STICS, were tested in simulating different N managements (catch crops (CC) and different N fertilizer rates) in 12-year rotations in Western Europe. Winter wheat, sugar beet and pea were the main crops, and radish was the main CC in the tested systems. Our results showed that PBMs simulated yield, aboveground biomass, N export and N uptake well with low RMSE values, except for sugar beet, which was generally less well parameterized. Moreover, PBMs provided more accurate crop simulations (i.e. N export and N uptake) compared to simulations of soil (N mineralization and soil mineral N (SMN)) and environmental variables (N leaching). The use of multi-model ensemble mean or median of four PBMs significantly reduced the mean absolute percentage error (MAPE) between simulations and observations to less than 15% for yield, aboveground biomass, N export and N uptake. Multi-model ensemble also significantly reduced the MAPE for net N mineralization and annual N leaching to around 15%, while it was larger than 20% for SMN. Generally, PBMs well simulated the CC effects on N fluxes, i.e. increasing N mineralization and reducing N leaching in both short-term and long-term, and all PBMs correctly predicted the effects of the reduced N rate on all measured variables in the study. The uncertainties of multi-model ensemble for N mineralization, SMN and N leaching were larger, mainly because these variables are influenced by plant-soil interactions and subject to cumulative long-term effects in crop rotations, which makes them more difficult to simulate. Large differences existed between individual PBMs due to the differences in formalisms for describing N processes in soil–plant systems, the skills of modelers and the model calibration level. In addition, the model performance also depended on the simulated variables, for instance, HERMES and FASSET performed better for yield and crop biomass, APSIM, DAISY and STICS performed better for N export and N uptake, STICS provided best simulation for SMN and N leaching among the six individual PBMs in the study, but all PBMs met difficulties to well predict either average or variance of soil N mineralization. Our results showed that better calibration for soil N variables is needed to improve model predictions of N cycling in order to optimize N management in crop rotations.
|
|
|
Martre, P., Wallach, D., Asseng, S., Ewert, F., Jones, J. W., Rötter, R. P., et al. (2015). Multimodel ensembles of wheat growth: many models are better than one. Glob. Chang. Biol., 21(2), 911–925.
Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.
|
|