Refsgaard, J. C., Madsen, H., Andréassian, V., Arnbjerg-Nielsen, K., Davidson, T. A., Drews, M., et al. (2014). A framework for testing the ability of models to project climate change and its impacts. Clim. Change, 122(1-2), 271–282.
Abstract: Models used for climate change impact projections are typically not tested for simulation beyond current climate conditions. Since we have no data truly reflecting future conditions, a key challenge in this respect is to rigorously test models using proxies of future conditions. This paper presents a validation framework and guiding principles applicable across earth science disciplines for testing the capability of models to project future climate change and its impacts. Model test schemes comprising split-sample tests, differential split-sample tests and proxy site tests are discussed in relation to their application for projections by use of single models, ensemble modelling and space-time-substitution and in relation to use of different data from historical time series, paleo data and controlled experiments. We recommend that differential-split sample tests should be performed with best available proxy data in order to build further confidence in model projections.
|
Coucheney, E., Buis, S., Launay, M., Constantin, J., Mary, B., García de Cortázar-Atauri, I., et al. (2015). Accuracy, robustness and behavior of the STICS soil–crop model for plant, water and nitrogen outputs: Evaluation over a wide range of agro-environmental conditions in France. Env. Model. Softw., 64, 177–190.
Abstract: Soil-crop models are increasingly used as predictive tools to assess yield and environmental impacts of agriculture in a growing diversity of contexts. They are however seldom evaluated at a given time over a wide domain of use. We tested here the performances of the STICS model (v8.2.2) with its standard set of parameters over a dataset covering 15 crops and a wide range of agropedoclimatic conditions in France. Model results showed a good overall accuracy, with little bias. Relative RMSE was larger for soil nitrate (49%) than for plant biomass (35%) and nitrogen (33%) and smallest for soil water (10%). Trends induced by contrasted environmental conditions and management practices were well reproduced. Finally, limited dependency of model errors on crops or environments indicated a satisfactory robustness. Such performances make STICS a valuable tool for studying the effects of changes in agro-ecosystems over the domain explored. (C) 2014 Elsevier Ltd. All rights reserved.
|
Montesino-San Martín, M., Olesen, J. E., & Porter, J. R. (2015). Can crop-climate models be accurate and precise? A case study for wheat production in Denmark. Agricultural and Forest Meteorology, 202, 51–60.
Abstract: Crop models, used to make projections of climate change impacts, differ greatly in structural detail. Complexity of model structure has generic effects on uncertainty and error propagation in climate change impact assessments. We applied Bayesian calibration to three distinctly different empirical and mechanistic wheat models to assess how differences in the extent of process understanding in models affects uncertainties in projected impact. Predictive power of the models was tested via both accuracy (bias) and precision (or tightness of grouping) of yield projections for extrapolated weather conditions. Yields predicted by the mechanistic model were generally more accurate than the empirical models for extrapolated conditions. This trend does not hold for all extrapolations; mechanistic and empirical models responded differently due to their sensitivities to distinct weather features. However, higher accuracy comes at the cost of precision of the mechanistic model to embrace all observations within given boundaries. The approaches showed complementarity in sensitivity to weather variables and in accuracy for different extrapolation domains. Their differences in model precision and accuracy make them suitable for generic model ensembles for near-term agricultural impact assessments of climate change.
|
