Coucheney, E., Buis, S., Launay, M., Constantin, J., Mary, B., García de Cortázar-Atauri, I., et al. (2015). Accuracy, robustness and behavior of the STICS soil–crop model for plant, water and nitrogen outputs: Evaluation over a wide range of agro-environmental conditions in France. Env. Model. Softw., 64, 177–190.
Abstract: Soil-crop models are increasingly used as predictive tools to assess yield and environmental impacts of agriculture in a growing diversity of contexts. They are however seldom evaluated at a given time over a wide domain of use. We tested here the performances of the STICS model (v8.2.2) with its standard set of parameters over a dataset covering 15 crops and a wide range of agropedoclimatic conditions in France. Model results showed a good overall accuracy, with little bias. Relative RMSE was larger for soil nitrate (49%) than for plant biomass (35%) and nitrogen (33%) and smallest for soil water (10%). Trends induced by contrasted environmental conditions and management practices were well reproduced. Finally, limited dependency of model errors on crops or environments indicated a satisfactory robustness. Such performances make STICS a valuable tool for studying the effects of changes in agro-ecosystems over the domain explored. (C) 2014 Elsevier Ltd. All rights reserved.
|
Dumont, B., Leemans, V., Mansouri, M., Bodson, B., Destain, J. - P., & Destain, M. - F. (2014). Parameter identification of the STICS crop model, using an accelerated formal MCMC approach. Env. Model. Softw., 52, 121–135.
Abstract: This study presents a Bayesian approach for the parameters’ identification of the STICS crop model based on the recently developed Differential Evolution Adaptive Metropolis (DREAM) algorithm. The posterior distributions of nine specific crop parameters of the STICS model were sampled with the aim to improve the growth simulations of a winter wheat (Triticum aestivum L) culture. The results obtained with the DREAM algorithm were initially compared to those obtained with a Nelder-Mead Simplex algorithm embedded within the OptimiSTICS package. Then, three types of likelihood functions implemented within the DREAM algorithm were compared, namely the standard least square, the weighted least square, and a transformed likelihood function that makes explicit use of the coefficient of variation (CV). The results showed that the proposed CV likelihood function allowed taking into account both noise on measurements and heteroscedasticity which are regularly encountered in crop modelling. (C) 2013 Elsevier Ltd. All rights reserved.
|
Sanna, M., Bellocchi, G., Fumagalli, M., & Acutis, M. (2015). A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models. Env. Model. Softw., 73, 286–304.
Abstract: The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of “stable correlation”, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools. (C) 2015 Elsevier Ltd. All rights reserved.
|
Ruane, A. C., Hudson, N. I., Asseng, S., Camarrano, D., Ewert, F., Martre, P., et al. (2016). Multi-wheat-model ensemble responses to interannual climate variability. Env. Model. Softw., 81, 86–101.
Abstract: We compare 27 wheat models’ yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981-2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models’ climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R-2 <= 0.24) was found between the models’ sensitivities to interannual temperature variability and their response to long-term warming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts. Published by Elsevier Ltd.
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
