Kersebaum, K. C., Boote, K. J., Jorgenson, J. S., Nendel, C., Bindi, M., Frühauf, C., et al. (2015). Analysis and classification of data sets for calibration and validation of agro-ecosystem models. Env. Model. Softw., 72, 402–417.
Abstract: Experimental field data are used at different levels of complexity to calibrate, validate and improve agroecosystem models to enhance their reliability for regional impact assessment. A methodological framework and software are presented to evaluate and classify data sets into four classes regarding their suitability for different modelling purposes. Weighting of inputs and variables for testing was set from the aspect of crop modelling. The software allows users to adjust weights according to their specific requirements. Background information is given for the variables with respect to their relevance for modelling and possible uncertainties. Examples are given for data sets of the different classes. The framework helps to assemble high quality data bases, to select data from data bases according to modellers requirements and gives guidelines to experimentalists for experimental design and decide on the most effective measurements to improve the usefulness of their data for modelling, statistical analysis and data assimilation. (C) 2015 Elsevier Ltd. All rights reserved.
|
Ewert, F., Rötter, R. P., Bindi, M., Webber, H., Trnka, M., Kersebaum, K. C., et al. (2015). Crop modelling for integrated assessment of risk to food production from climate change. Env. Model. Softw., 72, 287–303.
Abstract: The complexity of risks posed by climate change and possible adaptations for crop production has called for integrated assessment and modelling (IAM) approaches linking biophysical and economic models. This paper attempts to provide an overview of the present state of crop modelling to assess climate change risks to food production and to which extent crop models comply with IAM demands. Considerable progress has been made in modelling effects of climate variables, where crop models best satisfy IAM demands. Demands are partly satisfied for simulating commonly required assessment variables. However, progress on the number of simulated crops, uncertainty propagation related to model parameters and structure, adaptations and scaling are less advanced and lagging behind IAM demands. The limitations are considered substantial and apply to a different extent to all crop models. Overcoming these limitations will require joint efforts, and consideration of novel modelling approaches.
|
Houska, T., Kraft, P., Liebermann, R., Klatt, S., Kraus, D., Haas, E., et al. (2017). Rejecting hydro-biogeochemical model structures by multi-criteria evaluation. Env. Model. Softw., 93, 1–12.
Abstract: Highlights • New method to investigate biogeochemical model structure performance. • Process based hydrological modelling can improve biogeochemical model predictions. • Modelling efficiency dramatically drops with multiple objectives. Abstract This work presents a novel way for assessing and comparing different hydro-biogeochemical model structures and their performances. We used the LandscapeDNDC modelling framework to set up four models of different complexity, considering two soil-biogeochemical and two hydrological modules. The performance of each model combination was assessed using long-term (8 years) data and applying different thresholds, considering multiple criteria and objective functions. Our results show that each model combination had its strength for particular criteria. However, only 0.01% of all model runs passed the complete rejectionist framework. In contrast, our comparatively applied assessments of single thresholds, as frequently used in other studies, lead to a much higher acceptance rate of 40–70%. Therefore, our study indicates that models can be right for the wrong reasons, i.e., matching GHG emissions while at the same time failing to simulate other criteria such as soil moisture or plant biomass dynamics.
|
Grosz, B., Dechow, R., Gebbert, S., Hoffmann, H., Zhao, G., Constantin, J., et al. (2017). The implication of input data aggregation on up-scaling soil organic carbon changes. Env. Model. Softw., 96, 361–377.
Abstract: In up-scaling studies, model input data aggregation is a common method to cope with deficient data availability and limit the computational effort. We analyzed model errors due to soil data aggregation for modeled SOC trends. For a region in North West Germany, gridded soil data of spatial resolutions between 1 km and 100 km has been derived by majority selection. This data was used to simulate changes in SOC for a period of 30 years by 7 biogeochemical models. Soil data aggregation strongly affected modeled SOC trends. Prediction errors of simulated SOC changes decreased with increasing spatial resolution of model output. Output data aggregation only marginally reduced differences of model outputs between models indicating that errors caused by deficient model structure are likely to persist even if requirements on the spatial resolution of model outputs are low. (C)2017 Elsevier Ltd. All rights reserved.
|
Sanna, M., Bellocchi, G., Fumagalli, M., & Acutis, M. (2015). A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models. Env. Model. Softw., 73, 286–304.
Abstract: The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of “stable correlation”, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools. (C) 2015 Elsevier Ltd. All rights reserved.
|