Sanna, M., Bellocchi, G., Fumagalli, M., & Acutis, M. (2015). A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models. Env. Model. Softw., 73, 286–304.
Abstract: The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of “stable correlation”, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools. (C) 2015 Elsevier Ltd. All rights reserved.
|
Grosz, B., Dechow, R., Gebbert, S., Hoffmann, H., Zhao, G., Constantin, J., et al. (2017). The implication of input data aggregation on up-scaling soil organic carbon changes. Env. Model. Softw., 96, 361–377.
Abstract: In up-scaling studies, model input data aggregation is a common method to cope with deficient data availability and limit the computational effort. We analyzed model errors due to soil data aggregation for modeled SOC trends. For a region in North West Germany, gridded soil data of spatial resolutions between 1 km and 100 km has been derived by majority selection. This data was used to simulate changes in SOC for a period of 30 years by 7 biogeochemical models. Soil data aggregation strongly affected modeled SOC trends. Prediction errors of simulated SOC changes decreased with increasing spatial resolution of model output. Output data aggregation only marginally reduced differences of model outputs between models indicating that errors caused by deficient model structure are likely to persist even if requirements on the spatial resolution of model outputs are low. (C)2017 Elsevier Ltd. All rights reserved.
|
Kipling, R. P., Topp, C. F. E., Bannink, A., Bartley, D. J., Blanco-Penedo, I., Cortignani, R., et al. (2019). To what extent is climate change adaptation a novel challenge for agricultural modellers. Env. Model. Softw., 120, Unsp 104492.
Abstract: Modelling is key to adapting agriculture to climate change (CC), facilitating evaluation of the impacts and efficacy of adaptation measures, and the design of optimal strategies. Although there are many challenges to modelling agricultural CC adaptation, it is unclear whether these are novel or, whether adaptation merely adds new motivations to old challenges. Here, qualitative analysis of modellers’ views revealed three categories of challenge: Content, Use, and Capacity. Triangulation of findings with reviews of agricultural modelling and Climate Change Risk Assessment was then used to highlight challenges specific to modelling adaptation. These were refined through literature review, focussing attention on how the progressive nature of CC affects the role and impact of modelling. Specific challenges identified were: Scope of adaptations modelled, Information on future adaptation, Collaboration to tackle novel challenges, Optimisation under progressive change with thresholds, and Responsibility given the sensitivity of future outcomes to initial choices under progressive change.
|
