Abstract: The success of using agro-ecosystem models for the high-resolution simulation of agricultural yields for larger areas is often hampered by a lack of input data. We investigated the effect of different spatially resolved soil and weather data used as input for the MONICA model on its ability to reproduce winter wheat yields in the Federal State of Thuringia, Germany (16,172 km(2)). The combination of one representative soil and one weather station was insufficient to reproduce the observed mean yield of 6.66 +/- 0.87 t ha(-1) for the federal state. Use of a 100 m x 100 m grid of soil and relief information combined with just one representative weather station yielded a good estimator (7.01 +/- 1.47 t ha(-1)). The soil and relief data grid used in combination with weather information from 14 weather stations in a nearest neighbour approach produced even better results (6.60 +/- 1.37 t ha(-1)); the same grid used with 39 additional rain gauges and an interpolation algorithm that included an altitude correction of temperature data slightly overpredicted the observed mean (7.36 +/- 1.17 t ha(-1)). It was concluded that the apparent success of the first two high-resolution approaches over the latter was based on two effects that cancelled each other out: the calibration of MONICA to match high-yield experimental data and the growth-defining and -limiting effect of weather data that is not representative for large parts of the region. At the county and farm level the MONICA model failed to reproduce the 1992-2010 time series of yields, which is partly explained by the fact that many growth-reducing factors were not considered in the model. (C) 2013 Elsevier B.V. All rights reserved.

Abstract: The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of “stable correlation”, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools. (C) 2015 Elsevier Ltd. All rights reserved.

Abstract: The aim of this paper is to provide a critical analysis of the strengths and weaknesses of a non-standardised Model Requirements Analysis (MRA) used for the purpose of developing the Sustainability Impact Assessment Tool (SIAT). By ‘non-standardised’ we mean not strictly following a published MRA method. The underlying question we are interested in addressing is how non-standardised methods, often employed in research driven projects, compare to defined methods with more standardised structure, with regards their ability to capture model requirements effectively, and with regards their overall usability. Through describing and critically assessing the specific features of the non-standardised MRA employed, the ambition of this paper is to provide insights useful for impact assessment tool (IAT) development. Specifically, the paper will (i) characterise kinds of user requirements relevant to the functionality and design of IATs; (ii) highlight the strengths and weaknesses of non-standardised MRA for user requirements capture, analysis and reflection in the context of IAT; (iii) critically reflect on the process and outcomes of having used a non-standardised MRA in comparison with other more standardised approaches. To accomplish these aims, we first review methods available for IAT development before describing the SIAT development process, including the MRA employed. Major strengths and weaknesses of the MRA method are then discussed in terms of user identification and characterisation, organisational characterisation and embedding, and ability to capture design options for ensuring usability and usefulness. A detailed assessment on the structural differences of MRA with two advanced approaches (Integrated DSS design and goal directed design) and their role in performance of the MRA tool is used to critique the approach employed. The results show that MRA is able to bring thematic integration, establish system performance and technical thresholds as well as detailing quality and transparency guidelines. Nevertheless the discussion points out to a number of deficiencies in application – (i) a need to more effectively characterise potential users, and; (ii) a need to better foster communication among the distinguished roles in the development process. If addressed these deficiencies, SIAT non-standardised MRA could have brought out better outcomes in terms of tool usability and usefulness, and improved embedding of the tool into conditions of targeted end-users. (C) 2013 Elsevier Ltd. All rights reserved.