Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.

Abstract: • Systematic analysis of the influence of spatial soil data resolution on simulated regional yields and total growing season evapotranspiration. • The responses of four crop models of different complexity are compared. • Differences between models are larger than the effect of the chosen spatial soil data resolution. • Low influence of soil data resolution due to: high precipitation amount, methods for calculating water retention and method of data aggregation. The spatial variability of soil properties is an important driver of yield variability at both field and regional scale. Thus, when using crop growth simulation models, the choice of spatial resolution of soil input data might be key in order to accurately reproduce observed yield variability. In this study we used four crop models (SIMPLACE<LINTUL-SLIM>, DSSAT-CSM, EPIC and DAISY) differing in the detail of modeling above-ground biomass and yield as well as of modeling soil water dynamics, water uptake and drought effects on plants to simulate winter wheat in two (agro-climatologically and geo-morphologically) contrasting regions of the federal state of North-Rhine-Westphalia (Germany) for the period from 1995 to 2008. Three spatial resolutions of soil input data were taken into consideration, corresponding to the following map scales: 1:50 000, 1:300 000 and 1:1 000 000. The four crop models were run for water-limited production conditions and model results were evaluated in the form of frequency distributions, depicted by bean-plots. In both regions, soil data aggregation had very small influence on the shape and range of frequency distributions of simulated yield and simulated total growing season evapotranspiration for all models. Further analysis revealed that the small influence of spatial resolution of soil input data might be related to: (a) the high precipitation amount in the region which partly masked differences in soil characteristics for water holding capacity, (b) the loss of variability in hydraulic soil properties due to the methods applied to calculate water retention properties of the used soil profiles, and (c) the method of soil data aggregation. No characteristic “fingerprint” between sites, years and resolutions could be found for any of the models. Our results support earlier recommendation to evaluate model results on the basis of frequency distributions since these offer quick and better insight into the distribution of simulation results as compared to summary statistics only. Finally, our results support conclusions from other studies about the usefulness of considering a multi-model approach to quantify the uncertainty in simulated yields introduced by the crop growth simulation approach when exploring the effects of scaling for regional yield impact assessments.