Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.

Abstract: Justifiable usage of large-scale crop model simulations requires transparent, comprehensive and spatially extensive evaluations of their performance and associated accuracy. Simulated crop yields of a Pan-European implementation of the Environmental Policy Integrated Climate (EPIC) crop model were satisfactorily evaluated with reported regional yield data from EUROSTAT for four major crops, including winter wheat, rainfed and irrigated maize, spring barley and winter rye. European-wide land use, elevation, soil and daily meteorological gridded data were integrated in GIS and coupled with EPIC. Default EPIC crop and biophysical process parameter values were used with some minor adjustments according to suggestions from scientific literature. The model performance was improved by spatial calculations of crop sowing densities, potential heat units, operation schedules, and nutrient application rates. EPIC performed reasonable in the simulation of regional crop yields, with long-term averages predicted better than inter-annual variability: linear regression R-2 ranged from 0.58 (maize) to 0.91 (spring barley) and relative estimation errors were between +/- 30% for most of the European regions. The modelled and reported crop yields demonstrated similar responses to driving meteorological variables. However, EPIC performed better in dry compared to wet years. A yield sensitivity analysis of crop nutrient and irrigation management factors and cultivar specific characteristics for contrasting regions in Europe revealed a range in model response and attainable yields. We also show that modelled crop yield is strongly dependent on the chosen PET method. The simulated crop yield variability was lower compared to reported crop yields. This assessment should contribute to the availability of harmonised and transparently evaluated agricultural modelling tools in the EU as well as the establishment of modelling benchmarks as a requirement for sound and ongoing policy evaluations in the agricultural and environmental domains. (C) 2013 The Authors. Published by Elsevier Ltd. All rights reserved.

Abstract: Crop models are essential tools for assessing the threat of climate change to local and global food production1. Present models used to predict wheat grain yield are highly uncertain when simulating how crops respond to temperature2. Here we systematically tested 30 different wheat crop models of the Agricultural Model Intercomparison and Improvement Project against field experiments in which growing season mean temperatures ranged from 15 °C to 32 °C, including experiments with artificial heating. Many models simulated yields well, but were less accurate at higher temperatures. The model ensemble median was consistently more accurate in simulating the crop temperature response than any single model, regardless of the input information used. Extrapolating the model ensemble temperature response indicates that warming is already slowing yield gains at a majority of wheat-growing locations. Global wheat production is estimated to fall by 6% for each °C of further temperature increase and become more variable over space and time.