Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.

Abstract: The European Union Effort Sharing Regulation (ESR) will require a 30% reduction in greenhouse gas (GHG) emissions by 2030 compared with 2005 from the sectors not included in the European Emissions Trading Scheme, including agriculture. This will require the estimation of current and future emissions from agriculture, including dairy cattle production systems. Using a farm-scale model as part of a Tier 3 method for farm to national scales provides a more holistic and informative approach than IPCC (2006) Tier 2 but requires independent quality control. Comparing the results of using models to simulate a range of scenarios that explore an appropriate range of biophysical and management situations can support this process by providing a framework for placing model results in context. To assess the variation between models and the process of understanding differences, estimates of GHG emissions from four farm-scale models (DailyWise, FarmAC, HolosNor and SFARMMOD) were calculated for eight dairy farming scenarios within a factorial design consisting of two climates (cool/dry and warm/wet) x two soil types (sandy and clayey) x two feeding systems (grass only and grass/maize). The milk yield per cow, follower cow ratio, manure management system, nitrogen (N) fertilisation and land area were standardised for all scenarios in order to associate the differences in the results with the model structure and function. Potential yield and application of available N in fertiliser and manure were specified separately for grass and maize. Significant differences between models were found in GHG emissions at the farm-scale and for most contributory sources, although there was no difference in the ranking of source magnitudes. The farm-scale GHG emissions, averaged over the four models, was 10.6 t carbon dioxide equivalents (CO(2)e)/ha per year, with a range of 1.9 t CO(2)e/ha per year. Even though key production characteristics were specified in the scenarios, there were still significant differences between models in the annual milk production per ha and the amounts of N fertiliser and concentrate feed imported. This was because the models differed in their description of biophysical responses and feedback mechanisms, and in the extent to which management functions were internalised. We conclude that comparing the results of different farm-scale models when applied to a range of scenarios would build confidence in their use in achieving ESR targets, justifying further investment in the development of a wider range of scenarios and software tools.