Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.

Abstract: At the plot level, crop simulation models such as STICS have the potential to evaluate risk associated with management practices. In nitrogen (N) management, however, the decision-making process is complex because the decision has to be taken without any knowledge of future weather conditions. The objective of this paper is to present a general methodology for assessing yield variability linked to climatic uncertainty and variable N rate strategies. The STICS model was coupled with the LARS-Weather Generator. The Pearson system and coefficients were used to characterise the shape of yield distribution. Alternatives to classical statistical tests were proposed for assessing the normality of distributions and conducting comparisons (namely, the Jarque-Bera and Wilcoxon tests, respectively). Finally, the focus was put on the probability risk assessment, which remains a key point within the decision process. The simulation results showed that, based on current N application practice among Belgian farmers (60-60-60 kgN ha(-1)), yield distribution was very highly significantly non-normal, with the highest degree of asymmetry characterised by a skewness value of -1.02. They showed that this strategy gave the greatest probability (60 %) of achieving yields that were superior to the mean (10.5 t ha(-1)) of the distribution.

Abstract: The diversity in farmers’ objectives and responses to external drivers is usually not considered in integrated assessment studies that investigate impacts and adaptation to climate and socio-economic change. Here, we present an approach to assess how farmers’ stated objectives relate to their currently implemented practices and to preferred adaptation options, and we discuss what this implies for assessments of future changes. We based our approach on a combination of multi-criteria decision-making methods. We consistently assessed the importance of farmers’ objectives and adaptation preferences from what farmers say (based on interviews), from what farmers actually do (by analysing current farm performance) and from what farmers want (through a selected alternative farm plan). Our study was performed for six arable farms in Flevoland, a province in the Netherlands. Based on interviews with farmers, we reduced the long list of possible objectives to the most important ones. The objectives we assessed included maximization of economic result and soil organic matter, and minimization of gross margin variance, working hours and nitrogen balance. In our sample, farmers’ stated preferences in objectives were often not fully reflected in realized farming practices. Adaptation preferences of farmers largely resembled their current performance, but generally involved a trend towards stated preferences. Our results suggest that in Flevoland, although farmers do have more objectives, in practical decision-making they focus on economic result maximization, while for strategic decision-making they account for objectives influencing long-term performance and indicators associated with sustainability, in this case soil organic matter.