Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.

Abstract: • First model inter-comparison on crop rotations. • Continuous simulation of multi-year crop rotations yields outperformed single-year simulation. • Low accuracy of yield predictions in less commonly modelled crops such as potato, radish, grass vegetation. • Multi-model mean prediction was found to minimise the likely error arising from single-model predictions. • The representation of intermediate crops and carry-over effects in the models require further research efforts.
Diversification of crop rotations is considered an option to increase the resilience of European crop production under climate change. So far, however, many crop simulation studies have focused on predicting single crops in separate one-year simulations. Here, we compared the capability of fifteen crop growth simulation models to predict yields in crop rotations at five sites across Europe under minimal calibration. Crop rotations encompassed 301 seasons of ten crop types common to European agriculture and a diverse set of treatments (irrigation, fertilisation, CO2 concentration, soil types, tillage, residues, intermediate or catch crops). We found that the continuous simulation of multi-year crop rotations yielded results of slightly higher quality compared to the simulation of single years and single crops. Intermediate crops (oilseed radish and grass vegetation) were simulated less accurately than main crops (cereals). The majority of models performed better for the treatments of increased CO2 and nitrogen fertilisation than for irrigation and soil-related treatments. The yield simulation of the multi-model ensemble reduced the error compared to single-model simulations. The low degree of superiority of continuous simulations over single year simulation was caused by (a) insufficiently parameterised crops, which affect the performance of the following crop, and (b) the lack of growth-limiting water and/or nitrogen in the crop rotations under investigation. In order to achieve a sound representation of crop rotations, further research is required to synthesise existing knowledge of the physiology of intermediate crops and of carry-over effects from the preceding to the following crop, and to implement/improve the modelling of processes that condition these effects.