Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

Abstract: Within the context of nitrogen (N) management, since 1950, with the rapid intensification of agriculture, farmers have often applied much larger fertiliser quantities than what was required to reach the yield potential. However, to prevent pollution of surface and groundwater induced by nitrates, The European Community launched The European Nitrates Directive 91/6/76/EEC. In 2002, in Wallonia (Belgium), the Nitrates Directive has been transposed under the Sustainable Nitrogen Management in Agriculture Program (PGDA), with the aim of maintaining productivity and revenue for the country’s farmers, while reducing the environmental impact of excessive N application. A feasible approach for addressing climatic uncertainty lies in the use of crop models such as the one commonly known as STICS (simulateur multidisciplinaire pour les cultures standard). These models allow the impact on crops of the interaction between cropping systems and climatic records to be assessed. Comprehensive historical climatic records are rare, however, and therefore the yield distribution values obtained using such an approach can be discontinuous. In order to obtain better and more detailed yield distribution information, the use of a high number of stochastically generated climate time series was proposed, relying on the LARS-Weather Generator. The study focused on the interactions between varying N practices and climatic conditions. Historically and currently, Belgian farmers apply 180 kg N ha(-1), split into three equal fractions applied at the tillering, stem elongation and flag-leaf stages. This study analysed the effectiveness of this treatment in detail, comparing it to similar practices where only the N rates applied at the flag-leaf stage were modified. Three types of farmer decision-making were analysed. The first related to the choice of N strategy for maximising yield, the second to obtaining the highest net revenue, and the third to reduce the environmental impact of potential N leaching, which carries the likelihood of taxation if inappropriate N rates are applied. The results showed reduced discontinuity in the yield distribution values thus obtained. In general, the modulation of N levels to accord with current farmer practices showed considerable asymmetry. In other words, these practices maximised the probability of achieving yields that were at least superior to the mean of the distribution values, thus reducing risk for the farmers. The practice based on applying the highest amounts (60-60-100 kg N ha(-1)) produced the best yield distribution results. When simple economical criteria were computed, the 60-60-80 kg N ha(-1) protocol was found to be optimal for 80-90% of the time. There were no statistical differences, however, between this practice and Belgian farmers’ current practice. When the taxation linked to a high level of potentially leachable N remaining in the soil after harvest was considered, this methodology clearly showed that, in 3 years out of 4,30 kg N ha(-1) could systematically be saved in comparison with the usual practice.

Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.