Abstract: Robust projections of climate impact on crop growth and productivity by crop models are key to designing effective adaptations to cope with future climate risk. However, current crop models diverge strongly in their climate impact projections. Previous studies tried to compare or improve crop models regarding the impact of one single climate variable. However, this approach is insufficient, considering that crop growth and yield are affected by the interactive impacts of multiple climate change factors and multiple interrelated biophysical processes. Here, a new comprehensive analysis was conducted to look holistically at the reasons why crop models diverge substantially in climate impact projections and to investigate which biophysical processes and knowledge gaps are key factors affecting this uncertainty and should be given the highest priorities for improvement. First, eight barley models and eight climate projections for the 2050s were applied to investigate the uncertainty from crop model structure in climate impact projections for barley growth and yield at two sites: Jokioinen, Finland (Boreal) and Lleida, Spain (Mediterranean). Sensitivity analyses were then conducted on the responses of major crop processes to major climatic variables including temperature, precipitation, irradiation, and CO2, as well as their interactions, for each of the eight crop models. The results showed that the temperature and CO2 relationships in the models were the major sources of the large discrepancies among the models in climate impact projections. In particular, the impacts of increases in temperature and CO2 on leaf area development were identified as the major causes for the large uncertainty in simulating changes in evapotranspiration, above-ground biomass, and grain yield. Our findings highlight that advancements in understanding the basic processes and thresholds by which climate warming and CO2 increases will affect leaf area development, crop evapotranspiration, photosynthesis, and grain formation in contrasting environments are needed for modeling their impacts.

Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.