Abstract: unless local adaptation can ameliorate these impacts. Ensembles of crop simulation models can be useful tools for assessing if proposed adaptation options are capable of achieving target yields, whilst also quantifying the share of uncertainty in the simulated crop impact resulting from the crop models themselves. Although some studies have analysed the influence of ensemble size on model outcomes, the effect of ensemble composition has not yet been properly appraised. Moreover, results and derived recommendations typically rely on averaged ensemble simulation results without accounting sufficiently for the spread of model outcomes. Therefore, we developed an Ensemble Outcome Agreement (EOA) index, which analyses the effect of changes in composition and size of a multi-model ensemble (MME) to evaluate the level of agreement between MME outcomes with respect to a given hypothesis (e.g. that adaptation measures result in positive crop responses). We analysed the recommendations of a previous study performed with an ensemble of 17 crop models and testing 54 adaptation options for rainfed winter wheat (Triticum aestivwn L.) at Lleida (NE Spain) under perturbed conditions of temperature, precipitation and atmospheric CO2 concentration. Our results confirmed that most adaptations recommended in the previous study have a positive effect. However, we also showed that some options did not remain recommendable in specific conditions if different ensembles were considered. Using EOA, we were able to identify the adaptation options for which there is high confidence in their effectiveness at enhancing yields, even under severe climate perturbations. These include substituting spring wheat for winter wheat combined with earlier sowing dates and standard or longer duration cultivars, or introducing supplementary irrigation, the latter increasing EOA values in all cases. There is low confidence in recovering yields to baseline levels, although this target could be attained for some adaptation options under moderate climate perturbations. Recommendations derived from such robust results may provide crucial information for stakeholders seeking to implement adaptation measures.

Abstract: Highlights
• 14 criteria for use of crop models in assessments of impacts, adaptation and risk • Working with stakeholders to identify timing of risks is key to risk assessments. • Multiple methods needed to critically assess the use of climate model output • Increasing transparency and inter-comparability needed in risk assessments
Abstract
Crop models are used for an increasingly broad range of applications, with a commensurate proliferation of methods. Careful framing of research questions and development of targeted and appropriate methods are therefore increasingly important. In conjunction with the other authors in this special issue, we have developed a set of criteria for use of crop models in assessments of impacts, adaptation and risk. Our analysis drew on the other papers in this special issue, and on our experience in the UK Climate Change Risk Assessment 2017 and the MACSUR, AgMIP and ISIMIP projects. The criteria were used to assess how improvements could be made to the framing of climate change risks, and to outline the good practice and new developments that are needed to improve risk assessment. Key areas of good practice include: i. the development, running and documentation of crop models, with attention given to issues of spatial scale and complexity; ii. the methods used to form crop-climate ensembles, which can be based on model skill and/or spread; iii. the methods used to assess adaptation, which need broadening to account for technological development and to reflect the full range options available. The analysis highlights the limitations of focussing only on projections of future impacts and adaptation options using pre-determined time slices. Whilst this long-standing approach may remain an essential component of risk assessments, we identify three further key components: 1. Working with stakeholders to identify the timing of risks. What are the key vulnerabilities of food systems and what does crop-climate modelling tell us about when those systems are at risk? 2. Use of multiple methods that critically assess the use of climate model output and avoid any presumption that analyses should begin and end with gridded output. 3. Increasing transparency and inter-comparability in risk assessments. Whilst studies frequently produce ranges that quantify uncertainty, the assumptions underlying these ranges are not always clear. We suggest that the contingency of results upon assumptions is made explicit via a common uncertainty reporting format; and/or that studies are assessed against a set of criteria, such as those presented in this paper.