Abstract: While crop models are widely used to assess the change in crop productivity with climate change, their skill in assessing irrigation water demand or the risk of crop failure in large area impact assessments is relatively unknown. The objective of this study is to investigate which aspects of modeling crop water use (reference crop evapotranspiration (ET0), soil water extraction, soil evaporation, soil water balance and root growth) contributes most to the variability in estimates of maize crop water use and the risk of crop failure, and demonstrate the resulting uncertainty in a climate change impact study for Europe. The SIMPLACE crop modeling framework was used to couple the LINTUL5 crop model in factorial combinations of 2-3 different approaches for simulating the 5 aspects of crop water use, resulting in 51 modeling approaches. Using experiments in France and New Zeland, analysis of total sensitivity revealed that ET0 explained the most variability in both irrigated maize water use and rainfed grain yield levels, with soil evaporation also imporatant in the French experiment. In the European impact study, net irrigation requirement differed by 36% between the Penman and Hargreaves ET0 methods in the baseline period. Average EU grain yields were similar between models, but differences approached 1-2 tonnes in parts of France and Southern Europe. EU wide esimates of crop failure in the historical period ranged between 5.4 years for Priestley-Taylor to every 7.9 years for the Penman ET0 methods. While the uncertainty in absolute values between models was significant, estimates of relative changes were similar between models, confirming the utility of crop models in assessing climate change impacts. If ET0 estimates in crop models can be improved, through the use of appropriate methods, uncertainty in irrigation water demand as well as in yield estimates under drought can be reduced.

Abstract: Highlights
• 14 criteria for use of crop models in assessments of impacts, adaptation and risk • Working with stakeholders to identify timing of risks is key to risk assessments. • Multiple methods needed to critically assess the use of climate model output • Increasing transparency and inter-comparability needed in risk assessments
Abstract
Crop models are used for an increasingly broad range of applications, with a commensurate proliferation of methods. Careful framing of research questions and development of targeted and appropriate methods are therefore increasingly important. In conjunction with the other authors in this special issue, we have developed a set of criteria for use of crop models in assessments of impacts, adaptation and risk. Our analysis drew on the other papers in this special issue, and on our experience in the UK Climate Change Risk Assessment 2017 and the MACSUR, AgMIP and ISIMIP projects. The criteria were used to assess how improvements could be made to the framing of climate change risks, and to outline the good practice and new developments that are needed to improve risk assessment. Key areas of good practice include: i. the development, running and documentation of crop models, with attention given to issues of spatial scale and complexity; ii. the methods used to form crop-climate ensembles, which can be based on model skill and/or spread; iii. the methods used to assess adaptation, which need broadening to account for technological development and to reflect the full range options available. The analysis highlights the limitations of focussing only on projections of future impacts and adaptation options using pre-determined time slices. Whilst this long-standing approach may remain an essential component of risk assessments, we identify three further key components: 1. Working with stakeholders to identify the timing of risks. What are the key vulnerabilities of food systems and what does crop-climate modelling tell us about when those systems are at risk? 2. Use of multiple methods that critically assess the use of climate model output and avoid any presumption that analyses should begin and end with gridded output. 3. Increasing transparency and inter-comparability in risk assessments. Whilst studies frequently produce ranges that quantify uncertainty, the assumptions underlying these ranges are not always clear. We suggest that the contingency of results upon assumptions is made explicit via a common uncertainty reporting format; and/or that studies are assessed against a set of criteria, such as those presented in this paper.

Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.