Abstract: Highlights
• 14 criteria for use of crop models in assessments of impacts, adaptation and risk • Working with stakeholders to identify timing of risks is key to risk assessments. • Multiple methods needed to critically assess the use of climate model output • Increasing transparency and inter-comparability needed in risk assessments
Abstract
Crop models are used for an increasingly broad range of applications, with a commensurate proliferation of methods. Careful framing of research questions and development of targeted and appropriate methods are therefore increasingly important. In conjunction with the other authors in this special issue, we have developed a set of criteria for use of crop models in assessments of impacts, adaptation and risk. Our analysis drew on the other papers in this special issue, and on our experience in the UK Climate Change Risk Assessment 2017 and the MACSUR, AgMIP and ISIMIP projects. The criteria were used to assess how improvements could be made to the framing of climate change risks, and to outline the good practice and new developments that are needed to improve risk assessment. Key areas of good practice include: i. the development, running and documentation of crop models, with attention given to issues of spatial scale and complexity; ii. the methods used to form crop-climate ensembles, which can be based on model skill and/or spread; iii. the methods used to assess adaptation, which need broadening to account for technological development and to reflect the full range options available. The analysis highlights the limitations of focussing only on projections of future impacts and adaptation options using pre-determined time slices. Whilst this long-standing approach may remain an essential component of risk assessments, we identify three further key components: 1. Working with stakeholders to identify the timing of risks. What are the key vulnerabilities of food systems and what does crop-climate modelling tell us about when those systems are at risk? 2. Use of multiple methods that critically assess the use of climate model output and avoid any presumption that analyses should begin and end with gridded output. 3. Increasing transparency and inter-comparability in risk assessments. Whilst studies frequently produce ranges that quantify uncertainty, the assumptions underlying these ranges are not always clear. We suggest that the contingency of results upon assumptions is made explicit via a common uncertainty reporting format; and/or that studies are assessed against a set of criteria, such as those presented in this paper.

Abstract: While crop models are widely used to assess the change in crop productivity with climate change, their skill in assessing irrigation water demand or the risk of crop failure in large area impact assessments is relatively unknown. The objective of this study is to investigate which aspects of modeling crop water use (reference crop evapotranspiration (ET0), soil water extraction, soil evaporation, soil water balance and root growth) contributes most to the variability in estimates of maize crop water use and the risk of crop failure, and demonstrate the resulting uncertainty in a climate change impact study for Europe. The SIMPLACE crop modeling framework was used to couple the LINTUL5 crop model in factorial combinations of 2-3 different approaches for simulating the 5 aspects of crop water use, resulting in 51 modeling approaches. Using experiments in France and New Zeland, analysis of total sensitivity revealed that ET0 explained the most variability in both irrigated maize water use and rainfed grain yield levels, with soil evaporation also imporatant in the French experiment. In the European impact study, net irrigation requirement differed by 36% between the Penman and Hargreaves ET0 methods in the baseline period. Average EU grain yields were similar between models, but differences approached 1-2 tonnes in parts of France and Southern Europe. EU wide esimates of crop failure in the historical period ranged between 5.4 years for Priestley-Taylor to every 7.9 years for the Penman ET0 methods. While the uncertainty in absolute values between models was significant, estimates of relative changes were similar between models, confirming the utility of crop models in assessing climate change impacts. If ET0 estimates in crop models can be improved, through the use of appropriate methods, uncertainty in irrigation water demand as well as in yield estimates under drought can be reduced.

Abstract: Crop models are important tools for impact assessment of climate change, as well as for  exploring management options under current climate. It is essential to evaluate the  uncertainty associated with predictions of these models. Several ways of quantifying  prediction uncertainty have been explored in the literature, but there have been no  studies of how the different approaches are related to one another, and how they are  related to some overall measure of prediction uncertainty. Here we show that all the  different approaches can be related to two different viewpoints about the model; either  the model is treated as a fixed predictor with some average error, or the model can be  treated as a random variable with uncertainty in one or more of model structure, model  inputs and model parameters. We discuss the differences, and show how mean squared  error of prediction can be estimated in both cases. The results can be used to put  uncertainty estimates into a more general framework and to relate different uncertainty  estimates to one another and to overall prediction uncertainty. This should lead to a  better understanding of crop model prediction uncertainty and the underlying causes of  that uncertainty. This study was published as (Wallach et al. 2016)