Abstract: Crop growth simulation models can differ greatly in their treatment of key processes and hence in their response to environmental conditions. Here, we used an ensemble of 26 process-based wheat models applied at sites across a European transect to compare their sensitivity to changes in temperature (−2 to +9°C) and precipitation (−50 to +50%). Model results were analysed by plotting them as impact response surfaces (IRSs), classifying the IRS patterns of individual model simulations, describing these classes and analysing factors that may explain the major differences in model responses.   The model ensemble was used to simulate yields of winter and spring wheat at sites in Finland, Germany and Spain. Results were plotted as IRSs that show changes in yields relative to the baseline with respect to temperature and precipitation. IRSs of 30-year means and selected extreme years were classified using two approaches describing their pattern.   The expert diagnostic approach (EDA) combines two aspects of IRS patterns: location of the maximum yield (nine classes, Figure 1) and strength of the yield response with respect to climate (four classes), resulting in a total of 36 combined classes defined using criteria pre-specified by experts. The statistical diagnostic approach (SDA) groups IRSs by comparing their pattern and magnitude, without attempting to interpret these features. It applies a hierarchical clustering method, grouping response patterns using a distance metric that combines the spatial correlation and Euclidian distance between IRS pairs. The two approaches were used to investigate whether different patterns of yield response could be related to different properties of the crop models, specifically their genealogy, calibration and process description.   Although no single model property across a large model ensemble was found to explain the integrated yield response to temperature and precipitation perturbations, the application of the EDA and SDA approaches revealed their capability to distinguish: (i) stronger yield responses to precipitation for winter wheat than spring wheat; (ii) differing strengths of response to climate changes for years with anomalous weather conditions compared to period-average conditions; (iii) the influence of site conditions on yield patterns; (iv) similarities in IRS patterns among models with related genealogy; (v) similarities in IRS patterns for models with simpler process descriptions of root growth and water uptake compared to those with more complex descriptions; and (vi) a closer correspondence of IRS patterns in models using partitioning schemes to represent yield formation than in those using a harvest index.   Such results can inform future crop modelling studies that seek to exploit the diversity of multi-model ensembles, by distinguishing ensemble members that span a wide range of responses as well as those that display implausible behaviour or strong mutual similarities.   The full manuscript of this study is currently under revision (Fronzek et al. 2017).

Abstract: We assessed the weather data aggregation effect (DAE) on the simulation of cropping systems for different crops, response variables, and production conditions. Using 13 process-based crop models and the ensemble mean, we simulated 30 yr continuous cropping systems for 2 crops (winter wheat and silage maize) under 3 production conditions for the state of North Rhine-Westphalia, Germany. The DAE was evaluated for 5 weather data resolutions (i.e. 1, 10, 25, 50, and 100 km) for 3 response variables including yield, growing season evapotranspiration, and water use efficiency. Five metrics, viz. the spatial bias (Delta), average absolute deviation (AAD), relative AAD, root mean squared error (RMSE), and relative RMSE, were used to evaluate the DAE on both the input weather data and simulated results. For weather data, we found that data aggregation narrowed the spatial variability but widened the., especially across mountainous areas. The DAE on loss of spatial heterogeneity and hotspots was stronger than on the average changes over the region. The DAE increased when coarsening the spatial resolution of the input weather data. The DAE varied considerably across different models, but changed only slightly for different production conditions and crops. We conclude that if spatially detailed information is essential for local management decision, higher resolution is desirable to adequately capture the spatial variability for heterogeneous regions. The required resolution depends on the choice of the model as well as the environmental condition of the study area.

Abstract: We show the error in water-limited yields simulated by crop models which is associated with spatially aggregated soil and climate input data. Crop simulations at large scales (regional, national, continental) frequently use input data of low resolution. Therefore, climate and soil data are often generated via averaging and sampling by area majority. This may bias simulated yields at large scales, varying largely across models. Thus, we evaluated the error associated with spatially aggregated soil and climate data for 14 crop models. Yields of winter wheat and silage maize were simulated under water-limited production conditions. We calculated this error from crop yields simulated at spatial resolutions from 1 to 100 km for the state of North Rhine-Westphalia, Germany. Most models showed yields biased by <15% when aggregating only soil data. The relative mean absolute error (rMAE) of most models using aggregated soil data was in the range or larger than the inter-annual or inter-model variability in yields. This error increased further when both climate and soil data were aggregated. Distinct error patterns indicate that the rMAE may be estimated from few soil variables. Illustrating the range of these aggregation effects across models, this study is a first step towards an ex-ante assessment of aggregation errors in large-scale simulations.