Abstract: Crop growth simulation models can differ greatly in their treatment of key processes and hence in their response to environmental conditions. Here, we used an ensemble of 26 process-based wheat models applied at sites across a European transect to compare their sensitivity to changes in temperature (−2 to +9°C) and precipitation (−50 to +50%). Model results were analysed by plotting them as impact response surfaces (IRSs), classifying the IRS patterns of individual model simulations, describing these classes and analysing factors that may explain the major differences in model responses.   The model ensemble was used to simulate yields of winter and spring wheat at sites in Finland, Germany and Spain. Results were plotted as IRSs that show changes in yields relative to the baseline with respect to temperature and precipitation. IRSs of 30-year means and selected extreme years were classified using two approaches describing their pattern.   The expert diagnostic approach (EDA) combines two aspects of IRS patterns: location of the maximum yield (nine classes, Figure 1) and strength of the yield response with respect to climate (four classes), resulting in a total of 36 combined classes defined using criteria pre-specified by experts. The statistical diagnostic approach (SDA) groups IRSs by comparing their pattern and magnitude, without attempting to interpret these features. It applies a hierarchical clustering method, grouping response patterns using a distance metric that combines the spatial correlation and Euclidian distance between IRS pairs. The two approaches were used to investigate whether different patterns of yield response could be related to different properties of the crop models, specifically their genealogy, calibration and process description.   Although no single model property across a large model ensemble was found to explain the integrated yield response to temperature and precipitation perturbations, the application of the EDA and SDA approaches revealed their capability to distinguish: (i) stronger yield responses to precipitation for winter wheat than spring wheat; (ii) differing strengths of response to climate changes for years with anomalous weather conditions compared to period-average conditions; (iii) the influence of site conditions on yield patterns; (iv) similarities in IRS patterns among models with related genealogy; (v) similarities in IRS patterns for models with simpler process descriptions of root growth and water uptake compared to those with more complex descriptions; and (vi) a closer correspondence of IRS patterns in models using partitioning schemes to represent yield formation than in those using a harvest index.   Such results can inform future crop modelling studies that seek to exploit the diversity of multi-model ensembles, by distinguishing ensemble members that span a wide range of responses as well as those that display implausible behaviour or strong mutual similarities.   The full manuscript of this study is currently under revision (Fronzek et al. 2017).

Abstract: Data of diverse crop rotations from five locations across Europe were distributed to modelers to investigate the capability of models to handle complex crop rotations and management interactions. Crop rotations comprise various main crops (winter/spring wheat, winter/spring barley, rye, oat, maize, sugar beet, oil seed rape and potatoes) plus several catch crops. The experimental setup of the datasets included treatments such as modified soils, crops exchanged within the rotations, irrigation/rainfed, nitrogen fertilization, residue management, tillage and atmospheric CO2 concentration. 19 modeling teams registered to model either the whole rotation or single crops. Models which are capable to run the whole rotation should provide transient as well as single year simulations with a reset of initial conditions. In the first step only initial soil conditions (water and soil mineral N) of the first year and key phenological stages were provided to the modelers. For calibration, crop yields and biomass were provided for selected years but not for all seasons. In total the combination of treatments and seasons results in 301 years of simulation. Results were analyzed to evaluate the effect of transient simulation versus single-year simulation regarding crop yield, biomass, water and nitrogen balance components. Model results will be evaluated crop-specifically to identify crops with highest uncertainty and potential for model improvement. Full data will be provided to modelers for model-improvement and results will provide insights into model capabilities to reproduce treatments and crops. Further, the question of error propagation along the transient simulation of crop rotations will be addressed.

Abstract: Croplands and grasslands are agricultural systems that contribute to land–atmosphere exchanges of carbon (C). We evaluated and compared gross primary production (GPP), ecosystem respiration (RECO), net ecosystem exchange (NEE) of CO2, and two derived outputs – C use efficiency (CUE=-NEE/GPP) and C emission intensity (IntC= -NEE/Offtake [grazed or harvested biomass]). The outputs came from 23 models (11 crop-specific, eight grassland-specific, and four models covering both systems) at three cropping sites over several rotations with spring and winter cereals, soybean and rapeseed in Canada, France and India, and two temperate permanent grasslands in France and the United Kingdom. The models were run independently over multi-year simulation periods in five stages (S), either blind with no calibration and initialization data (S1), using historical management and climate for initialization (S2), calibrated against plant data (S3), plant and soil data together (S4), or with the addition of C and N fluxes (S5). Here, we provide a framework to address methodological uncertainties and contextualize results. Most of the models overestimated or underestimated the C fluxes observed during the growing seasons (or the whole years for grasslands), with substantial differences between models. For each simulated variable, changes in the multi-model median (MMM) from S1 to S5 was used as a descriptor of the ensemble performance. Overall, the greatest improvements (MMM approaching the mean of observations) were achieved at S3 or higher calibration stages. For instance, grassland GPP MMM was equal to 1632 g C m−2 yr-1 (S5) while the observed mean was equal to 1763 m-2 yr-1 (average for two sites). Nash-Sutcliffe modelling efficiency coefficients indicated that MMM outperformed individual models in 92.3 % of cases. Our study suggests a cautious use of large-scale, multi-model ensembles to estimate C fluxes in agricultural sites if some site-specific plant and soil observations are available for model calibration. The further development of crop/grassland ensemble modelling will hinge upon the interpretation of results in light of the way models represent the processes underlying C fluxes in complex agricultural systems (grassland and crop rotations including fallow periods).