Abstract: • We simulate biomass, soil water content (SWC) and temperature (ST) in grasslands. • We compare nine models to the multi-model median (MMM) at nine sites. • With model calibration, we obtain satisfactory estimates of ST, less of SWC and biomass. • We observe discrepancies across models in the simulation of grassland processes. • We improve performance with multi-model approach. This study presents results from a major grassland model intercomparison exercise, and highlights the main challenges faced in the implementation of a multi-model ensemble prediction system in grasslands. Nine, independently developed simulation models linking climate, soil, vegetation and management to grassland biogeochemical cycles and production were compared in a simulation of soil water content (SWC) and soil temperature (ST) in the topsoil, and of biomass production. The results were assessed against SWC and ST data from five observational grassland sites representing a range of conditions – Grillenburg in Germany, Laqueuille in France with both extensive and intensive management, Monte Bondone in Italy and Oensingen in Switzerland – and against yield measurements from the same sites and other experimental grassland sites in Europe and Israel. We present a comparison of model estimates from individual models to the multi-model ensemble (represented by multi-model median: MMM). With calibration (seven out of nine models), the performances were acceptable for weekly-aggregated ST (R² > 0.7 with individual models and >0.8–0.9 with MMM), but less satisfactory with SWC (R² < 0.6 with individual models and < ∼ 0.5 with MMM) and biomass (R² < ∼0.3 with both individual models and MMM). With individual models, maximum biases of about −5 °C for ST, −0.3 m3 m−3 for SWC and 360 g DM m−2 for yield, as well as negative modelling efficiencies and some high relative root mean square errors indicate low model performance, especially for biomass. We also found substantial discrepancies across different models, indicating considerable uncertainties regarding the simulation of grassland processes. The multi-model approach allowed for improved performance, but further progress is strongly needed in the way models represent processes in managed grassland systems.

Abstract: Biophysical models are acknowledged for examining interactions of agro-ecological systems and fostering communication between scientists, managers and the public. As the role of models grows in importance, there is an increase in the need to assess their quality and performance (Bellocchi et al., 2010). However, the heterogeneity of factors influencing model outputs makes it difficult a full assessment of model features. Where models are used with or for stakeholders then model credibility depends not only on the outcomes of well-structured statistical evaluation but also less tangible factors may need to be addressed using complementary deliberative processes. To expand our horizons in the evaluation of crop and grassland models, approaches have been reviewed with emphasis on using combined metrics. Comprehensive evaluation of simulation models was developed to integrate expectations of stakeholders via a weighting system where lower and upper fuzzy bounds are applied to a set of evaluation metrics. A questionnaire-based survey helped understanding the multi-faceted knowledge and experience required and the substantial challenges posed by the deliberative process. MACSUR knowledge hub holds potential to advance in good modelling practice in relation with model evaluation (including access to appropriate software tools), an activity which is frequently neglected in the context of time-limited projects.