Abstract: When evaluating the performances of simulation models, the perception of the quality of the outputs may depend on the statistics used to compare simulated and observed data. In order to have a comprehensive understanding of model performance, the use of a variety of metrics is generally advocated. However, since they may be correlated, the use of two or more metrics may convey the same information, leading to redundancy. This study intends to investigate the interrelationship between evaluation metrics, with the aim of identifying the most useful set of indicators, for assessing simulation performance. Our focus is on agro-ecological modelling. Twenty-three performance indicators were selected to compare simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Indicators were calculated on large data sets, collected to effectively apply correlation analysis techniques. For each variable, the interrelationship between each pair of indicators was evaluated, by computing the Spearman’s rank correlation coefficient. A definition of “stable correlation” was proposed, based on the test of heterogeneity, allowing to assess whether two or more correlation coefficients are equal. An optimal subset of indicators was identified, striking a balance between number of indicators, amount of provided information and information redundancy. They are: Index of Agreement, Squared Bias, Root Mean Squared Relative Error, Pattern Index, Persistence Model Efficiency and Spearman’s Correlation Coefficient. The present study was carried out in the context of CropM-LiveM cross-cutting activities of MACSUR knowledge hub. No Label

Abstract: Grassland-based ruminant production systems are integral to sustainable food production in Europe, converting plant materials indigestible to humans into nutritious food, while providing a range of environmental and cultural benefits. Climate change poses significant challenges for such systems, their productivity and the wider benefits they supply. In this context, grassland models have an important role in predicting and understanding the impacts of climate change on grassland systems, and assessing the efficacy of potential adaptation and mitigation strategies. In order to identify the key challenges for European grassland modelling under climate change, modellers and researchers from across Europe were consulted via workshop and questionnaire. Participants identified fifteen challenges and considered the current state of modelling and priorities for future research in relation to each. A review of literature was undertaken to corroborate and enrich the information provided during the horizon scanning activities. Challenges were in four categories relating to: 1) the direct and indirect effects of climate change on the sward 2) climate change effects on grassland systems outputs 3) mediation of climate change impacts by site, system and management and 4) cross-cutting methodological issues. While research priorities differed between challenges, an underlying theme was the need for accessible, shared inventories of models, approaches and data, as a resource for stakeholders and to stimulate new research. Developing grassland models to effectively support efforts to tackle climate change impacts, while increasing productivity and enhancing ecosystem services, will require engagement with stakeholders and policy-makers, as well as modellers and experimental researchers across many disciplines. The challenges and priorities identified are intended to be a resource 1) for grassland modellers and experimental researchers, to stimulate the development of new research directions and collaborative opportunities, and 2) for policy-makers involved in shaping the research agenda for European grassland modelling under climate change.

Abstract: XC1 has established links to other research activities and consortia on model comparison and improvement. They include the global initiatives AgMIP (http://www.agmip.org ) and GRA (http://www.globalresearchalliance.org), and the EU-FP7 project MODEXTREME (http://modextreme.org ). These links have allowed sharing and communication of recent results and methods, and have created opportunities for future research calls.