Abstract: The most common way to evaluate simulation models is to quantify the agreement between observations and simulations via statistical metrics such as the root mean squared error and the linear regression coefficient of determination. It is agreed that the aggregation of metrics of different nature intro integrated indicators offers a valuable way to assess models. Expanded notions of model evaluation that have recently emerged, based on the trade-off between properties of the model and agreement between predictions and actual data under contrasting conditions, integrate sensitivity analysis measures and information criteria for model selection, as well as concepts of model robustness, and point to expert judgments to explore the importance of different metrics. As a FACCE MACSUR CropM-LiveM action, a composite indicator (MQIm: Model Quality Indicator for multi-site assessment) was elaborated, by a group of specialists, on metrics commonly used to evaluate crop models (with extension to grassland models) while also integrating aspects of model complexity and stability of performances. The indicator, based on fuzzy bounds applied to a set of weighed metrics, was first revised by a broader group of modellers and then assessed via questionnaire survey of scientists and end-users. We document a crop model evaluation in Europe and assess to what extent the MQIm reflects the main components of model quality and supports inferences about model performances. No Label

Abstract: The dairy sector may expand by over 2% per annum with expiration of the milk quota system in countries with a major and intensive dairy sector. Such expansion will increase pressure to further reduce on-farm nitrogenous emission per unit of milk produced even more. A straightforward N-reducing measure is the manipulation of the cow diet resulting in a lower excretion of ammoniacal N excreted with urine in particular. However, dietary N-reducing measures also affect enteric methane emissions and P excretion. For an integral evaluation of the consequences of N-reducing dietary measures on on-farm emissions, the trade-offs between N emissions and P and methane emissions at the cow level need to be taken into account. Therefore, a simulation study was performed to simulate the consequence of various N-reducing and/or P-reducing dietary measures (altered grassland management, grass silage replaced by low-N feeds, increased concentrate allowance) on enteric methane emission and on N and P excretion. Results indicate a large scattering, but there was a trend of higher methane emissions with lower N excretion was significant. Specific measures had a synergistic effect on emissions such as the exchange of maize for grass silage. The present detailed model evaluations may aid in quantifying the extent of trade-offs between various types of emissions at the cow level, but also prove to be relevant when evaluating consequences of management options taken at the farm scale. No Label