Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.

Abstract: Grassland-based ruminant production systems are integral to sustainable food production in Europe, converting plant materials indigestible to humans into nutritious food, while providing a range of environmental and cultural benefits. Climate change poses significant challenges for such systems, their productivity and the wider benefits they supply. In this context, grassland models have an important role in predicting and understanding the impacts of climate change on grassland systems, and assessing the efficacy of potential adaptation and mitigation strategies. In order to identify the key challenges for European grassland modelling under climate change, modellers and researchers from across Europe were consulted via workshop and questionnaire. Participants identified fifteen challenges and considered the current state of modelling and priorities for future research in relation to each. A review of literature was undertaken to corroborate and enrich the information provided during the horizon scanning activities. Challenges were in four categories relating to: 1) the direct and indirect effects of climate change on the sward 2) climate change effects on grassland systems outputs 3) mediation of climate change impacts by site, system and management and 4) cross-cutting methodological issues. While research priorities differed between challenges, an underlying theme was the need for accessible, shared inventories of models, approaches and data, as a resource for stakeholders and to stimulate new research. Developing grassland models to effectively support efforts to tackle climate change impacts, while increasing productivity and enhancing ecosystem services, will require engagement with stakeholders and policy-makers, as well as modellers and experimental researchers across many disciplines. The challenges and priorities identified are intended to be a resource 1) for grassland modellers and experimental researchers, to stimulate the development of new research directions and collaborative opportunities, and 2) for policy-makers involved in shaping the research agenda for European grassland modelling under climate change.