Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: We assessed the weather data aggregation effect (DAE) on the simulation of cropping systems for different crops, response variables, and production conditions. Using 13 process-based crop models and the ensemble mean, we simulated 30 yr continuous cropping systems for 2 crops (winter wheat and silage maize) under 3 production conditions for the state of North Rhine-Westphalia, Germany. The DAE was evaluated for 5 weather data resolutions (i.e. 1, 10, 25, 50, and 100 km) for 3 response variables including yield, growing season evapotranspiration, and water use efficiency. Five metrics, viz. the spatial bias (Delta), average absolute deviation (AAD), relative AAD, root mean squared error (RMSE), and relative RMSE, were used to evaluate the DAE on both the input weather data and simulated results. For weather data, we found that data aggregation narrowed the spatial variability but widened the., especially across mountainous areas. The DAE on loss of spatial heterogeneity and hotspots was stronger than on the average changes over the region. The DAE increased when coarsening the spatial resolution of the input weather data. The DAE varied considerably across different models, but changed only slightly for different production conditions and crops. We conclude that if spatially detailed information is essential for local management decision, higher resolution is desirable to adequately capture the spatial variability for heterogeneous regions. The required resolution depends on the choice of the model as well as the environmental condition of the study area.

Abstract: Error propagation within models is an issue that requires a structured approach involving the testing of individual equations and evaluation of the consequences of error creation from imperfect equation and model structure on estimates of interest made by a model. This report briefly covers some of the key issues in error propagation and sets out several concepts, across a range of complexity, that may be used to organise an investigation into error propagation. No Label