Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Abstract: We consider predictions of the impact of climate warming on rice development times in Sri Lanka. The major emphasis is on the uncertainty of the predictions, and in particular on the estimation of mean squared error of prediction. Three contributions to mean squared error are considered. The first is parameter uncertainty that results from model calibration. To take proper account of the complex data structure, generalized least squares is used to estimate the parameters and the variance-covariance matrix of the parameter estimators. The second contribution is model structure uncertainty, which we estimate using two different models. An ANOVA analysis is used to separate the contributions of parameter and model uncertainty to mean squared error. The third contribution is model error, which is estimated using hindcasts. Mean squared error of prediction of time from emergence to maturity, for baseline +2 °C, is estimated as 108 days2, with model error contributing 86 days2, followed by model structure uncertainty which contributes 15 days2 and parameter uncertainty which contributes 7 days2. We also show how prediction uncertainty is reduced if prediction concerns development time averaged over years, or the difference in development time between baseline and warmer temperatures.