Crout, N. M. J., Craigon, J., Cox, G. M., Jao, Y., Tarsitano, D., Wood, A. T. A., et al. (2014). An objective approach to model reduction: Application to the Sirius wheat model. Agricultural and Forest Meteorology, 189-190(100), 211–219.
Abstract: An existing simulation model of wheat growth and development, Sirius, was evaluated through a systematic model reduction procedure. The model was automatically manipulated under software control to replace variables within the model structure with constants, individually and in combination. Predictions of the resultant models were compared to growth analysis observations of total biomass, grain yield, and canopy leaf area derived from 9 trials conducted in the UK and New Zealand under optimal, nitrogen limiting and drought conditions. Model performance in predicting these observations was compared in order to evaluate whether individual model variables contributed positively to the overall prediction. Of the 1 1 1 model variables considered 16 were identified as potentially redundant. Areas of the model where there was evidence of redundancy were: (a) translocation of biomass carbon to grain; (b) nitrogen physiology; (c) adjustment of air temperature for various modelled processes; (d) allowance for diurnal variation in temperature; (e) vernalisation (f) soil nitrogen mineralisation (g) soil surface evaporation. It is not suggested that these are not important processes in real crops, rather, that their representation in the model cannot be justified in the context of the analysis. The approach described is analogous to a detailed model inter-comparison although it would be better described as a model intra-comparison as it is based on the comparison of many simplified forms of the same model. The approach provides automation to increase the efficiency of the evaluation and a systematic means of increasing the rigour of the evaluation.
|
Wallach, D., Mearns, L. O., Ruane, A. C., Rötter, R. P., & Asseng, S. (2016). Lessons from climate modeling on the design and use of ensembles for crop modeling. Clim. Change, .
Abstract: Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.
|
Bindi, M., Palosuo, T., Trnka, M., & Semenov, M. A. (2015). Modelling climate change impacts on crop production for food security INTRODUCTION. Clim. Res., 65, 3–5.
Abstract: Process-based crop models that synthesise the latest scientific understanding of biophysical processes are currently the primary scientific tools available to assess potential impacts of climate change on crop production. Important obstacles are still present, however, and must be overcome for improving crop modelling application in integrated assessments of risk, of sustainability and of crop-production resilience in the face of climate change (e.g. uncertainty analysis, model integration, etc.). The research networks MACSUR and AGMIP organised the CropM International Symposium and Workshop in Oslo, on 10-12 February 2014, and present this CR Special, discussing the state-of-the-art-as well as future perspectives-of crop modelling applications in climate change risk assessment, including the challenges of integrated assessments for the agricultural sector.
|
Ruane, A. C., Hudson, N. I., Asseng, S., Camarrano, D., Ewert, F., Martre, P., et al. (2016). Multi-wheat-model ensemble responses to interannual climate variability. Env. Model. Softw., 81, 86–101.
Abstract: We compare 27 wheat models’ yield responses to interannual climate variability, analyzed at locations in Argentina, Australia, India, and The Netherlands as part of the Agricultural Model Intercomparison and Improvement Project (AgMIP) Wheat Pilot. Each model simulated 1981-2010 grain yield, and we evaluate results against the interannual variability of growing season temperature, precipitation, and solar radiation. The amount of information used for calibration has only a minor effect on most models’ climate response, and even small multi-model ensembles prove beneficial. Wheat model clusters reveal common characteristics of yield response to climate; however models rarely share the same cluster at all four sites indicating substantial independence. Only a weak relationship (R-2 <= 0.24) was found between the models’ sensitivities to interannual temperature variability and their response to long-term warming, suggesting that additional processes differentiate climate change impacts from observed climate variability analogs and motivating continuing analysis and model development efforts. Published by Elsevier Ltd.
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
