Hjelkrem, A. - G. R., Höglind, M., van Oijen, M., Schellberg, J., Gaiser, T., & Ewert, F. (2017). Sensitivity analysis and Bayesian calibration for testing robustness of the BASGRA model in different environments. Ecol. Model., 359, 80–91. Abstract: Highlights • The parameters to be fixed were consistent across sites. • Model calibration must be performed separately for each specific case. • Possible to reduce model parameters from 66 to 45. • Strong model reductions must be avoided. • The error term for the training data were characterised by timing (phase shift). Abstract Proper parameterisation and quantification of model uncertainty are two essential tasks in improvement and assessment of model performance. Bayesian calibration is a method that combines both tasks by quantifying probability distributions for model parameters and outputs. However, the method is rarely applied to complex models because of its high computational demand when used with high-dimensional parameter spaces. We therefore combined Bayesian calibration with sensitivity analysis, using the screening method by Morris (1991), in order to reduce model complexity by fixing parameters to which model output was only weakly sensitive to a nominal value. Further, the robustness of the model with respect to reduction in the number of free parameters were examined according to model discrepancy and output uncertainty. The process-based grassland model BASGRA was examined in the present study on two sites in Norway and in Germany, for two grass species (Phleum pratense and Arrhenatherum elatius). According to this study, a reduction of free model parameters from 66 to 45 was possible. The sensitivity analysis showed that the parameters to be fixed were consistent across sites (which differed in climate and soil conditions), while model calibration had to be performed separately for each combination of site and species. The output uncertainty decreased slightly, but still covered the field observations of aboveground biomass. Considering the training data, the mean square error for both the 66 and the 45 parameter model was dominated by errors in timing (phase shift), whereas no general pattern was found in errors when using the validation data. Stronger model reduction should be avoided, as the error term increased and output uncertainty was underestimated. Keywords: Metropolis-hasting; Morris method; Reducing complexity; Robustness Permanent link \| Save citation: RTF PDF LaTeX Markdown \| Export record: BibTeX Endnote ISI RIS Atom XML MODS XML ODF XML Word XML
Crout, N. M. J., Craigon, J., Cox, G. M., Jao, Y., Tarsitano, D., Wood, A. T. A., et al. (2014). An objective approach to model reduction: Application to the Sirius wheat model. Agricultural and Forest Meteorology, 189-190(100), 211–219. Abstract: An existing simulation model of wheat growth and development, Sirius, was evaluated through a systematic model reduction procedure. The model was automatically manipulated under software control to replace variables within the model structure with constants, individually and in combination. Predictions of the resultant models were compared to growth analysis observations of total biomass, grain yield, and canopy leaf area derived from 9 trials conducted in the UK and New Zealand under optimal, nitrogen limiting and drought conditions. Model performance in predicting these observations was compared in order to evaluate whether individual model variables contributed positively to the overall prediction. Of the 1 1 1 model variables considered 16 were identified as potentially redundant. Areas of the model where there was evidence of redundancy were: (a) translocation of biomass carbon to grain; (b) nitrogen physiology; (c) adjustment of air temperature for various modelled processes; (d) allowance for diurnal variation in temperature; (e) vernalisation (f) soil nitrogen mineralisation (g) soil surface evaporation. It is not suggested that these are not important processes in real crops, rather, that their representation in the model cannot be justified in the context of the analysis. The approach described is analogous to a detailed model inter-comparison although it would be better described as a model intra-comparison as it is based on the comparison of many simplified forms of the same model. The approach provides automation to increase the efficiency of the evaluation and a systematic means of increasing the rigour of the evaluation. Keywords: Complexity; Crop model; Evaluation; Model reduction; Parsimony; Wheat Permanent link \| Save citation: RTF PDF LaTeX Markdown \| Export record: BibTeX Endnote ISI RIS Atom XML MODS XML ODF XML Word XML

Abstract: Highlights • The parameters to be fixed were consistent across sites. • Model calibration must be performed separately for each specific case. • Possible to reduce model parameters from 66 to 45. • Strong model reductions must be avoided. • The error term for the training data were characterised by timing (phase shift). Abstract Proper parameterisation and quantification of model uncertainty are two essential tasks in improvement and assessment of model performance. Bayesian calibration is a method that combines both tasks by quantifying probability distributions for model parameters and outputs. However, the method is rarely applied to complex models because of its high computational demand when used with high-dimensional parameter spaces. We therefore combined Bayesian calibration with sensitivity analysis, using the screening method by Morris (1991), in order to reduce model complexity by fixing parameters to which model output was only weakly sensitive to a nominal value. Further, the robustness of the model with respect to reduction in the number of free parameters were examined according to model discrepancy and output uncertainty. The process-based grassland model BASGRA was examined in the present study on two sites in Norway and in Germany, for two grass species (Phleum pratense and Arrhenatherum elatius). According to this study, a reduction of free model parameters from 66 to 45 was possible. The sensitivity analysis showed that the parameters to be fixed were consistent across sites (which differed in climate and soil conditions), while model calibration had to be performed separately for each combination of site and species. The output uncertainty decreased slightly, but still covered the field observations of aboveground biomass. Considering the training data, the mean square error for both the 66 and the 45 parameter model was dominated by errors in timing (phase shift), whereas no general pattern was found in errors when using the validation data. Stronger model reduction should be avoided, as the error term increased and output uncertainty was underestimated.

Keywords: Metropolis-hasting; Morris method; Reducing complexity; Robustness

| Save citation: RTF PDF LaTeX Markdown

| Export record: BibTeX Endnote ISI RIS Atom XML MODS XML ODF XML Word XML

Abstract: An existing simulation model of wheat growth and development, Sirius, was evaluated through a systematic model reduction procedure. The model was automatically manipulated under software control to replace variables within the model structure with constants, individually and in combination. Predictions of the resultant models were compared to growth analysis observations of total biomass, grain yield, and canopy leaf area derived from 9 trials conducted in the UK and New Zealand under optimal, nitrogen limiting and drought conditions. Model performance in predicting these observations was compared in order to evaluate whether individual model variables contributed positively to the overall prediction. Of the 1 1 1 model variables considered 16 were identified as potentially redundant. Areas of the model where there was evidence of redundancy were: (a) translocation of biomass carbon to grain; (b) nitrogen physiology; (c) adjustment of air temperature for various modelled processes; (d) allowance for diurnal variation in temperature; (e) vernalisation (f) soil nitrogen mineralisation (g) soil surface evaporation. It is not suggested that these are not important processes in real crops, rather, that their representation in the model cannot be justified in the context of the analysis. The approach described is analogous to a detailed model inter-comparison although it would be better described as a model intra-comparison as it is based on the comparison of many simplified forms of the same model. The approach provides automation to increase the efficiency of the evaluation and a systematic means of increasing the rigour of the evaluation.