Kersebaum, K. C., Boote, K. J., Jorgenson, J. S., Nendel, C., Bindi, M., Frühauf, C., et al. (2015). Analysis and classification of data sets for calibration and validation of agro-ecosystem models. Env. Model. Softw., 72, 402–417.
Abstract: Experimental field data are used at different levels of complexity to calibrate, validate and improve agroecosystem models to enhance their reliability for regional impact assessment. A methodological framework and software are presented to evaluate and classify data sets into four classes regarding their suitability for different modelling purposes. Weighting of inputs and variables for testing was set from the aspect of crop modelling. The software allows users to adjust weights according to their specific requirements. Background information is given for the variables with respect to their relevance for modelling and possible uncertainties. Examples are given for data sets of the different classes. The framework helps to assemble high quality data bases, to select data from data bases according to modellers requirements and gives guidelines to experimentalists for experimental design and decide on the most effective measurements to improve the usefulness of their data for modelling, statistical analysis and data assimilation. (C) 2015 Elsevier Ltd. All rights reserved.
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
Kipling, R. P., Topp, C. F. E., Bannink, A., Bartley, D. J., Blanco-Penedo, I., Cortignani, R., et al. (2019). To what extent is climate change adaptation a novel challenge for agricultural modellers. Env. Model. Softw., 120, Unsp 104492.
Abstract: Modelling is key to adapting agriculture to climate change (CC), facilitating evaluation of the impacts and efficacy of adaptation measures, and the design of optimal strategies. Although there are many challenges to modelling agricultural CC adaptation, it is unclear whether these are novel or, whether adaptation merely adds new motivations to old challenges. Here, qualitative analysis of modellers’ views revealed three categories of challenge: Content, Use, and Capacity. Triangulation of findings with reviews of agricultural modelling and Climate Change Risk Assessment was then used to highlight challenges specific to modelling adaptation. These were refined through literature review, focussing attention on how the progressive nature of CC affects the role and impact of modelling. Specific challenges identified were: Scope of adaptations modelled, Information on future adaptation, Collaboration to tackle novel challenges, Optimisation under progressive change with thresholds, and Responsibility given the sensitivity of future outcomes to initial choices under progressive change.
|
