Sieber, S., Amjath-Babu, T. S., McIntosh, B. S., Tscherning, K., Müller, K., Helming, K., et al. (2013). Evaluating the characteristics of a non-standardised Model Requirements Analysis (MRA) for the development of policy impact assessment tools. Env. Model. Softw., 49, 53–63.
Abstract: The aim of this paper is to provide a critical analysis of the strengths and weaknesses of a non-standardised Model Requirements Analysis (MRA) used for the purpose of developing the Sustainability Impact Assessment Tool (SIAT). By ‘non-standardised’ we mean not strictly following a published MRA method. The underlying question we are interested in addressing is how non-standardised methods, often employed in research driven projects, compare to defined methods with more standardised structure, with regards their ability to capture model requirements effectively, and with regards their overall usability. Through describing and critically assessing the specific features of the non-standardised MRA employed, the ambition of this paper is to provide insights useful for impact assessment tool (IAT) development. Specifically, the paper will (i) characterise kinds of user requirements relevant to the functionality and design of IATs; (ii) highlight the strengths and weaknesses of non-standardised MRA for user requirements capture, analysis and reflection in the context of IAT; (iii) critically reflect on the process and outcomes of having used a non-standardised MRA in comparison with other more standardised approaches. To accomplish these aims, we first review methods available for IAT development before describing the SIAT development process, including the MRA employed. Major strengths and weaknesses of the MRA method are then discussed in terms of user identification and characterisation, organisational characterisation and embedding, and ability to capture design options for ensuring usability and usefulness. A detailed assessment on the structural differences of MRA with two advanced approaches (Integrated DSS design and goal directed design) and their role in performance of the MRA tool is used to critique the approach employed. The results show that MRA is able to bring thematic integration, establish system performance and technical thresholds as well as detailing quality and transparency guidelines. Nevertheless the discussion points out to a number of deficiencies in application – (i) a need to more effectively characterise potential users, and; (ii) a need to better foster communication among the distinguished roles in the development process. If addressed these deficiencies, SIAT non-standardised MRA could have brought out better outcomes in terms of tool usability and usefulness, and improved embedding of the tool into conditions of targeted end-users. (C) 2013 Elsevier Ltd. All rights reserved.
|
Wallach, D., Thorburn, P., Asseng, S., Challinor, A. J., Ewert, F., Jones, J. W., et al. (2016). Estimating model prediction error: Should you treat predictions as fixed or random. Env. Model. Softw., 84, 529–539.
Abstract: Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEPfixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEPuncertain(X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEPuncertain(X) can be estimated using a random effects ANOVA. It is argued that MSEPuncertain(X) is the more informative uncertainty criterion, because it is specific to each prediction situation.
|
Ewert, F., Rötter, R. P., Bindi, M., Webber, H., Trnka, M., Kersebaum, K. C., et al. (2015). Crop modelling for integrated assessment of risk to food production from climate change. Env. Model. Softw., 72, 287–303.
Abstract: The complexity of risks posed by climate change and possible adaptations for crop production has called for integrated assessment and modelling (IAM) approaches linking biophysical and economic models. This paper attempts to provide an overview of the present state of crop modelling to assess climate change risks to food production and to which extent crop models comply with IAM demands. Considerable progress has been made in modelling effects of climate variables, where crop models best satisfy IAM demands. Demands are partly satisfied for simulating commonly required assessment variables. However, progress on the number of simulated crops, uncertainty propagation related to model parameters and structure, adaptations and scaling are less advanced and lagging behind IAM demands. The limitations are considered substantial and apply to a different extent to all crop models. Overcoming these limitations will require joint efforts, and consideration of novel modelling approaches.
|
|
Van Oijen, M., Cameron, D., Levy, P. E., & Preston, R. (2017). Correcting errors from spatial upscaling of nonlinear greenhouse gas flux models. Environmental Modelling & Software, 94, 157–165.
|
Dumont, B., Basso, B., Bodson, B., Destain, J. - P., & Destain, M. - F. (2016). Assessing and modeling economic and environmental impact of wheat nitrogen management in Belgium. Env. Model. Softw., 79, 184–196.
Abstract: Future progress in wheat yield will rely on identifying genotypes & management practices better adapted to the fluctuating environment Nitrogen (N) fertilization is probably the most important practice impacting crop growth. However, the adverse environmental impacts of inappropriate N management (e.g., lixiviation) must be considered in the decision-making process. A formal decisional algorithm was developed to tactically optimize the economic & environmental N fertilization in wheat. Climatic uncertainty analysis was performed using stochastic weather time-series (LARS-WG). Crop growth was simulated using STICS model. Experiments were conducted to support the algorithm recommendations: winter wheat was sown between 2008 & 2014 in a classic loamy soil of the Hesbaye Region, Belgium (temperate climate). Results indicated that, most of the time, the third N fertilization applied at flag-leaf stage by farmers could be reduced. Environmental decision criterion is most of the time the limiting factor in comparison to the revenues expected by farmers. (C) 2016 Elsevier Ltd. All rights reserved.
|
