Bellocchi, G., Rivington, M., & Acutis, M. (2014). Deliberative processes for comprehensive evaluation of agro-ecological models. FACCE MACSUR Mid-term Scientific Conference, 3(S) Sassari, Italy.
Abstract: Biophysical models are acknowledged for examining interactions of agro-ecological systems and fostering communication between scientists, managers and the public. As the role of models grows in importance, there is an increase in the need to assess their quality and performance (Bellocchi et al., 2010). However, the heterogeneity of factors influencing model outputs makes it difficult a full assessment of model features. Where models are used with or for stakeholders then model credibility depends not only on the outcomes of well-structured statistical evaluation but also less tangible factors may need to be addressed using complementary deliberative processes. To expand our horizons in the evaluation of crop and grassland models, approaches have been reviewed with emphasis on using combined metrics. Comprehensive evaluation of simulation models was developed to integrate expectations of stakeholders via a weighting system where lower and upper fuzzy bounds are applied to a set of evaluation metrics. A questionnaire-based survey helped understanding the multi-faceted knowledge and experience required and the substantial challenges posed by the deliberative process. MACSUR knowledge hub holds potential to advance in good modelling practice in relation with model evaluation (including access to appropriate software tools), an activity which is frequently neglected in the context of time-limited projects.
|
Ben Touhami, H., & Bellocchi, G. (2015). Bayesian calibration of the Pasture Simulation model (PaSim) to simulate European grasslands under water stress. Ecological Informatics, 30, 356–364.
Abstract: As modeling becomes a more widespread practice in the agro-environmental sciences, scientists need reliable tools to calibrate models against ever more complex and detailed data. We present a generic Bayesian computation framework for grassland simulation, which enables parameter estimation in the Bayesian formalism by using Monte Carlo approaches. We outline the underlying rationale, discuss the computational issues, and provide results from an application of the Pasture Simulation model (PaSim) to three European grasslands. The framework was suited to investigate the challenging problem of calibrating complex biophysical models to data from altered scenarios generated by precipitation reduction (water stress conditions). It was used to infer the parameters of manipulated grassland systems and to assess the gain in uncertainty reduction by updating parameter distributions using measurements of the output variables.
|
De Swaef, T., Bellocchi, G., Aper, J., Lootens, P., & Roldan-Ruiz, I. (2019). Use of identifiability analysis in designing phenotyping experiments for modelling forage production and quality. J. Experim. Bot., 70(9), 2587–2604.
Abstract: Agricultural systems models are complex and tend to be over-parameterized with respect to observational datasets. Practical identifiability analysis based on local sensitivity analysis has proved effective in investigating identifiable parameter sets in environmental models, but has not been applied to agricultural systems models. Here, we demonstrate that identifiability analysis improves experimental design to ensure independent parameter estimation for yield and quality outputs of a complex grassland model. The Pasture Simulation model (PaSim) was used to demonstrate the effectiveness of practical identifiability analysis in designing experiments and measurement protocols within phe-notyping experiments with perennial ryegrass. Virtual experiments were designed combining three factors: frequency of measurements, duration of the experiment. and location of trials. Our results demonstrate that (i) PaSim provides sufficient detail in terms of simulating biomass yield and quality of perennial ryegrass for use in breeding, (ii) typical breeding trials are insufficient to parameterize all influential parameters, (iii) the frequency of measurements is more important than the number of growing seasons to improve the identifiability of PaSim parameters, and (iv) identifiability analysis provides a sound approach for optimizing the design of multi-location trials. Practical identifiability analysis can play an important role in ensuring proper exploitation of phenotypic data and cost-effective multi-location experimental designs. Considering the growing importance of simulation models, this study supports the design of experiments and measurement protocols in the phenotyping networks that have recently been organized.
|
|
Sándor, R., Ehrhardt, F., Basso, B., Bellocchi, G., Bhatia, A., Brilli, L., et al. (2016). C and N models Intercomparison – benchmark and ensemble model estimates for grassland production. Advances in Animal Biosciences, 7(03), 245–247.
|
|
Pulina, A., Bellocchi, G., Seddaiu, G., & Roggero, P. P. (2016). Scenario analysis of alternative management options on the forage production and greenhouse gas emissions in Mediterranean grasslands. (Vol. 116, pp. 263–266).
|
