| Records |
| Author |
Bellocchi, G.; Rivington, M.; Matthews, K.; Acutis, M. |
| Title |
Deliberative processes for comprehensive evaluation of agroecological models. A review |
Type |
Journal Article |
| Year |
2015 |
Publication |
Agronomy for Sustainable Development |
Abbreviated Journal |
Agron. Sust. Developm. |
| Volume |
35 |
Issue |
2 |
Pages |
589-605 |
| Keywords |
component-oriented programing; deliberative approach; modeling; model evaluation; multiple metrics; stakeholders; decision-support-systems; environmental-models; performance evaluation; groundwater models; farming systems; climate-change; irene-dll; simulation; validation; integration |
| Abstract |
The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs. |
Address  |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1774-0746 1773-0155 |
ISBN |
|
Medium |
Review |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM, LiveM, ft_macsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4551 |
| Permanent link to this record |
| |
|
| |
| Author |
Sanna, M.; Bellocchi, G.; Fumagalli, M.; Acutis, M. |
| Title |
A new method for analysing the interrelationship between performance indicators with an application to agrometeorological models |
Type |
Journal Article |
| Year |
2015 |
Publication |
Environmental Modelling & Software |
Abbreviated Journal |
Env. Model. Softw. |
| Volume |
73 |
Issue |
|
Pages |
286-304 |
| Keywords |
model evaluation; performance indicators; stable correlation; solar-radiation; simulation-model; environmental-models; statistical-methods; crop nitrogen; validation; rice; uncertainty; calibration; software |
| Abstract |
The use of a variety of metrics is advocated to assess model performance but correlated metrics may convey the same information, thus leading to redundancy. Starting from this assumption, a method was developed for selecting, from among a collection of performance indicators, one or more subsets providing the same information as the entire set. The method, based on the definition of “stable correlation”, was applied to 23 performance indicators of agrometeorological models, calculated on large sets of simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Two subsets were determined: {Squared Bias, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index, Modified Modelling Efficiency}, {Persistence Model Efficiency, Root Mean Squared Relative Error, Coefficient of Determination, Pattern Index}. The method needs corroboration but is statistically founded and can support the implementation of standardized evaluation tools. (C) 2015 Elsevier Ltd. All rights reserved. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
English |
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
1364-8152 |
ISBN |
|
Medium |
Article |
| Area |
|
Expedition |
|
Conference |
|
| Notes |
CropM LiveM, ftnotmacsur |
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
4503 |
| Permanent link to this record |
| |
|
| |
| Author |
Van den Pol-van Dasselaar, A.; Bellocchi, G.; Hutchings, N.; Olesen, J.; Saetnan, E. |
| Title |
AnimalChange |
Type |
Conference Article |
| Year |
2014 |
Publication |
|
Abbreviated Journal |
|
| Volume |
|
Issue |
|
Pages |
|
| Keywords |
|
| Abstract |
The EU-FP7 project AnimalChange (AN Integration of Mitigation and Adaptation options for sustainable Livestock production under climate CHANGE, http://www.animalchange.eu, 2011-2015) addresses mitigation and adaptation options and provides scientific guidance for their integration in sustainable development pathways for livestock production under climate change in Europe, Northern and Sub-Saharan Africa, and Latin America. The project provides insights, innovations, tools and models for livestock production incorporating socio-economic and environmental (particularly GHG emission) variables. Scenario studies are carried out at scales ranging from animal and pasture, to farm and to region, for given management options. A wide range of livestock production systems is included in the project. The core analytical spine of the project is a series of coupled biophysical and socio-economic models combined with experimentation. This allows exploring future scenarios for the livestock sector under baseline and atmospheric CO2 stabilization scenarios. These scenarios are first constructed and then elaborated and enriched by breakthrough mitigation and adaptation options at field and animal scales, integrated and evaluated at farm scale and finally used to assess policy options and their socio-economic consequences. The modelling results are useful for governments, agricultural and food industry and the agricultural sector (farmers). There are many synergies between the European activities of AnimalChange and those of the LiveM theme of MACSUR, in particular with respect to access to livestock production datasets, dialogue with stakeholders and comparison and integration of grassland and livestock models with crop and socio-economic models in pilot studies at a variety of scales. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
FACCE MACSUR Mid-term Scientific Conference |
| Series Volume |
3(S) Sassari, Italy |
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
FACCE MACSUR Mid-term Scientific Conference, 2014-04-01 to 2014-04-04, Sassari, Italy |
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
5053 |
| Permanent link to this record |
| |
|
| |
| Author |
Lellei-Kovács, E.; Barcza, Z.; Hidy, D.; Horváth, F.; Ittzés, D.; Ittzés, P.; Ma, S.; Bellocchi, G. |
| Title |
Application of Biome-BGC MuSo in managed grassland ecosystems in the Euro-Mediteranean region |
Type |
Conference Article |
| Year |
2014 |
Publication |
|
Abbreviated Journal |
|
| Volume |
|
Issue |
|
Pages |
|
| Keywords |
|
| Abstract |
Simulation of the biogeochemical cycles of extensively and intensively managed grasslands and croplands are of particular interest due to the strong connection between ecosystem production, animal husbandry and food security. In the frame of MACSUR LiveM activities, we conducted a series of „blind tests” (i.e. uncalibrated model simulations with previously optimized model) on differently managed grasslands within Europe and Israel. We used the latest version of Biome-BGC MuSo model, the modified version of the widely used biogeochemical Biome-BGC model. Biome-BGC MuSo contains structural improvements, development of management modules, and the extension of the model to simulate herbaceouos ecosystem carbon and water cycles more faithfully. The studied ecosystems were meadows and pastures located in a variety of climate zones from the Atlantic sector to Central Europe, including Mediterranean sites. Managements were intensive and extensive grazing or mowing with or without different kind of fertilizers. Under similar options we simulated ecosystem variables, e.g. Gross Primary Production (GPP) and Net Ecosystem Exchange (NEE). Our experiences show that different sites have different sensitivity to the parameters (maximum root depth, soil parameters, etc.), but overall the model provided realistic fluxes. Experiences gained during the blind tests led us to further improve the model. Biome-BGC MuSo is available as a standalone model in personal computers, but also through virtual laboratory environment and Biome-BGC Projects database (http://ecos.okologia.mta.hu/bbgcdb) developed within the BioVeL project (http://www.biovel.eu). Scientific workflow management, web service and desktop grid technology can support model optimization in the so-called „calibrated runs” within MACSUR. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
FACCE MACSUR Mid-term Scientific Conference |
| Series Volume |
3(S) Sassari, Italy |
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
FACCE MACSUR Mid-term Scientific Conference, 2014-04-01 to 2014-04-04, Sassari, Italy |
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
5054 |
| Permanent link to this record |
| |
|
| |
| Author |
Bellocchi, G.; Rivington, M.; Acutis, M. |
| Title |
Deliberative processes for comprehensive evaluation of agro-ecological models |
Type |
Conference Article |
| Year |
2014 |
Publication |
|
Abbreviated Journal |
|
| Volume |
|
Issue |
|
Pages |
|
| Keywords |
|
| Abstract |
Biophysical models are acknowledged for examining interactions of agro-ecological systems and fostering communication between scientists, managers and the public. As the role of models grows in importance, there is an increase in the need to assess their quality and performance (Bellocchi et al., 2010). However, the heterogeneity of factors influencing model outputs makes it difficult a full assessment of model features. Where models are used with or for stakeholders then model credibility depends not only on the outcomes of well-structured statistical evaluation but also less tangible factors may need to be addressed using complementary deliberative processes. To expand our horizons in the evaluation of crop and grassland models, approaches have been reviewed with emphasis on using combined metrics. Comprehensive evaluation of simulation models was developed to integrate expectations of stakeholders via a weighting system where lower and upper fuzzy bounds are applied to a set of evaluation metrics. A questionnaire-based survey helped understanding the multi-faceted knowledge and experience required and the substantial challenges posed by the deliberative process. MACSUR knowledge hub holds potential to advance in good modelling practice in relation with model evaluation (including access to appropriate software tools), an activity which is frequently neglected in the context of time-limited projects. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
FACCE MACSUR Mid-term Scientific Conference |
| Series Volume |
3(S) Sassari, Italy |
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
FACCE MACSUR Mid-term Scientific Conference, 2014-04-01 to 2014-04-04, Sassari, Italy |
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
5071 |
| Permanent link to this record |
