| Records |
| Author |
Sanna, M.; Acutis, M.; Bellocchi, G. |
| Title |
Interrelationship between evaluation metrics to assess agro-ecological models |
Type |
Report |
| Year |
2014 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
3 |
Issue |
|
Pages |
Sp3-5 |
Keywords  |
|
| Abstract |
When evaluating the performances of simulation models, the perception of the quality of the outputs may depend on the statistics used to compare simulated and observed data. In order to have a comprehensive understanding of model performance, the use of a variety of metrics is generally advocated. However, since they may be correlated, the use of two or more metrics may convey the same information, leading to redundancy. This study intends to investigate the interrelationship between evaluation metrics, with the aim of identifying the most useful set of indicators, for assessing simulation performance. Our focus is on agro-ecological modelling. Twenty-three performance indicators were selected to compare simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Indicators were calculated on large data sets, collected to effectively apply correlation analysis techniques. For each variable, the interrelationship between each pair of indicators was evaluated, by computing the Spearman’s rank correlation coefficient. A definition of “stable correlation” was proposed, based on the test of heterogeneity, allowing to assess whether two or more correlation coefficients are equal. An optimal subset of indicators was identified, striking a balance between number of indicators, amount of provided information and information redundancy. They are: Index of Agreement, Squared Bias, Root Mean Squared Relative Error, Pattern Index, Persistence Model Efficiency and Spearman’s Correlation Coefficient. The present study was carried out in the context of CropM-LiveM cross-cutting activities of MACSUR knowledge hub. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2222 |
| Permanent link to this record |
| |
|
| |
| Author |
Bellocchi, G. |
| Title |
Fuzzy-logic based multi-site crop model evaluation |
Type |
|
| Year |
2015 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
5 |
Issue |
|
Pages |
Sp5-5 |
| Keywords |
|
| Abstract |
The most common way to evaluate simulation models is to quantify the agreement between observations and simulations via statistical metrics such as the root mean squared error and the linear regression coefficient of determination. It is agreed that the aggregation of metrics of different nature intro integrated indicators offers a valuable way to assess models. Expanded notions of model evaluation that have recently emerged, based on the trade-off between properties of the model and agreement between predictions and actual data under contrasting conditions, integrate sensitivity analysis measures and information criteria for model selection, as well as concepts of model robustness, and point to expert judgments to explore the importance of different metrics. As a FACCE MACSUR CropM-LiveM action, a composite indicator (MQIm: Model Quality Indicator for multi-site assessment) was elaborated, by a group of specialists, on metrics commonly used to evaluate crop models (with extension to grassland models) while also integrating aspects of model complexity and stability of performances. The indicator, based on fuzzy bounds applied to a set of weighed metrics, was first revised by a broader group of modellers and then assessed via questionnaire survey of scientists and end-users. We document a crop model evaluation in Europe and assess to what extent the MQIm reflects the main components of model quality and supports inferences about model performances. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
MACSUR Science Conference 2015 »Integrated Climate Risk Assessment in Agriculture & Food«, 8–9+10 April 2015, Reading, UK |
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2120 |
| Permanent link to this record |
| |
|
| |
| Author |
Bellocchi, G.; Sándor, R. |
| Title |
Model intercomparison |
Type |
Report |
| Year |
2015 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
6 |
Issue |
|
Pages |
D-L2.4 |
| Keywords |
|
| Abstract |
This deliverable focuses on some illustrative results obtained with different grassland- specific, grassland adapted crop and dynamic vegetation models selected out of the first list of models compiled in D-L2.1.1 to simulate biomass and flux data from grassland sites in Europe and peri-Mediterranean regions (D-L2.1.1 and D-L2.1.2). Results from uncalibrated simulations were documented in the D-L2.3 report as a blind exercise. Some model improvements are emphasized in this report due to the higher information level of the model calibrations. The complete set of results will include simulations from uncalibrated and calibrated models. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2108 |
| Permanent link to this record |
| |
|
| |
| Author |
Cammarano, D.; Rivington, M.; Matthews, K.; B,; Bellocchi, G. |
| Title |
Estimates of crop responses to climate change with quantified ranges of uncertainty |
Type |
Report |
| Year |
2015 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
6 |
Issue |
|
Pages |
D-C4.1.3 |
| Keywords |
|
| Abstract |
In estimating responses of crops to future climate realisations, it is necessary to understand and differentiate between the sources of uncertainty in climate models and how these lead to errors in estimating the past climate and biases in future projections, and how these affect crop model estimates. This paper investigates the complexities in using climate model projections representing different spatial scales within climate change impacts and adaptation studies. This is illustrated by simulating spring barley with three crop models run using site-specific observed, original (50•50 km) and bias corrected downscaled (site-specific) hindcast (1960-1990) weather data from the HadRM3 Regional Climate Model (RCM). Original and bias corrected downscaled weather data were evaluated against the observed data. The comparisons made between the crop models were in the light of lessons learned from this data evaluation. Though the bias correction downscaling method improved the match between observed and hindcast data, this did not always translate into better matching of crop models estimates. At four sites the original HadRM3 data produced near identical mean simulated yield values as from the observed weather data, despite differences in the weather data, giving a situation of ‘right results for the wrong reasons’. This was likely due to compensating errors in the input weather data and non-linearity in crop models processes, making interpretation of results problematic. Overall, bias correction downscaling improved the quality of simulated outputs. Understanding how biases in climate data manifest themselves in crop models gives greater confidence in the utility of the estimates produced using downscaled future climate projections. The results indicate implications on how future projections of climate change impacts are interpreted. Fundamentally, considerable care is required in determining the impact weather data sources have in climate change impact and adaptation studies, whether from individual models or ensembles. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2098 |
| Permanent link to this record |
| |
|
| |
| Author |
Van den Pol-van Dasselaar, A.; Bellocchi, G.; Hutchings, N.; Olesen, J.; Saetnan, E. |
| Title |
AnimalChange |
Type |
Conference Article |
| Year |
2014 |
Publication |
|
Abbreviated Journal |
|
| Volume |
|
Issue |
|
Pages |
|
| Keywords |
|
| Abstract |
The EU-FP7 project AnimalChange (AN Integration of Mitigation and Adaptation options for sustainable Livestock production under climate CHANGE, http://www.animalchange.eu, 2011-2015) addresses mitigation and adaptation options and provides scientific guidance for their integration in sustainable development pathways for livestock production under climate change in Europe, Northern and Sub-Saharan Africa, and Latin America. The project provides insights, innovations, tools and models for livestock production incorporating socio-economic and environmental (particularly GHG emission) variables. Scenario studies are carried out at scales ranging from animal and pasture, to farm and to region, for given management options. A wide range of livestock production systems is included in the project. The core analytical spine of the project is a series of coupled biophysical and socio-economic models combined with experimentation. This allows exploring future scenarios for the livestock sector under baseline and atmospheric CO2 stabilization scenarios. These scenarios are first constructed and then elaborated and enriched by breakthrough mitigation and adaptation options at field and animal scales, integrated and evaluated at farm scale and finally used to assess policy options and their socio-economic consequences. The modelling results are useful for governments, agricultural and food industry and the agricultural sector (farmers). There are many synergies between the European activities of AnimalChange and those of the LiveM theme of MACSUR, in particular with respect to access to livestock production datasets, dialogue with stakeholders and comparison and integration of grassland and livestock models with crop and socio-economic models in pilot studies at a variety of scales. |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
FACCE MACSUR Mid-term Scientific Conference |
| Series Volume |
3(S) Sassari, Italy |
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
FACCE MACSUR Mid-term Scientific Conference, 2014-04-01 to 2014-04-04, Sassari, Italy |
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
5053 |
| Permanent link to this record |
