| Records |
| Author |
Bellocchi, G.; Ma, S. |
| Title |
Results of uncalibrated grassland model runs |
Type |
Report |
| Year |
2014 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
3 |
Issue |
|
Pages |
D-L2.3 |
| Keywords |
|
| Abstract |
This deliverable focuses on the some illustrative results obtained with the grassland models selected (D-L2.1.1) to simulate biomass and flux data from grassland sites in Europe and peri-Mediterranean regions (D-L2.1.1 and D-L2.1.2). This is a blind exercise, carried out without model calibration. The complete set of results will include simulations from calibrated models. The results shown are illustrative of the methodology adopted for grassland model intercomparison in MACSUR. The insights gained from this ongoing study are relevant for some crop and vegetation models, which in some cases proved comparable to grassland-specific models to simulate biomass data from managed grasslands. The results reported here cannot be considered conclusive. Additional results will be published as they become available together with calibration results, as well as the comprehensive evaluation of models with fuzzy logic-based indicators. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
Language  |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2234 |
| Permanent link to this record |
| |
|
| |
| Author |
Bellocchi, G.; Rivington, M.; Acutis, M. |
| Title |
Protocol for model evaluation |
Type |
Report |
| Year |
2014 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
3 |
Issue |
|
Pages |
D-L2.2/D |
| Keywords |
|
| Abstract |
This deliverable focuses on the development of methods for model evaluation in order to have unambiguous indications derived from the use of several evaluation metrics. The information about model quality is aggregated into a single indicator using a fuzzy expert system that can be applied to a wide range of model estimates where suitable test data are available. This is a cross-cutting activity between CropM (C1.4) and LiveM (L2.2). No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2229 |
| Permanent link to this record |
| |
|
| |
| Author |
Bellocchi, G.; Martin, R.; Shtiliyanova, A.; Ben Touhami, H.; Carrère, P. |
| Title |
Vul’Clim – Climate change vulnerability studies in the region Auvergne (France) |
Type |
Report |
| Year |
2014 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
3 |
Issue |
|
Pages |
Sp3-6 |
| Keywords |
|
| Abstract |
The region Auvergne (France) is a major livestock territory in Europe (beef and dairy cattle with permanent grasslands), with a place in climate change regional studies assisting policy makers and actors in identifying adaptation and mitigation measures. Vul’Clim is a research grant (Bourse Recherche Filière) of the region Auvergne (February 2014-September 2015) to develop model-based vulnerability analysis approaches for a detailed assessment of climate change impacts at regional scale. Its main goal is the creation of a computer-aided platform for vulnerability assessment of grasslands, in interaction with stakeholders from a cluster of eco-enterprises. A modelling engine provided by the mechanistic, biogeochemical model PaSim (Pasture Simulation model) is the core of the platform. An action studies the changes of scales by varying the granularity of the data available at a given scale (e.g. climate data supplied by global scenarios) to let them being exploited at another scale (e.g. high-resolution pixels). Another action is to develop an assessment framework linking modelling tools to entry data and outputs, including a variety of components: data-entry manager at different spatial resolutions; automatic computation of indicators; gap-filling and data quality check; simulation kernel with the model(s) used; device to represent results as maps and integrated indicators. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2223 |
| Permanent link to this record |
| |
|
| |
| Author |
Sanna, M.; Acutis, M.; Bellocchi, G. |
| Title |
Interrelationship between evaluation metrics to assess agro-ecological models |
Type |
Report |
| Year |
2014 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
3 |
Issue |
|
Pages |
Sp3-5 |
| Keywords |
|
| Abstract |
When evaluating the performances of simulation models, the perception of the quality of the outputs may depend on the statistics used to compare simulated and observed data. In order to have a comprehensive understanding of model performance, the use of a variety of metrics is generally advocated. However, since they may be correlated, the use of two or more metrics may convey the same information, leading to redundancy. This study intends to investigate the interrelationship between evaluation metrics, with the aim of identifying the most useful set of indicators, for assessing simulation performance. Our focus is on agro-ecological modelling. Twenty-three performance indicators were selected to compare simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Indicators were calculated on large data sets, collected to effectively apply correlation analysis techniques. For each variable, the interrelationship between each pair of indicators was evaluated, by computing the Spearman’s rank correlation coefficient. A definition of “stable correlation” was proposed, based on the test of heterogeneity, allowing to assess whether two or more correlation coefficients are equal. An optimal subset of indicators was identified, striking a balance between number of indicators, amount of provided information and information redundancy. They are: Index of Agreement, Squared Bias, Root Mean Squared Relative Error, Pattern Index, Persistence Model Efficiency and Spearman’s Correlation Coefficient. The present study was carried out in the context of CropM-LiveM cross-cutting activities of MACSUR knowledge hub. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
|
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2222 |
| Permanent link to this record |
| |
|
| |
| Author |
Bellocchi, G. |
| Title |
Fuzzy-logic based multi-site crop model evaluation |
Type |
|
| Year |
2015 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
| Volume |
5 |
Issue |
|
Pages |
Sp5-5 |
| Keywords |
|
| Abstract |
The most common way to evaluate simulation models is to quantify the agreement between observations and simulations via statistical metrics such as the root mean squared error and the linear regression coefficient of determination. It is agreed that the aggregation of metrics of different nature intro integrated indicators offers a valuable way to assess models. Expanded notions of model evaluation that have recently emerged, based on the trade-off between properties of the model and agreement between predictions and actual data under contrasting conditions, integrate sensitivity analysis measures and information criteria for model selection, as well as concepts of model robustness, and point to expert judgments to explore the importance of different metrics. As a FACCE MACSUR CropM-LiveM action, a composite indicator (MQIm: Model Quality Indicator for multi-site assessment) was elaborated, by a group of specialists, on metrics commonly used to evaluate crop models (with extension to grassland models) while also integrating aspects of model complexity and stability of performances. The indicator, based on fuzzy bounds applied to a set of weighed metrics, was first revised by a broader group of modellers and then assessed via questionnaire survey of scientists and end-users. We document a crop model evaluation in Europe and assess to what extent the MQIm reflects the main components of model quality and supports inferences about model performances. No Label |
| Address |
|
| Corporate Author |
|
Thesis |
|
| Publisher |
|
Place of Publication |
|
Editor |
|
| Language |
|
Summary Language |
|
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
|
ISBN |
|
Medium |
|
| Area |
|
Expedition |
|
Conference |
MACSUR Science Conference 2015 »Integrated Climate Risk Assessment in Agriculture & Food«, 8–9+10 April 2015, Reading, UK |
| Notes |
|
Approved |
no |
| Call Number |
MA @ admin @ |
Serial |
2120 |
| Permanent link to this record |
