| |
Records |
Links |
|
Author  |
Bellocchi, G.; Rivington, M.; Acutis, M. |
|
| |
Title |
Protocol for model evaluation |
Type |
Report |
| |
Year |
2014 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
|
| |
Volume |
3 |
Issue |
|
Pages |
D-L2.2/D |
|
| |
Keywords |
|
|
| |
Abstract |
This deliverable focuses on the development of methods for model evaluation in order to have unambiguous indications derived from the use of several evaluation metrics. The information about model quality is aggregated into a single indicator using a fuzzy expert system that can be applied to a wide range of model estimates where suitable test data are available. This is a cross-cutting activity between CropM (C1.4) and LiveM (L2.2). No Label |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
MA @ admin @ |
Serial |
2229 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Bellocchi, G.; Rivington, M.; Matthews, K.; Acutis, M. |
|
| |
Title |
Deliberative processes for comprehensive evaluation of agroecological models. A review |
Type |
Journal Article |
| |
Year |
2015 |
Publication |
Agronomy for Sustainable Development |
Abbreviated Journal |
Agron. Sust. Developm. |
|
| |
Volume |
35 |
Issue |
2 |
Pages |
589-605 |
|
| |
Keywords |
component-oriented programing; deliberative approach; modeling; model evaluation; multiple metrics; stakeholders; decision-support-systems; environmental-models; performance evaluation; groundwater models; farming systems; climate-change; irene-dll; simulation; validation; integration |
|
| |
Abstract |
The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
1774-0746 1773-0155 |
ISBN |
|
Medium |
Review |
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
CropM, LiveM, ft_macsur |
Approved |
no |
|
| |
Call Number |
MA @ admin @ |
Serial |
4551 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Bellocchi, G.; Sándor, R. |
|
| |
Title |
Model intercomparison |
Type |
Report |
| |
Year |
2015 |
Publication |
FACCE MACSUR Reports |
Abbreviated Journal |
|
|
| |
Volume |
6 |
Issue |
|
Pages |
D-L2.4 |
|
| |
Keywords |
|
|
| |
Abstract |
This deliverable focuses on some illustrative results obtained with different grassland- specific, grassland adapted crop and dynamic vegetation models selected out of the first list of models compiled in D-L2.1.1 to simulate biomass and flux data from grassland sites in Europe and peri-Mediterranean regions (D-L2.1.1 and D-L2.1.2). Results from uncalibrated simulations were documented in the D-L2.3 report as a blind exercise. Some model improvements are emphasized in this report due to the higher information level of the model calibrations. The complete set of results will include simulations from uncalibrated and calibrated models. No Label |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
MA @ admin @ |
Serial |
2108 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Ben Touhami, H.; Bellocchi, G. |
|
| |
Title |
Bayesian calibration of the Pasture Simulation model (PaSim) to simulate European grasslands under water stress |
Type |
Journal Article |
| |
Year |
2015 |
Publication |
Ecological Informatics |
Abbreviated Journal |
Ecological Informatics |
|
| |
Volume |
30 |
Issue |
|
Pages |
356-364 |
|
| |
Keywords |
Bayesian calibration framework; Grasslands; Pasture Simulation model; (PaSim); integrated assessment models; chain monte-carlo; climate-change; computation; impacts; vulnerability; likelihoods; france |
|
| |
Abstract |
As modeling becomes a more widespread practice in the agro-environmental sciences, scientists need reliable tools to calibrate models against ever more complex and detailed data. We present a generic Bayesian computation framework for grassland simulation, which enables parameter estimation in the Bayesian formalism by using Monte Carlo approaches. We outline the underlying rationale, discuss the computational issues, and provide results from an application of the Pasture Simulation model (PaSim) to three European grasslands. The framework was suited to investigate the challenging problem of calibrating complex biophysical models to data from altered scenarios generated by precipitation reduction (water stress conditions). It was used to infer the parameters of manipulated grassland systems and to assess the gain in uncertainty reduction by updating parameter distributions using measurements of the output variables. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
1574-9541 |
ISBN |
|
Medium |
Article |
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
CropM, LiveM, ft_macsur |
Approved |
no |
|
| |
Call Number |
MA @ admin @ |
Serial |
4697 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Ben Touhami, H.; Bellocchi, G. |
|
| |
Title |
Bayesian calibration of the Pasture Simulation model (PaSim) to simulate emissions from long-term grassland sites: a European perspective |
Type |
Conference Article |
| |
Year |
2014 |
Publication |
|
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
|
|
| |
Keywords |
LiveM |
|
| |
Abstract |
|
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
Livestock, Climate Change and Food Security, Madrid, Spain, 2014-05-19 to 2014-05-20 |
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
MA @ admin @ |
Serial |
2309 |
|
| Permanent link to this record |
