| Home | << 1 2 3 4 5 >> |
|
Sanna, M., Acutis, M., & Bellocchi, G. (2014). Interrelationship between evaluation metrics to assess agro-ecological models (Vol. 3).
Abstract: When evaluating the performances of simulation models, the perception of the quality of the outputs may depend on the statistics used to compare simulated and observed data. In order to have a comprehensive understanding of model performance, the use of a variety of metrics is generally advocated. However, since they may be correlated, the use of two or more metrics may convey the same information, leading to redundancy. This study intends to investigate the interrelationship between evaluation metrics, with the aim of identifying the most useful set of indicators, for assessing simulation performance. Our focus is on agro-ecological modelling. Twenty-three performance indicators were selected to compare simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Indicators were calculated on large data sets, collected to effectively apply correlation analysis techniques. For each variable, the interrelationship between each pair of indicators was evaluated, by computing the Spearman’s rank correlation coefficient. A definition of “stable correlation” was proposed, based on the test of heterogeneity, allowing to assess whether two or more correlation coefficients are equal. An optimal subset of indicators was identified, striking a balance between number of indicators, amount of provided information and information redundancy. They are: Index of Agreement, Squared Bias, Root Mean Squared Relative Error, Pattern Index, Persistence Model Efficiency and Spearman’s Correlation Coefficient. The present study was carried out in the context of CropM-LiveM cross-cutting activities of MACSUR knowledge hub. No Label
|
|
Perego, A., Sanna, M., Giussani, A., Chiodini, M. E., Fumagalli, M., Pilu, S. R., et al. (2014). Designing a high-yielding maize ideotype for a changing climate in Lombardy plain northern Italy. Science of the Total Environment, 499, 497–509.
Abstract: • ARMOSA model simulated a maize ideotype with drought adaptation under climate change. • The ideotype needs less water for higher yield compared to current hybrids. • Higher production involves more crop residues that enhance soil C sequestration. • Soil organic C may generally decrease and N leaching will increase in sandy soil. The expected climate change will affect the maize yields in view of air temperature increase and scarce water availability. The application of biophysical models offers the chance to design a drought-resistant ideotype and to assist plant breeders and agronomists in the assessment of its suitability in future scenarios. The aim of the present work was to perform a model-based estimation of the yields of two hybrids, current vs ideotype, under future climate scenarios (2030–2060 and 2070–2100) in Lombardy (northern Italy), testing two options of irrigation (small amount at fixed dates vs optimal water supply), nitrogen (N) fertilization (300 vs 400 kg N ha− 1), and crop cycle durations (current vs extended). For the designing of the ideotype we set several parameters of the ARMOSA process-based crop model: the root elongation rate and maximum depth, stomatal resistance, four stage-specific crop coefficients for the actual transpiration estimation, and drought tolerance factor. The work findings indicated that the current hybrid ensures good production only with high irrigation amount (245–565 mm y− 1). With respect to the current hybrid, the ideotype will require less irrigation water (− 13%, p < 0.01) and it resulted in significantly higher yield under water stress condition (+ 15%, p < 0.01) and optimal water supply (+ 2%, p < 0.05). The elongated cycle has a positive effect on yield under any combination of options. Moreover, higher yields projected for the ideotype implicate more crop residues to be incorporated into the soil, which are positively correlated with the SOC sequestration and negatively with N leaching. The crop N uptake is expected to be adequate in view of higher rate of soil mineralization; the N fertilization rate of 400 kg N ha− 1 will involve significant increasing of grain yield, and it is expected to involve a higher rate of SOC sequestration.
|
|
Bellocchi, G., Rivington, M., & Acutis, M. (2014). Deliberative processes for comprehensive evaluation of agro-ecological models. FACCE MACSUR Mid-term Scientific Conference, 3(S) Sassari, Italy.
Abstract: Biophysical models are acknowledged for examining interactions of agro-ecological systems and fostering communication between scientists, managers and the public. As the role of models grows in importance, there is an increase in the need to assess their quality and performance (Bellocchi et al., 2010). However, the heterogeneity of factors influencing model outputs makes it difficult a full assessment of model features. Where models are used with or for stakeholders then model credibility depends not only on the outcomes of well-structured statistical evaluation but also less tangible factors may need to be addressed using complementary deliberative processes. To expand our horizons in the evaluation of crop and grassland models, approaches have been reviewed with emphasis on using combined metrics. Comprehensive evaluation of simulation models was developed to integrate expectations of stakeholders via a weighting system where lower and upper fuzzy bounds are applied to a set of evaluation metrics. A questionnaire-based survey helped understanding the multi-faceted knowledge and experience required and the substantial challenges posed by the deliberative process. MACSUR knowledge hub holds potential to advance in good modelling practice in relation with model evaluation (including access to appropriate software tools), an activity which is frequently neglected in the context of time-limited projects.
|
|
Sanna, M., Acutis, M., & Bellocchi, G. (2014). Interrelationship between evaluation metrics to assess agro-ecological models. FACCE MACSUR Mid-term Scientific Conference, 3(S) Sassari, Italy.
Abstract: When evaluating the performances of simulation models, the perception of the quality of the outputs may depend on the statistics used to compare simulated and observed data. In order to have a comprehensive understanding of model performance, the use of a variety of metrics is generally advocated. However, since they may be correlated, the use of two or more metrics may convey the same information, leading to redundancy. This study intends to investigate the interrelationship between evaluation metrics, with the aim of identifying the most useful set of indicators, for assessing simulation performance. Our focus is on agro-ecological modelling. Twenty-three performance indicators were selected to compare simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Indicators were calculated on large data sets, collected to effectively apply correlation analysis techniques. For each variable, the interrelationship between each pair of indicators was evaluated, by computing the Spearman’s rank correlation coefficient. A definition of “stable correlation” was proposed, based on the test of heterogeneity, allowing to assess whether two or more correlation coefficients are equal. An optimal subset of indicators was identified, striking a balance between number of indicators, amount of provided information and information redundancy. They are: Index of Agreement, Squared Bias, Root Mean Squared Relative Error, Pattern Index, Persistence Model Efficiency and Spearman’s Correlation Coefficient. The present study was carried out in the context of CropM-LiveM cross-cutting activities of MACSUR knowledge hub.
|
|
Pirttioja, N., Carter, T. R., Fronzek, S., Bindi, M., Hoffmann, H., Palosuo, T., et al. (2015). Temperature and precipitation effects on wheat yield across a European transect: a crop model ensemble analysis using impact response surfaces. Clim. Res., 65, 87–105.
Abstract: This study explored the utility of the impact response surface (IRS) approach for investigating model ensemble crop yield responses under a large range of changes in climate. IRSs of spring and winter wheat Triticum aestivum yields were constructed from a 26-member ensemble of process-based crop simulation models for sites in Finland, Germany and Spain across a latitudinal transect. The sensitivity of modelled yield to systematic increments of changes in temperature (-2 to +9°C) and precipitation (-50 to +50%) was tested by modifying values of baseline (1981 to 2010) daily weather, with CO2 concentration fixed at 360 ppm. The IRS approach offers an effective method of portraying model behaviour under changing climate as well as advantages for analysing, comparing and presenting results from multi-model ensemble simulations. Though individual model behaviour occasionally departed markedly from the average, ensemble median responses across sites and crop varieties indicated that yields decline with higher temperatures and decreased precipitation and increase with higher precipitation. Across the uncertainty ranges defined for the IRSs, yields were more sensitive to temperature than precipitation changes at the Finnish site while sensitivities were mixed at the German and Spanish sites. Precipitation effects diminished under higher temperature changes. While the bivariate and multi-model characteristics of the analysis impose some limits to interpretation, the IRS approach nonetheless provides additional insights into sensitivities to inter-model and inter-annual variability. Taken together, these sensitivities may help to pinpoint processes such as heat stress, vernalisation or drought effects requiring refinement in future model development.
|