Sanna, M., Acutis, M., & Bellocchi, G. (2014). Interrelationship between evaluation metrics to assess agro-ecological models. FACCE MACSUR Mid-term Scientific Conference, 3(S) Sassari, Italy.
Abstract: When evaluating the performances of simulation models, the perception of the quality of the outputs may depend on the statistics used to compare simulated and observed data. In order to have a comprehensive understanding of model performance, the use of a variety of metrics is generally advocated. However, since they may be correlated, the use of two or more metrics may convey the same information, leading to redundancy. This study intends to investigate the interrelationship between evaluation metrics, with the aim of identifying the most useful set of indicators, for assessing simulation performance. Our focus is on agro-ecological modelling. Twenty-three performance indicators were selected to compare simulated and observed data of four agronomic and meteorological variables: above-ground biomass, leaf area index, hourly air relative humidity and daily solar radiation. Indicators were calculated on large data sets, collected to effectively apply correlation analysis techniques. For each variable, the interrelationship between each pair of indicators was evaluated, by computing the Spearman’s rank correlation coefficient. A definition of “stable correlation” was proposed, based on the test of heterogeneity, allowing to assess whether two or more correlation coefficients are equal. An optimal subset of indicators was identified, striking a balance between number of indicators, amount of provided information and information redundancy. They are: Index of Agreement, Squared Bias, Root Mean Squared Relative Error, Pattern Index, Persistence Model Efficiency and Spearman’s Correlation Coefficient. The present study was carried out in the context of CropM-LiveM cross-cutting activities of MACSUR knowledge hub.
|
|
Rocca, A., Bellocchi, G., Giussani, A., Sanna, M., Perego, A., Fumagalli, M., et al. (2013). Correlation between evaluation model indicators..
|
Perego, A., Giussani, A., Fumagalli, M., Sanna, M., Chiodini, M., Carozzi, M., et al. (2013). Crop rotation, fertilizer types and application timing affecting nitrogen leaching in nitrate vulnerable zones in Po Valley. Italian Journal of Agrometeorology, 3(2), 39–50.
Abstract: A critical analysis was performed to evaluate the potential risk of nitrate leaching towards groundwater in three Nitrate Vulnerable Zones (NVZs) of the Lombardia plain by applying the ARMOSA crop simulation model over a 20 years period (1988-2007). Each studied area was characterized by (i) two representative soil types, (ii) a meteorological data set, (iii) four crop rotations according to the regional land use, (iv) organic N load, calculated on the basis of livestock density. We simulated 3 scenarios defined by different fertilization time and amount of mineral and organic fertilizers. The A scenario involved no limitation in organic N application, while under the B and C scenarios the N organic amount was 170 and 250 kg N ha(-1)y(-1), respectively. The C scenario was compliant with the requirement of the 2012 Italian derogation, allowing only the use of organic manure with an efficiency greater than 65%. The model results highlighted that nitrate leaching was significantly reduced passing from the A scenario to the B and C ones (p<0.01); on average nitrogen losses decreased by up to 53% from A to B and up to 75% from A to C.
|
Perego, A., Giussani, A., Sanna, M., Fumagalli, M., Carozzi, M., Alfieri, L., et al. (2013). The ARMOSA simulation crop model: overall features, calibration and validation results. Italian Journal of Agrometeorology, 3, 23–38.
Abstract: ARMOSA is a dynamic simulation model which was developed to simulate crop growth and development, water and nitrogen dynamics under different pedoclimatic conditions and cropping systems in the arable land. The model is meant to be a tool for the evaluation of the impact of different crop management practices on soil nitrogen and carbon cycles and groundwater nitrate pollution. A large data set collected over three to six years from six monitoring sites in Lombardia plain was used to calibrate and validate the model parameters. Measured meteorological data, soil chemical and physical characterizations, crop-related data of different cropping systems allowed for a proper parameterization. Fit indexes showed the reliability of the model in adequately predicting crop-related variables, such as above ground biomass (RRMSE=11.18, EF=0.94, r=0.97), Leaf Area Index maximum value (RRMSE=8.24, EF=0.37, r=0.72), harvest index (RRMSE=19.4, EF=0.32, r=0.74), and crop N uptake (RRMSE=20.25, EF=0.69, r=0.85). Using two different one-year data set from each monitoring site, the model was calibrated and validated, getting to encouraging results: RRMSE=6.28, EF=0.52, r=0.68 for soil water content at different depths, and RRMSE=34.89, EF=0.59, r=0.75 for soil NO3-N content along soil profile. The simulated N leaching was in full agreement with measured data (RRMSE=26.62, EF=0.88, r=0.98).
|
|
Sanna, M., Bellocchi, G., Fumagalli, M., & Acutis, M. Interrelationship and optimal choice of indicators to evaluate performance of agrometeorological models.
|
