|
|
Zhao, G., Hoffmann, H., Yeluripati, J., Xenia, S., Nendel, C., Coucheney, E., et al. (2016). Evaluating the precision of eight spatial sampling schemes in estimating regional means of simulated yield for two crops. Env. Model. Softw., 80, 100–112.
Abstract: We compared the precision of simple random sampling (SimRS) and seven types of stratified random sampling (StrRS) schemes in estimating regional mean of water-limited yields for two crops (winter wheat and silage maize) that were simulated by fourteen crop models. We found that the precision gains of StrRS varied considerably across stratification methods and crop models. Precision gains for compact geographical stratification were positive, stable and consistent across crop models. Stratification with soil water holding capacity had very high precision gains for twelve models, but resulted in negative gains for two models. Increasing the sample size monotonously decreased the sampling errors for all the sampling schemes. We conclude that compact geographical stratification can modestly but consistently improve the precision in estimating regional mean yields. Using the most influential environmental variable for stratification can notably improve the sampling precision, especially when the sensitivity behavior of a crop model is known.
|
|
|
|
Challinor, A. J., Müller, C., Asseng, S., Deva, C., Nicklin, K. J., Wallach, D., et al. (2017). Improving the use of crop models for risk assessment and climate change adaptation. Agric. Syst., 159, 296–306.
Abstract: Highlights
• 14 criteria for use of crop models in assessments of impacts, adaptation and risk • Working with stakeholders to identify timing of risks is key to risk assessments. • Multiple methods needed to critically assess the use of climate model output • Increasing transparency and inter-comparability needed in risk assessments
Abstract
Crop models are used for an increasingly broad range of applications, with a commensurate proliferation of methods. Careful framing of research questions and development of targeted and appropriate methods are therefore increasingly important. In conjunction with the other authors in this special issue, we have developed a set of criteria for use of crop models in assessments of impacts, adaptation and risk. Our analysis drew on the other papers in this special issue, and on our experience in the UK Climate Change Risk Assessment 2017 and the MACSUR, AgMIP and ISIMIP projects. The criteria were used to assess how improvements could be made to the framing of climate change risks, and to outline the good practice and new developments that are needed to improve risk assessment. Key areas of good practice include: i. the development, running and documentation of crop models, with attention given to issues of spatial scale and complexity; ii. the methods used to form crop-climate ensembles, which can be based on model skill and/or spread; iii. the methods used to assess adaptation, which need broadening to account for technological development and to reflect the full range options available. The analysis highlights the limitations of focussing only on projections of future impacts and adaptation options using pre-determined time slices. Whilst this long-standing approach may remain an essential component of risk assessments, we identify three further key components: 1. Working with stakeholders to identify the timing of risks. What are the key vulnerabilities of food systems and what does crop-climate modelling tell us about when those systems are at risk? 2. Use of multiple methods that critically assess the use of climate model output and avoid any presumption that analyses should begin and end with gridded output. 3. Increasing transparency and inter-comparability in risk assessments. Whilst studies frequently produce ranges that quantify uncertainty, the assumptions underlying these ranges are not always clear. We suggest that the contingency of results upon assumptions is made explicit via a common uncertainty reporting format; and/or that studies are assessed against a set of criteria, such as those presented in this paper.
|
|
|
|
Mansouri, M., Dumont, B., Leemans, V., & Destain, M. - F. (2014). Bayesian methods for predicting LAI and soil water content. Precision Agric., 15(2), 184–201.
Abstract: LAI of winter wheat (Triticum aestivum L.) and soil water content of the topsoil (200 mm) and of the subsoil (500 mm) were considered as state variables of a dynamic soil-crop system. This system was assumed to progress according to a Bayesian probabilistic state space model, in which real values of LAI and soil water content were daily introduced in order to correct the model trajectory and reach better future evolution. The chosen crop model was mini STICS which can reduce the computing and execution times while ensuring the robustness of data processing and estimation. To predict simultaneously state variables and model parameters in this non-linear environment, three techniques were used: extended Kalman filtering (EKF), particle filtering (PF), and variational filtering (VF). The significantly improved performance of the VF method when compared to EKF and PF is demonstrated. The variational filter has a low computational complexity and the convergence speed of states and parameters estimation can be adjusted independently. Detailed case studies demonstrated that the root mean square error of the three estimated states (LAI and soil water content of two soil layers) was smaller and that the convergence of all considered parameters was ensured when using VF. Assimilating measurements in a crop model allows accurate prediction of LAI and soil water content at a local scale. As these biophysical properties are key parameters in the crop-plant system characterization, the system has the potential to be used in precision farming to aid farmers and decision makers in developing strategies for site-specific management of inputs, such as fertilizers and water irrigation.
|
|
|
|
Bellocchi, G., Rivington, M., Matthews, K., & Acutis, M. (2015). Deliberative processes for comprehensive evaluation of agroecological models. A review. Agron. Sust. Developm., 35(2), 589–605.
Abstract: The use of biophysical models in agroecology has increased in the last few decades for two main reasons: the need to formalize empirical knowledge and the need to disseminate model-based decision support for decision makers (such as farmers, advisors, and policy makers). The first has encouraged the development and use of mathematical models to enhance the efficiency of field research through extrapolation beyond the limits of site, season, and management. The second reflects the increasing need (by scientists, managers, and the public) for simulation experimentation to explore options and consequences, for example, future resource use efficiency (i.e., management in sustainable intensification), impacts of and adaptation to climate change, understanding market and policy responses to shocks initiated at a biophysical level under increasing demand, and limited supply capacity. Production concerns thus dominate most model applications, but there is a notable growing emphasis on environmental, economic, and policy dimensions. Identifying effective methods of assessing model quality and performance has become a challenging but vital imperative, considering the variety of factors influencing model outputs. Understanding the requirements of stakeholders, in respect of model use, logically implies the need for their inclusion in model evaluation methods. We reviewed the use of metrics of model evaluation, with a particular emphasis on the involvement of stakeholders to expand horizons beyond conventional structured, numeric analyses. Two major topics are discussed: (1) the importance of deliberative processes for model evaluation, and (2) the role computer-aided techniques may play to integrate deliberative processes into the evaluation of agroecological models. We point out that (i) the evaluation of agroecological models can be improved through stakeholder follow-up, which is a key for the acceptability of model realizations in practice, (ii) model credibility depends not only on the outcomes of well-structured, numerically based evaluation, but also on less tangible factors that may need to be addressed using complementary deliberative processes, (iii) comprehensive evaluation of simulation models can be achieved by integrating the expectations of stakeholders via a weighting system of preferences and perception, (iv) questionnaire-based surveys can help understand the challenges posed by the deliberative process, and (v) a benefit can be obtained if model evaluation is conceived in a decisional perspective and evaluation techniques are developed at the same pace with which the models themselves are created and improved. Scientific knowledge hubs are also recognized as critical pillars to advance good modeling practice in relation to model evaluation (including access to dedicated software tools), an activity which is frequently neglected in the context of time-limited framework programs.
|
|
|
|
Martre, P., Wallach, D., Asseng, S., Ewert, F., Jones, J. W., Rötter, R. P., et al. (2015). Multimodel ensembles of wheat growth: many models are better than one. Glob. Chang. Biol., 21(2), 911–925.
Abstract: Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.
|
|
