Future Farm – the potential value in data-driven N decisions
Future Farm – the potential value in data-driven N decisions
Author: Brett Whelan (Future Farm), Andre Colaco (Future Farm) | Date: 28 Feb 2023
Take home message
- Current methods for calculating in-season nitrogen requirements based on a single sensor and simplistic agronomic decision frameworks can match the performance of good farmer management decisions at the uniform field-rate level
- The way to improve the accuracy and profitability of nitrogen rate decisions when the uniform-rate decisions are near optimal is by increasing the spatial resolution of management
- Empirical, multivariate, data-driven methods for predicting the site-specific, economically optimum nitrogen application rate (EONR) have potential to successfully increase the spatial resolution of decisions and reduce the error and increase profitability of fertiliser management (~$50/ha in this study)
- Data availability is critical to enable data-driven prediction methods and increase profitability. On-farm experimentation (OFE) is a critical enabler of these data-driven decision tools as they allow the automated collection of large digital datasets of crop response to applied nutrients that are needed to train the algorithms. Such OFE should be adopted as a core element of farm business operation to support decision optimisation
- Farm businesses that collect and maintain relevant production response and resource data will be able to push closer towards season- and site-specific economically optimum operations.
Introduction
Future Farm is a research program combining skills from CSIRO, USYD, USQ, QUT and AgVIC. It aimed to re‐examine and improve the way in which on-farm soil and crop sensors, and digital data from elsewhere, could be used to improve decisions about input management and explore automation of the process from data acquisition, through analysis, to the formulation and implementation of decision options. The research focused on nitrogen application decisions, but the concept could be applied to any rate-based inputs (e.g., lime, gypsum and other nutrients).
Methods
A program of on-farm experiments (OFE) was established at sites across the three GRDC regions that were designed to document the local yield and protein response to applied nitrogen. The trials included three application rates: a zero (or reduced) nitrogen rate, a farm decision nitrogen rate, and a high nitrogen rate that ensures nitrogen should be non- limiting. The nitrogen rate treatments were placed adjacent to each other in strips or plots and the treatments were applied to run through zones of predetermined potential management classes in each field site (Figure 1). Data was gathered from the OFE in-season and the harvest data from the OFE was used to evaluate and compare the benefits of a range of different methods that the team designed that use digital data from a range of sources (Appendix 1) to ultimately predict the N requirement in different agro-ecological zones across Australia.
Figure 1. An example of a field trial layout (left) and grain quality data (right) for a site in Northern NSW.
Assessment of nitrogen recommendation models
The assessment process was designed to provide a comparison between the average ability of the different methods designed by the team to predict nitrogen requirement across the sites, in terms of both average accuracy and average profitability. The assessment process also allows the developed methods to be compared against the current farm decision approach (a whole-paddock uniform rate decision) and also against a number of currently used ‘benchmark’ methods. A number of simple methods for predicting nitrogen requirement using Normalized Difference Vegetation Index (NDVI) and Normalized Difference Red Edge (NDRE) indices calculated from ground-based Crop Circle sensors (CC) and satellite systems (Sentinel) have also been included. These provide an evaluation of a digital, single sensor approach to N estimation. In all, 15 different models were produced and tested, however Table 1 shows the models employed in the final comparison process.
Yield and protein data were obtained from the OFE using commercially-available, harvester-mounted yield and protein sensors. A regression analysis was performed between applied N rates and the harvest data (grain yield and protein) along the length of the trial strips, fitting a quadradic model to the response data using a moving window approach (Figure 2). This process provided site-specific functions at a 10 m scale for each site (site-specific management analysis) which could then be aggregated up to an average response function for each potential management class where possible (potential management class analysis) or an average single response function for the whole paddock (whole-paddock uniform management analysis).
From these functions the economically optimal N rate (EONR) was calculated as the rate that maximised partial profit (harvest income minus expenditure on N fertiliser). The harvest income was calculated based on the average grain price between 2018 and 2020 adjusted for protein premiums based on Table 2. The EONR is regarded here as the ultimate nitrogen application rate decision against which all the recommendation and benchmark methods were compared. The comparison was made in terms of the prediction accuracy of each method (root mean squared error, RMSE) and also the resultant partial profit. The partial profits for the different prediction methods were obtained by inserting the nitrogen recommendations from each into the respective partial profit response functions for each site.
The results of the comparative assessment are tabulated in Table 3 where the methods are ranked on normalised partial profit (NPP) achieved. The NPP is the partial profit achieved for each prediction method normalised against the EONR partial profit values for each site at the different management scales. In Figure 3, each method is plotted based on the average achieved across all sites for RMSE and NPP. The results are only shown here for the site-specific and whole-paddock management levels to enable a clearer view of the comparison.
Table 1. Methods included for in-season prediction of nitrogen requirement.
Label | Approach | Description |
---|---|---|
EONR | Ex-post reference | Observed N rate that maximised partial profit. |
Max yield | Ex-post reference | Observed N rate that maximised grain yield. |
Farmer | Benchmark method | Farmer decision for application rate. |
Simplified mass balance | Benchmark method | A mass balance calculation from publicly available water-limited yield potential data, used as a standard commercial agronomist comparison. |
Yield prediction | Digital method based on yield prediction | Inspired by the ‘Nitrogen fertilisation optimisation algorithm’, a mass balance back calculation from estimated yield using NDVI and a simple linear regression model. |
Yield prediction | Digital method based on yield prediction | As per ‘Yield prediction (LM)’ but using multiple variables and a Random Forest model for yield prediction instead of the linear regression. |
Response function | Digital method based on crop response prediction | Inspired by the Crop Circle (CC) approach, the N rate that maximised the Crop Circle NDVI based on a mid-season response function of vegetation index vs N rate. |
Response function | Digital method based on crop response prediction | As per ‘Response function (NDVI CC)’ but using NDRE instead of NDVI. |
Response function | Digital method based on crop response prediction | As per ‘Response function (NDVI CC)’ but using Sentinel 2 data instead of Crop Circle. |
Response function | Digital method based on crop response prediction | As per ‘Response function (NDVI Sent)’ but using NDRE instead of NDVI. |
N sufficiency | Digital method based on N sufficiency | N sufficiency approach based on machine vision data. |
DD | Digital method based on an empirical, data-driven approach | Data-driven model; the site and season conditions at which the model is validated are well represented in the data used to build the model |
DD | Digital method based on an empirical, data-driven approach | Data-driven model; the site and season conditions at which the model is validated are not well represented in the data used to build the model |
Figure 3 shows that as accuracy in prediction of nitrogen required increases (decreasing RMSE), partial profit increases, but the rate of increase diminishes as the methods become more accurate. This result reflects the often ‘flat’ profit response to applied N around the optimum rate which can limit the improvement in profitability through greater accuracy. However, while the rate of increase in NPP slows, the increase in accuracy means an application rate closer to target is more often achieved, bringing a commensurate decrease in the risk associated with N management. Thus, reducing the error improves the chance of getting the management decision correct (or less chance of making an incorrect decision) and increases farmer confidence in the decision. Better targeting of nitrogen application rates to optimum also has implications for minimising potential environmental impact.
Figure 2. An example of the moving window regression analysis at one point along a strip trial at a site in SA.
Table 2. Average grain grade and nitrogen prices applied in partial profit analysis.
Item | Grade | Grain protein | Adjustment | Price |
---|---|---|---|---|
Wheat | ASW1 | <10.5 | 0.85 | 261.80 |
Wheat | APW1 | 10.5 – 11.5 | 1 (base) | 308.00 |
Wheat | H2 | 11.5 – 13 | 1.05 | 323.40 |
Wheat | H1 | >13 | 1.1 | 338.80 |
Barley | Malting | 9 – 12 | 1 (base) | 300.00 |
Barley | Feed | <9 or >12 | 0.92 | 277.00 |
Urea (46% N) | - | - | - | 500.00 |
The best future farm method was the data-driven model (DD data abundance), which represents a situation where a database is available for fields that provides information on past OFE and production response and associated environmental data that encompasses the variation in production that can be achieved in that field. This method succeeds in providing better estimates than the average farm- based decision (farmer) at all management scales. At the whole-field uniform and site-specific management scales, the DD (data abundance) can improve NPP by 2% ($14/ha) and 5% ($47/ha) respectively, over the average Farmer method (Table 3; Figure 3).
Table 3. Results of the comparison of methods for predicting N requirement along with benchmark methods for comparison. Methods ranked on normalised partial profit achieved.
Method | Scale | RMSE | Normalised partial | NPP |
---|---|---|---|---|
EONR | Site-specific | 0.0 | 1.00 | 1000 |
DD (data abundance) | Site-specific | 15.6 | 0.99 | 990 |
Max yield | Site-specific | 35.6 | 0.97 | 972 |
DD (data abundance) | Uniform | 34.5 | 0.96 | 960 |
EONR | Uniform | 34.5 | 0.96 | 959 |
Max yield | Uniform | 40.2 | 0.95 | 948 |
Farmer | Uniform | 42.8 | 0.94 | 943 |
Resp func (NDVI Sent) | Uniform | 48.6 | 0.93 | 930 |
Yield prediction (RF) | Uniform | 44.0 | 0.93 | 928 |
N sufficiency (MV) | Uniform | 42.1 | 0.93 | 927 |
Yield prediction (RF) | Site-specific | 44.0 | 0.93 | 926 |
Yield prediction (LM) | Uniform | 44.7 | 0.93 | 926 |
Yield prediction (LM) | Site-specific | 44.8 | 0.93 | 926 |
N sufficiency (MV) | Site-specific | 44.4 | 0.92 | 922 |
DD (data limited) | Uniform | 45.8 | 0.91 | 913 |
Simplified mass balance | Uniform | 46.2 | 0.91 | 910 |
Resp func (NDRE Sent) | Uniform | 57.0 | 0.91 | 909 |
DD (data limited) | Site-specific | 46.0 | 0.91 | 907 |
Resp func (NDVI CC) | Uniform | 48.3 | 0.90 | 897 |
Resp func (NDRE CC) | Uniform | 51.0 | 0.88 | 884 |
Resp func (NDVI Sent) | Site-specific | 56.6 | 0.87 | 870 |
Resp func (NDRE Sent) | Site-specific | 63.6 | 0.86 | 859 |
Resp func (NDVI CC) | Site-specific | 55.9 | 0.85 | 851 |
Resp func (NDRE CC) | Site-specific | 56.9 | 0.85 | 846 |
The farmer recommendation is on average 2% ($14/ha) lower in NPP than the average uniform EONR (Table 3). All the farmers involved in the project were skilled in using Precision Agriculture technologies in farm management and the result here confirms that they were very good at calculating nitrogen requirement for the seasons under study. Aside from the top performing (DD data abundance) method, a number of the other digital mechanistic sensor-based methods (e.g., ‘Yield prediction (RF)’, ‘Response function (NDVI Sent)’ and ‘N sufficiency MV’) approached within 1% ($13 - $16/ha) of the Farmer decision level of average profit and accuracy at the uniform application scale (Table 3; Figure 3). The response function approach was sensitive to the type of input data, that is, some combinations of vegetation indices and their data sources may match a profit response function better than others.
For the fields in this study, the sensor-based response function that most resembled the final profit function was the one derived from Sentinel 2 NDVI. Since Sentinel data can be accessed for free, the fact that it out-performed the methods which used proximal crop sensors represents an important result for farmer adopters of such PA technologies. The ‘N sufficiency’ method, a less common sensor-based approach, had a similar performance to the ‘yield prediction’ methods.
Figure 3. Profitability (y axis) verses accuracy (x axis, root mean squared error) of methods for N recommendation averaged across trial sites at uniform and site-specific management scales. All relevant sites utilised.
However, apart from the DD (data abundance) approach, all the other methods performed worse on average when implemented at the site-specific scale as compared to the unform application scale (Figure 3) because of their larger recommendation error. In some cases, using the methods to calculate a uniform application rate reduced the error substantially, suggesting that methods in which the recommendation error is expected to be large are better implemented as the average for the field instead of site-specifically.
The variables that proved of most importance for the DD (data abundance) method were the Sentinel NDVI from each N strip, historic yield monitor data, accumulated rainfall to GS31 and the historic NDRE (95th percentile). For the mechanistic models that predicted yield in order to calculate a nitrogen recommendation rate, the most important variables were historic yield monitor data, accumulated rainfall to GS31, Sentinel NDRE at GS31 from all strips and historic NDRE (5th percentile). From this it is clear that information derived from the OFE are crucial for these prediction methods.
The average results shown in Figure 3 also suggest that. Moving towards a more site-specific nitrogen management approach may be more achievable in all locations using an approach that includes more information that is able to describe the range of site and season variables that impact the response to nitrogen.
Conclusions
From assessing these varied model types over multiple sites in five States, it appears the farmers in this study are operating near the optimum management level at the uniform paddock scale, for the seasons included, and they would need to move towards site-specific decisions using a data-driven approach with more data in order to improve the accuracy and profitability of nitrogen requirement decisions. The methods built here require further development and testing. However, the data-driven approach with increasing levels of OFE data for directly predicting ONR appears to be a promising target methodology for improving site-specific decisions. Using the methodology at the uniform paddock scale would also be a viable approach to improve uniform management decisions on farms where uncertainty in decisions at that level remain high.
The data-driven approach relies on data availability to ensure the method performs at its optimum. Its success at all management scales in this assessment provides a significant pointer towards a future where farm businesses that collect and maintain relevant production response and resource data will be able to push closer towards season- and site-specific economically optimum operations.
A system in which farmers share OFE data across larger communities may also play a crucial role in building the necessary database for empirical DD approaches. Improvements can be gained as soon as more OFE data is collected and made available from farms. However, as formalised OFE is an exception rather than a rule across farming operations, this means it is not an approach that can currently be employed by every farmer.
Acknowledgements
The research undertaken as part of this project is made possible by the significant contributions of growers through trial cooperation and the support of the GRDC, the authors thank them for their continued support. This research was cofounded by the Commonwealth Scientific and Industrial Research Organisation (CSIRO), the University of Sydney, Agriculture Victoria, the University of Southern Queensland, the Queensland University of Technology and the GRDC. The authors are also most grateful to the various collaborating farmers who have provided us with commercial cereal fields in which to develop and test our methods – Ashley Wakefield, Ben Pratt, Bob Nixon, Ed Hunt, Jessica and Joe Koch, Mark and Sam Branson, Mark Swaffer, Rob Cole, Robin Schaeffer, Stuart Modra, Kieran Shephard and Peter Bell.
Contact details
Brett Whelan
Precision Agriculture Laboratory
University of Sydney, 1 Central Avenue, South Eveleigh, NSW 2015
Ph: 02 8627 1132
Email: brett.whelan@sydney.edu.au
Date published: March 2023
Appendix 1. List of variables available for use in digital N recommendations.
Group | Variable | Description | Source | Spatial scale | Timing of collection |
---|---|---|---|---|---|
Field history | Historic yield | Average yield from previous 3 to 4 years of wheat and barley crops | Onboard yield monitoring | Site-specific (interpolated at 5 m pixels) | Previous seasons |
Field history | Yield potential | Water limited yield potential (t/ha) at the local level | Yield Gap Australia – CSIRO | Field-scale | Previous seasons |
Field history | Historic yield (public) | Historic average yield | ABARES | Field-scale | Previous seasons |
Field history | Historic crop indices | 5th and 95th NDRE percentiles from historic imagery | Landsat 8 | Site-specific (30 m pixels) | Previous seasons |
In-season crop sensing | Vegetation indices | NDVI and NDRE | Crop Circle sensor | Site-specific (point data along the strips) | GS-31 |
In-season crop sensing | Vegetation indices | NDVI and NDRE | Sentinel 2 | Site-specific (10 m pixels) | GS-31 (nearest image to the Crop Circle sensing date) |
In-season crop sensing | Machine Vision features | NGRDI, NRBDI and canopy cover | RGB camera | Site-specific (point data along the strips) | GS-31 |
Soil/ | Soil bulk density | Soil bulk density at the top 0.3 m layer | ASRIS | Field-scale | - |
Soil/ | Soil clay content | Soil clay content at the top 0.3 m layer | ASRIS | Field-scale | - |
Soil/ | Soil pH | Soil pH (CaCl2) at the top 0.3 m layer | ASRIS | Field-scale | - |
Soil/ | Gamma radiometry | U238, Th232 and K40 radiometry from airborne gamma-ray spectrometric survey | Radiometric Grid of Australia | Site-specific (100 m pixels) | - |
Soil/ | Aspect, hill shade and slope | Landscape attributes from digital elevation model | Digital Elevation Model of Australia | Site-specific (30 m pixels) | - |
Weather | Evapotranspiration | Total evapotranspiration | MODIS | Field-scale | Between sowing and GS-31 |
Weather | Phase and amplitude | Model parameters (phase and amplitude) of a sinusoid function fitted to a land surface temperature dataset | MODIS | Field-scale | - |
Weather | Degree days | Summed daily mean temperatures | BOM | Field-scale | Between sowing and GS-31 |
Weather | Rainfall | Total daily rainfall, and accumulated since sowing, aggregated into weekly intervals | BOM | Field-scale | Between sowing and GS-31 |
Weather | Maximum temperature | Summed daily maximum temperature, and accumulated since sowing, aggregated into weekly intervals | BOM | Field-scale | Between sowing and GS-31 |
GRDC Project Code: CSP1803-020RMX,