loading page

Integration of multi-modal proximal remote sensing data for improved prediction of agronomically important crop traits
  • +9
  • Erin Farmer,
  • Ruyu Yan,
  • Peter Michael,
  • Nick Lepak,
  • Cinta Romay,
  • Ed Buckler,
  • Noah Snavely,
  • Ying Sun,
  • Kelly Robbins,
  • Joe Gage,
  • Abe Davis,
  • Michael Gore
Erin Farmer
Plant Breeding and Genetics Section, School of Integrative Plant Science, Cornell University

Corresponding Author:[email protected]

Author Profile
Ruyu Yan
Department of Computer Science, Cornell University
Peter Michael
Department of Computer Science, Cornell University
Nick Lepak
Department of Agriculture-Agricultural Research Service, Robert W. Holley Center for Agriculture and Health
Cinta Romay
Institute for Genomic Diversity, Cornell University
Ed Buckler
Department of Agriculture-Agricultural Research Service, Robert W. Holley Center for Agriculture and Health, Institute for Genomic Diversity, Cornell University, Plant Breeding and Genetics Section, School of Integrative Plant Science, Cornell University
Noah Snavely
Cornell Tech, Cornell University
Ying Sun
Soil and Crop Sciences Section, School of Integrative Plant Science, Cornell University
Kelly Robbins
Plant Breeding and Genetics Section, School of Integrative Plant Science, Cornell University
Joe Gage
Department of Crop and Soil Sciences, North Carolina State University
Abe Davis
Department of Computer Science, Cornell University
Michael Gore
Plant Breeding and Genetics Section, School of Integrative Plant Science, Cornell University

Abstract

Recent advancements in proximal remote sensing have increased the spatial and temporal resolution of data collection, as well as the availability of these technologies for applications to precision agriculture. These sensors have allowed the collection of new and large quantities of data, which have been used to successfully determine phenotypes and parametrize crop growth models. So far, these data streams have been mostly used separately, though they contain unique structural, spatial, and spectral information. Thus, this research aims to integrate these disparate data sources to improve estimations of agronomically important crop traits. In this study, we examine two high-throughput and relatively inexpensive remote platforms: unoccupied ground vehicles (UGV) and unoccupied aerial vehicles (UAV). Data were collected on maize hybrids from the Genomes to Fields initiative over 5 years, from 2018 to 2022, in Aurora, NY. We used ground rovers to collect lidar scans, which were converted to point clouds, to construct the three-dimensional sub-canopy architecture of maize plants. Multispectral sensors, covering red, green, blue, red-edge, and near infrared (NIR) were deployed on a UAV platform to characterize maize canopies. Machine learning methods, including autoencoders, will be used to extract latent phenotypes from the lidar point clouds and multispectral images. Ultimately, these will be used to predict manually measured traits, such as yield, in order to compare the prediction accuracies of models using these measurements separately and jointly.  
13 Jan 2023Submitted to NAPPN 2023 Abstracts
14 Jan 2023Published in NAPPN 2023 Abstracts