Finger Lakes – A radical collaboration between Cornell Biologist and Engineer is working hard to protect grape crops. The technology, developed using robotics and artificial intelligence (II) to identify pesticide-infected vines, has recently been made available to researchers working in various botanical and animal studies.
Biologist, Lance Cadley-Davidson, Ph.D. “03”, an assistant professor at the Institute of Plant Sciences (SIPS), is working to develop grapes that are more resistant to powdery mildew, but the laboratory study was forced to manually evaluate thousands of leaf samples. Infectious disease.
The fungus, which attacks many plants, including mildew, wine, and table wine, leaves white scars on leaves and fruits, costing wine producers around the world billions of dollars a year in lost fruit and mushrooms.
Cadley-Davidson is a pathogen in the USDA-ARS research plant. He works in the Department of Vinegar Research in Geneva, and his team developed prototype robots protocols that can automatically scan vine leaf samples: a process called phenotyping – funded by USDA-ARS through the VitisGen2 Vineyard Project and Light and Health Research Center. This partnership led to the creation of a robot camera called the BlackBerry. But extracting relevant biological information from these images was still an important interest.
Enter Engineer and Computer Scientist – Yu Jiang, Assistant Research Professor in SIPS Gardening Department at Cornell Agritech. Jiang’s research focuses on system engineering, data analysis, and artificial intelligence. The BlackBerry robot can measure data at 1.2 microns per pixel – with a standard optical microscope. The robot provides 8,000 by 5,000 pixels for each 1 cm of leaf sample.

Extracting useful information from such a large, high-resolution image was Yanyan’s challenge, and his team used AI. Using face-to-face discoveries in deep neural networks designed for computer vision, Jiang applied this knowledge to microscopic grapes. Jiang and his team also applied the visualization of network transmission processes to help biologists better understand the analysis process and build trust in II models.
Working together, the Cadle-Davidson team examines and verifies what the robots see, enabling the Jiang team to teach them how to more effectively identify biological characteristics. The results are impressive, says Cadley-Davison. Six months of research experiments to complete the entire laboratory team now take BlackBerry robots in just one day.
“Our science has revolutionized,” says Cadley-Davidson. And we know that II tools really do a better job of explaining the genes of these grapes.
In July alone, the partnership received a prize and two new grants. On July 1, the team received a $ 100,000 grant from USDA-ARS to distribute to BlackBard field offices working on other high-yielding crops.
“We look forward to finding cooperative laboratories that will join us in using this tool,” Jiang said. We look at possible applications for this research in herbal studies, animal husbandry, or medical purposes.
At the 2021 Annual International Conference of the American Association of Agricultural and Biological Engineers, the team won the Paper Award for Information Technology, Sensor and Control Systems. And on July 27, Cornell was awarded a two-year $ 150,000 grant from the Cornell Digital Agricultural Research Innovation Fund to begin upgrading the BlackBerry robot to infrared beyond the red-green-blue tissue.
Plant diseases such as powdery mildew can appear in infrared before they can be seen; If researchers are able to develop tools to help early detection of disease, it will allow farmers to target fungal pesticides before the infection spreads, which means reducing the number of fungi and lost crops. They are working to integrate AI efficiently with scientists in data analysis.
“This work is accelerating the growth of wine and genetics,” said Donald Brown, president of the National Wine Research Alliance. Traditionally, when we invest in research in industries, we know that we will never see the results of our investments in our lifetime: it is really a trust-based investment in the next generation of manufacturers. But now this technology is really shortening that time line for the benefit of farmers and consumers.