Applying Machine Learning to Investigate Long Term Insect-Plant Interactions Preserved on Digitized Herbarium Specimens

<jats:title>Abstract</jats:title><jats:sec><jats:title>Premise of the study</jats:title><jats:p>Despite the economic importance of insect damage to plants, long-term data documenting changes in insect damage (‘herbivory’) and diversity are limited. Millions of pressed plant specimens are now available online for collecting big data on plant-insect interactions during the Anthropocene.</jats:p></jats:sec><jats:sec><jats:title>Methods</jats:title><jats:p>We initiated development of machine learning methods to automate extraction of herbivory data from herbarium specimens. We trained an insect damage detector and a damage type classifier on two distantly related plant species. We experimented with 1) classifying six types of herbivory and two control categories of undamaged leaf, and 2) detecting two of these damage categories for which several hundred annotations were available.</jats:p></jats:sec><jats:sec><jats:title>Results</jats:title><jats:p>Classification models identified the correct type of herbivory 81.5% of the time. The damage classifier was accurate for categories with at least one hundred test samples. We show anecdotally that the detector works well when asked to detect two types of damage.</jats:p></jats:sec><jats:sec><jats:title>Discussion</jats:title><jats:p>The classifier and detector together are a promising first step for the automation of herbivory data collection. We describe ongoing efforts to increase the accuracy of these models to allow other researchers to extract similar data and apply them to address a variety of biological hypotheses.</jats:p></jats:sec>