From Birdsong to Rumbles: Classifying Elephant Calls with Out-of-Species Embeddings
Abstract
We show that pretrained acoustic embeddings classify elephant vocalisations at a level approaching that of end-to-end supervised neural networks, without any fine-tuning of the embedding model. This result is of practical importance because annotated bioacoustic data are scarce and costly to obtain, leaving conventional supervised approaches prone to overfitting and to poor generalisation under domain shift. A broad range of embedding models drawn from general audio, speech, and bioacoustic domains is evaluated, all of which are either out-of-domain (containing no bioacoustic data) or out-of-species (containing no elephant call data). The embedding networks themselves remain fixed; only the lightweight downstream classifiers, which include a linear model and several small neural networks, are trained. Among the models considered, Perch 2.0 achieves the best cross-validated classification performance, attaining AUCs of 0.849 on African bush elephant (Loxodonta africana) calls and 0.936 on Asian elephant (Elephas maximus) calls, with Perch 1.0 close behind. The best-performing system is within 2.2 % of an end-to-end supervised elephant call classification system. A layerwise analysis of pretrained transformer encoders, considered as embedding models, shows that intermediate representations outperform final-layer outputs. The second layer of both wav2vec2.0 and HuBERT encodes sufficient information for effective elephant call classification; truncation at this layer therefore preserves classification performance whilst retaining only approximately 10 % of the parameters of the full network. Such compact embedding networks are well suited to on-device processing where computational resources are limited.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents a pioneering evaluation of elephant call classification using pretrained acoustic embeddings, achieving significant performance without fine-tuning. This work not only advances the field of bioacoustics but also sets a precedent for leveraging existing models in low-data scenarios, thereby enhancing conservation efforts through automated analysis of wildlife vocalizations.
Methodology
The paper introduces a novel approach to elephant call classification using pretrained acoustic embeddings without fine-tuning, which is significant given the scarcity of annotated bioacoustic data. The methodology is well-structured, employing a variety of embedding models from different domains and evaluating their performance with lightweight classifiers. The choice to analyze intermediate layers of transformer models for their efficacy in classification is particularly innovative, providing insights into the model's internal representations. The segmentation and classification processes are clearly defined, ensuring a robust experimental design.
Results & evaluation
The experiments are comprehensive, utilizing two distinct datasets for evaluation, which enhances the validity of the results. The performance metrics, including AUC and MAP, are appropriate for the classification task and allow for a nuanced understanding of model effectiveness. The results demonstrate that the best-performing embedding model, Perch 2.0, achieves competitive performance compared to end-to-end supervised models, highlighting the potential of using out-of-domain embeddings in low-resource settings.
Reproducibility
The paper provides sufficient detail regarding the experimental setup, including data segmentation, model configurations, and hyperparameter tuning, which supports reproducibility. However, the lack of publicly available code or datasets limits the ease with which other researchers can replicate the study.
Limitations
One notable limitation is the reliance on pretrained models that may not be strictly out-of-species, particularly with Perch 2.0, which raises questions about the generalizability of the findings. Additionally, the paper does not address potential biases in the datasets or the implications of using embeddings from models trained on other species.
Broader impact
The implications of this research extend beyond elephant call classification, as it demonstrates the utility of pretrained embeddings in bioacoustics, potentially influencing conservation strategies and wildlife management. The approach could be adapted for other endangered species, promoting the use of machine learning in ecological research and conservation efforts. The paper presents a pioneering evaluation of elephant call classification using pretrained acoustic embeddings, achieving significant performance without fine-tuning. This work not only advances the field of bioacoustics but also sets a precedent for leveraging existing models in low-data scenarios, thereby enhancing conservation efforts through automated analysis of wildlife vocalizations.
Author of this paper? Send a correction.