Automated body length and body condition of whales from drone videos using deep learning models.
DeteX – analyzes drone-based videos to automatically detect and output frames containing whales.
XtraX – automatically extracts body size (length and condition) measurements from input frames.
To download: https://github.com/karkisa/special-train?tab=readme-ov-file
Tutorials: See this blog for a quick walk-through on how to use DeteX and XtraX. Watch the video tutorial here.
Manuscript: Bierlich, K.C.*, Karki, S.*, Bird, C. N., Fern, A., & Torres, L. G. (2024). Automated body length and body condition measurements of whales from drone videos for rapid assessment of population health. Marine Mammal Science, e13137. https://doi.org/10.1111/mms.13137 *indicates co-lead author
An overview of the DeteX and XtraX workflow is shown below. DeteX uses an object detection model to analyze aerial videos and automatically detects and save frames that contain whales at the surface. XtraX uses input frames to identify keypoints on the whale and applies a Segment Anything Model to extract body length and body condition measurements.
