Automated body size measurements of whales from drone videos using deep learning models. 

DeteX – analyzes drone-based videos to automatically detect and output frames containing whales.

XtraX – automatically extracts body size (length and condition) measurements from input frames.

To download: https://github.com/karkisa/special-train?tab=readme-ov-file 

 

An overview of the DeteX and XtraX workflow is shown below. DeteX uses an object detection model to analyze aerial videos and automatically detects and save frames that contain whales at the surface. XtraX uses input frames to identify keypoints on the whale and applies a Segment Anything Model to extract body length and body condition measurements.