SLEAP: A deep learning system for multi-animal pose tracking

🤖 Plain-English Summary

The desire to understand how the brain generates and patterns behavior has driven rapid methodological innovation in tools to quantify natural animal behavior. SLEAP achieves greater accuracy and speeds of more than 800 frames per second, with latencies of less than 3.5 ms at full 1,024 × 1,024 image resolution.

🔑 Key Findings

• While advances in deep learning and computer vision have enabled markerless pose estimation in individual animals, extending these to multiple animals presents unique challenges for studies of social behaviors or animals in their natural environments.
• Here we present Social LEAP Estimates Animal Poses (SLEAP), a machine learning system for multi-animal pose tracking.
• This system enables versatile workflows for data labeling, model training and inference on previously unseen data.

🔗 Related Resources