Automated detection and classification of feeding strikes by larval fish from continuous high-speed digital video: a novel method to extract quantitative data from fast, sparse kinematic events. Zilka, M., Eyal Shamur, E., Hassner, T., China, V., Liberzon, A., & Holzman, R. Journal of Experimental Biology, 2016.
Automated detection and classification of feeding strikes by larval fish from continuous high-speed digital video: a novel method to extract quantitative data from fast, sparse kinematic events [pdf]Paper  abstract   bibtex   
Using videography to extract quantitative data on animal movement and kinematics constitutes a major tool in biomechanics and behavioral ecology. Advanced recording technologies now enable acquisition of long video sequences encompassing sparse and unpredictable events. Although such events may be ecologically important, analysis of sparse data can be extremely time-consuming and potentially biased; data quality is often strongly dependent on the training level of the observer and subject to contamination by observer-dependent biases. These constraints often limit our ability to study animal performance and fitness. Using long videos of foraging fish larvae, we provide a framework for the automated detection of prey acquisition strikes, a behavior that is infrequent yet critical for larval survival.We compared the performance of four video descriptors and their combinations against manually identified feeding events. For our data, the best single descriptor provided a classification accuracy of 77-95% and detection accuracy of 88- 98%, depending on fish species and size. Using a combination of descriptors improved the accuracy of classification by ∼2%, but did not improve detection accuracy. Our results indicate that the effort required by an expert to manually label videos can be greatly reduced to examining only the potential feeding detections in order to filter false detections. Thus, using automated descriptors reduces the amount of manual work needed to identify events of interest from weeks to hours, enabling the assembly of an unbiased large dataset of ecologically relevant behaviors.
@article{
 title = {Automated detection and classification of feeding strikes by larval fish from continuous high-speed digital video: a novel method to extract quantitative data from fast, sparse kinematic events},
 type = {article},
 year = {2016},
 identifiers = {[object Object]},
 keywords = {automated classification,feeding kinematics,high-speed video,machine learning},
 pages = {1608-1617},
 id = {8cd4dbcd-9f4b-351d-a3fe-175da1b03bb4},
 created = {2016-09-28T17:56:50.000Z},
 accessed = {2016-09-28},
 file_attached = {true},
 profile_id = {fb329fcb-394b-3686-a7d8-4373fd71ca2d},
 last_modified = {2017-03-13T16:27:28.843Z},
 read = {false},
 starred = {false},
 authored = {true},
 confirmed = {true},
 hidden = {false},
 citation_key = {Shamur2016},
 private_publication = {false},
 abstract = {Using videography to extract quantitative data on animal movement and kinematics constitutes a major tool in biomechanics and behavioral ecology. Advanced recording technologies now enable acquisition of long video sequences encompassing sparse and unpredictable events. Although such events may be ecologically important, analysis of sparse data can be extremely time-consuming and potentially biased; data quality is often strongly dependent on the training level of the observer and subject to contamination by observer-dependent biases. These constraints often limit our ability to study animal performance and fitness. Using long videos of foraging fish larvae, we provide a framework for the automated detection of prey acquisition strikes, a behavior that is infrequent yet critical for larval survival.We compared the performance of four video descriptors and their combinations against manually identified feeding events. For our data, the best single descriptor provided a classification accuracy of 77-95% and detection accuracy of 88- 98%, depending on fish species and size. Using a combination of descriptors improved the accuracy of classification by ∼2%, but did not improve detection accuracy. Our results indicate that the effort required by an expert to manually label videos can be greatly reduced to examining only the potential feeding detections in order to filter false detections. Thus, using automated descriptors reduces the amount of manual work needed to identify events of interest from weeks to hours, enabling the assembly of an unbiased large dataset of ecologically relevant behaviors.},
 bibtype = {article},
 author = {Zilka, Miri and Eyal Shamur, E and Hassner, Tal and China, Victor and Liberzon, Alex and Holzman, Roi},
 journal = {Journal of Experimental Biology}
}
Downloads: 0