Multispectral camera fusion increases robustness of ROI detection for biosignal estimation with nearables in real-world scenarios

Multispectral camera fusion increases robustness of ROI detection for biosignal estimation with nearables in real-world scenarios. Scebba, G., Tushaus, L., & Karlen, W. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pages 5672-5, 7, 2018. IEEE.

Website abstract bibtex

Thermal cameras enable non-contact estimation of the respiratory rate (RR). Accurate estimation of RR is highly dependent on the reliable detection of the region of interest (ROI), especially when using cameras with low pixel resolution. We present a novel approach for the automatic detection of the human nose ROI, based on facial landmark detection from an RGB camera that is fused with the thermal image after tracking. We evaluated the detection rate and spatial accuracy of the novel algorithm on recordings obtained from 16 subjects under challenging detection scenarios. Results show a high detection rate (median: 100 %, 5th - 95th percentile: 92 % - 100 %) and very good spatial accuracy with an average root mean square error of 2 pixels in the detected ROI center when compared to manual labeling. Therefore, the implementation of a multispectral camera fusion algorithm is a valid strategy to improve the reliability of non-contact RR estimation with nearable devices featuring thermal cameras.

@inproceedings{
 title = {Multispectral camera fusion increases robustness of ROI detection for biosignal estimation with nearables in real-world scenarios},
 type = {inproceedings},
 year = {2018},
 identifiers = {[object Object]},
 pages = {5672-5},
 websites = {https://ieeexplore.ieee.org/document/8513501/},
 month = {7},
 publisher = {IEEE},
 city = {Honolulu, HI, USA},
 id = {12517edf-e55b-36b6-b2e4-8abbbdb91fc7},
 created = {2018-11-08T08:20:04.310Z},
 file_attached = {true},
 profile_id = {6d353feb-efe4-367e-84a2-0815eb9ca878},
 last_modified = {2020-06-10T12:29:54.474Z},
 read = {true},
 starred = {false},
 authored = {true},
 confirmed = {true},
 hidden = {false},
 citation_key = {Scebba2018},
 folder_uuids = {4afa922c-d8d6-102e-ac9a-0024e85ead87,0801d9e0-d1ec-46e2-803d-c74946b43a02,d9198259-8733-497d-ab87-d2a9518e0d30},
 private_publication = {false},
 abstract = {Thermal cameras enable non-contact estimation of the respiratory rate (RR). Accurate estimation of RR is highly dependent on the reliable detection of the region of interest (ROI), especially when using cameras with low pixel resolution. We present a novel approach for the automatic detection of the human nose ROI, based on facial landmark detection from an RGB camera that is fused with the thermal image after tracking. We evaluated the detection rate and spatial accuracy of the novel algorithm on recordings obtained from 16 subjects under challenging detection scenarios. Results show a high detection rate (median: 100 %, 5th - 95th percentile: 92 % - 100 %) and very good spatial accuracy with an average root mean square error of 2 pixels in the detected ROI center when compared to manual labeling. Therefore, the implementation of a multispectral camera fusion algorithm is a valid strategy to improve the reliability of non-contact RR estimation with nearable devices featuring thermal cameras.},
 bibtype = {inproceedings},
 author = {Scebba, Gaetano and Tushaus, Laura and Karlen, Walter},
 booktitle = {Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)}
}

Downloads: 0