Multi-modal Descriptors for Multi-class Hand Pose Recognition in Human Computer Interaction Systems

Multi-modal Descriptors for Multi-class Hand Pose Recognition in Human Computer Interaction Systems. Abella, J., Alcaide, R., Sabaté, A., Mas, J., Escalera, S., Gonzàlez, J., & Antens, C. In Proceedings of the 15th ACM on International Conference on Multimodal Interaction, of ICMI '13, pages 503--508, New York, NY, USA, 2013. ACM.

Paper doi abstract bibtex

Hand pose recognition in advanced Human Computer Interaction systems (HCI) is becoming more feasible thanks to the use of affordable multi-modal RGB-Depth cameras. Depth data generated by these sensors is a very valuable input information, although the representation of 3D descriptors is still a critical step to obtain robust object representations. This paper presents an overview of different multi-modal descriptors, and provides a comparative study of two feature descriptors called Multi-modal Hand Shape (MHS) and Fourier-based Hand Shape (FHS), which compute local and global 2D-3D hand shape statistics to robustly describe hand poses. A new dataset of 38K hand poses has been created for real-time hand pose and gesture recognition, corresponding to five hand shape categories recorded from eight users. Experimental results show good performance of the fused MHS and FHS descriptors, improving recognition accuracy while assuring real-time computation in HCI scenarios.

@inproceedings{abella_multi-modal_2013,
	address = {New York, NY, USA},
	series = {{ICMI} '13},
	title = {Multi-modal {Descriptors} for {Multi}-class {Hand} {Pose} {Recognition} in {Human} {Computer} {Interaction} {Systems}},
	isbn = {978-1-4503-2129-7},
	url = {http://doi.acm.org/10.1145/2522848.2532596},
	doi = {10.1145/2522848.2532596},
	abstract = {Hand pose recognition in advanced Human Computer Interaction systems (HCI) is becoming more feasible thanks to the use of affordable multi-modal RGB-Depth cameras. Depth data generated by these sensors is a very valuable input information, although the representation of 3D descriptors is still a critical step to obtain robust object representations. This paper presents an overview of different multi-modal descriptors, and provides a comparative study of two feature descriptors called Multi-modal Hand Shape (MHS) and Fourier-based Hand Shape (FHS), which compute local and global 2D-3D hand shape statistics to robustly describe hand poses. A new dataset of 38K hand poses has been created for real-time hand pose and gesture recognition, corresponding to five hand shape categories recorded from eight users. Experimental results show good performance of the fused MHS and FHS descriptors, improving recognition accuracy while assuring real-time computation in HCI scenarios.},
	urldate = {2014-06-05TZ},
	booktitle = {Proceedings of the 15th {ACM} on {International} {Conference} on {Multimodal} {Interaction}},
	publisher = {ACM},
	author = {Abella, Jordi and Alcaide, Raúl and Sabaté, Anna and Mas, Joan and Escalera, Sergio and Gonzàlez, Jordi and Antens, Coen},
	year = {2013},
	pages = {503--508}
}

Downloads: 0

{"_id":"pySEWNpgoctMjpe8q","bibbaseid":"abella-alcaide-sabat-mas-escalera-gonzlez-antens-multimodaldescriptorsformulticlasshandposerecognitioninhumancomputerinteractionsystems-2013","downloads":0,"creationDate":"2016-10-05T13:48:42.955Z","title":"Multi-modal Descriptors for Multi-class Hand Pose Recognition in Human Computer Interaction Systems","author_short":["Abella, J.","Alcaide, R.","Sabaté, A.","Mas, J.","Escalera, S.","Gonzàlez, J.","Antens, C."],"year":2013,"bibtype":"inproceedings","biburl":"http://bibbase.org/zotero/alanlivio","bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"New York, NY, USA","series":"ICMI '13","title":"Multi-modal Descriptors for Multi-class Hand Pose Recognition in Human Computer Interaction Systems","isbn":"978-1-4503-2129-7","url":"http://doi.acm.org/10.1145/2522848.2532596","doi":"10.1145/2522848.2532596","abstract":"Hand pose recognition in advanced Human Computer Interaction systems (HCI) is becoming more feasible thanks to the use of affordable multi-modal RGB-Depth cameras. Depth data generated by these sensors is a very valuable input information, although the representation of 3D descriptors is still a critical step to obtain robust object representations. This paper presents an overview of different multi-modal descriptors, and provides a comparative study of two feature descriptors called Multi-modal Hand Shape (MHS) and Fourier-based Hand Shape (FHS), which compute local and global 2D-3D hand shape statistics to robustly describe hand poses. A new dataset of 38K hand poses has been created for real-time hand pose and gesture recognition, corresponding to five hand shape categories recorded from eight users. Experimental results show good performance of the fused MHS and FHS descriptors, improving recognition accuracy while assuring real-time computation in HCI scenarios.","urldate":"2014-06-05TZ","booktitle":"Proceedings of the 15th ACM on International Conference on Multimodal Interaction","publisher":"ACM","author":[{"propositions":[],"lastnames":["Abella"],"firstnames":["Jordi"],"suffixes":[]},{"propositions":[],"lastnames":["Alcaide"],"firstnames":["Raúl"],"suffixes":[]},{"propositions":[],"lastnames":["Sabaté"],"firstnames":["Anna"],"suffixes":[]},{"propositions":[],"lastnames":["Mas"],"firstnames":["Joan"],"suffixes":[]},{"propositions":[],"lastnames":["Escalera"],"firstnames":["Sergio"],"suffixes":[]},{"propositions":[],"lastnames":["Gonzàlez"],"firstnames":["Jordi"],"suffixes":[]},{"propositions":[],"lastnames":["Antens"],"firstnames":["Coen"],"suffixes":[]}],"year":"2013","pages":"503--508","bibtex":"@inproceedings{abella_multi-modal_2013,\n\taddress = {New York, NY, USA},\n\tseries = {{ICMI} '13},\n\ttitle = {Multi-modal {Descriptors} for {Multi}-class {Hand} {Pose} {Recognition} in {Human} {Computer} {Interaction} {Systems}},\n\tisbn = {978-1-4503-2129-7},\n\turl = {http://doi.acm.org/10.1145/2522848.2532596},\n\tdoi = {10.1145/2522848.2532596},\n\tabstract = {Hand pose recognition in advanced Human Computer Interaction systems (HCI) is becoming more feasible thanks to the use of affordable multi-modal RGB-Depth cameras. Depth data generated by these sensors is a very valuable input information, although the representation of 3D descriptors is still a critical step to obtain robust object representations. This paper presents an overview of different multi-modal descriptors, and provides a comparative study of two feature descriptors called Multi-modal Hand Shape (MHS) and Fourier-based Hand Shape (FHS), which compute local and global 2D-3D hand shape statistics to robustly describe hand poses. A new dataset of 38K hand poses has been created for real-time hand pose and gesture recognition, corresponding to five hand shape categories recorded from eight users. Experimental results show good performance of the fused MHS and FHS descriptors, improving recognition accuracy while assuring real-time computation in HCI scenarios.},\n\turldate = {2014-06-05TZ},\n\tbooktitle = {Proceedings of the 15th {ACM} on {International} {Conference} on {Multimodal} {Interaction}},\n\tpublisher = {ACM},\n\tauthor = {Abella, Jordi and Alcaide, Raúl and Sabaté, Anna and Mas, Joan and Escalera, Sergio and Gonzàlez, Jordi and Antens, Coen},\n\tyear = {2013},\n\tpages = {503--508}\n}\n\n","author_short":["Abella, J.","Alcaide, R.","Sabaté, A.","Mas, J.","Escalera, S.","Gonzàlez, J.","Antens, C."],"key":"abella_multi-modal_2013","id":"abella_multi-modal_2013","bibbaseid":"abella-alcaide-sabat-mas-escalera-gonzlez-antens-multimodaldescriptorsformulticlasshandposerecognitioninhumancomputerinteractionsystems-2013","role":"author","urls":{"Paper":"http://doi.acm.org/10.1145/2522848.2532596"},"downloads":0},"search_terms":["multi","modal","descriptors","multi","class","hand","pose","recognition","human","computer","interaction","systems","abella","alcaide","sabaté","mas","escalera","gonzàlez","antens"],"keywords":[],"authorIDs":[],"dataSources":["tudya6YojbqEiF783"]}