Fishing or a Z?: Investigating the Effects of Error on Mimetic and Alphabet Device-based Gesture Interaction. El Ali, A., Kildal, J., & Lantz, V. In Proceedings of the 14th ACM International Conference on Multimodal Interaction, of ICMI '12, pages 93--100, New York, NY, USA, 2012. ACM. ![Fishing or a Z?: Investigating the Effects of Error on Mimetic and Alphabet Device-based Gesture Interaction [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex While gesture taxonomies provide a classification of device-based gestures in terms of communicative intent, little work has addressed the usability differences in manually performing these gestures. In this primarily qualitative study, we investigate how two sets of iconic gestures that vary in familiarity, mimetic and alphabetic, are affected under varying failed recognition error rates (0-20%, 20-40%, 40-60%). Drawing on experiment logs, video observations, subjects' feedback, and a subjective workload assessment questionnaire, results revealed two main findings: a) mimetic gestures tend to evolve into diverse variations (within the activities they mimic) under high error rates, while alphabet gestures tend to become more rigid and structured and b) mimetic gestures were tolerated under recognition error rates of up to 40%, while alphabet gestures incur significant overall workload with up to only 20% error rates. Thus, while alphabet gestures are more robust to recognition errors in keeping their signature, mimetic gestures are more robust to recognition errors from a usability and user experience standpoint, and thus better suited for inclusion into mainstream device-based gesture interaction with mobile phones.
@inproceedings{el_ali_fishing_2012,
address = {New York, NY, USA},
series = {{ICMI} '12},
title = {Fishing or a {Z}?: {Investigating} the {Effects} of {Error} on {Mimetic} and {Alphabet} {Device}-based {Gesture} {Interaction}},
isbn = {978-1-4503-1467-1},
shorttitle = {Fishing or a {Z}?},
url = {http://doi.acm.org/10.1145/2388676.2388701},
doi = {10.1145/2388676.2388701},
abstract = {While gesture taxonomies provide a classification of device-based gestures in terms of communicative intent, little work has addressed the usability differences in manually performing these gestures. In this primarily qualitative study, we investigate how two sets of iconic gestures that vary in familiarity, mimetic and alphabetic, are affected under varying failed recognition error rates (0-20\%, 20-40\%, 40-60\%). Drawing on experiment logs, video observations, subjects' feedback, and a subjective workload assessment questionnaire, results revealed two main findings: a) mimetic gestures tend to evolve into diverse variations (within the activities they mimic) under high error rates, while alphabet gestures tend to become more rigid and structured and b) mimetic gestures were tolerated under recognition error rates of up to 40\%, while alphabet gestures incur significant overall workload with up to only 20\% error rates. Thus, while alphabet gestures are more robust to recognition errors in keeping their signature, mimetic gestures are more robust to recognition errors from a usability and user experience standpoint, and thus better suited for inclusion into mainstream device-based gesture interaction with mobile phones.},
urldate = {2014-06-05TZ},
booktitle = {Proceedings of the 14th {ACM} {International} {Conference} on {Multimodal} {Interaction}},
publisher = {ACM},
author = {El Ali, Abdallah and Kildal, Johan and Lantz, Vuokko},
year = {2012},
pages = {93--100}
}
Downloads: 0
{"_id":"HGpyBhjHjA6XHQeYm","bibbaseid":"elali-kildal-lantz-fishingorazinvestigatingtheeffectsoferroronmimeticandalphabetdevicebasedgestureinteraction-2012","downloads":0,"creationDate":"2016-10-05T13:48:42.899Z","title":"Fishing or a Z?: Investigating the Effects of Error on Mimetic and Alphabet Device-based Gesture Interaction","author_short":["El Ali, A.","Kildal, J.","Lantz, V."],"year":2012,"bibtype":"inproceedings","biburl":"http://bibbase.org/zotero/alanlivio","bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"New York, NY, USA","series":"ICMI '12","title":"Fishing or a Z?: Investigating the Effects of Error on Mimetic and Alphabet Device-based Gesture Interaction","isbn":"978-1-4503-1467-1","shorttitle":"Fishing or a Z?","url":"http://doi.acm.org/10.1145/2388676.2388701","doi":"10.1145/2388676.2388701","abstract":"While gesture taxonomies provide a classification of device-based gestures in terms of communicative intent, little work has addressed the usability differences in manually performing these gestures. In this primarily qualitative study, we investigate how two sets of iconic gestures that vary in familiarity, mimetic and alphabetic, are affected under varying failed recognition error rates (0-20%, 20-40%, 40-60%). Drawing on experiment logs, video observations, subjects' feedback, and a subjective workload assessment questionnaire, results revealed two main findings: a) mimetic gestures tend to evolve into diverse variations (within the activities they mimic) under high error rates, while alphabet gestures tend to become more rigid and structured and b) mimetic gestures were tolerated under recognition error rates of up to 40%, while alphabet gestures incur significant overall workload with up to only 20% error rates. Thus, while alphabet gestures are more robust to recognition errors in keeping their signature, mimetic gestures are more robust to recognition errors from a usability and user experience standpoint, and thus better suited for inclusion into mainstream device-based gesture interaction with mobile phones.","urldate":"2014-06-05TZ","booktitle":"Proceedings of the 14th ACM International Conference on Multimodal Interaction","publisher":"ACM","author":[{"propositions":[],"lastnames":["El","Ali"],"firstnames":["Abdallah"],"suffixes":[]},{"propositions":[],"lastnames":["Kildal"],"firstnames":["Johan"],"suffixes":[]},{"propositions":[],"lastnames":["Lantz"],"firstnames":["Vuokko"],"suffixes":[]}],"year":"2012","pages":"93--100","bibtex":"@inproceedings{el_ali_fishing_2012,\n\taddress = {New York, NY, USA},\n\tseries = {{ICMI} '12},\n\ttitle = {Fishing or a {Z}?: {Investigating} the {Effects} of {Error} on {Mimetic} and {Alphabet} {Device}-based {Gesture} {Interaction}},\n\tisbn = {978-1-4503-1467-1},\n\tshorttitle = {Fishing or a {Z}?},\n\turl = {http://doi.acm.org/10.1145/2388676.2388701},\n\tdoi = {10.1145/2388676.2388701},\n\tabstract = {While gesture taxonomies provide a classification of device-based gestures in terms of communicative intent, little work has addressed the usability differences in manually performing these gestures. In this primarily qualitative study, we investigate how two sets of iconic gestures that vary in familiarity, mimetic and alphabetic, are affected under varying failed recognition error rates (0-20\\%, 20-40\\%, 40-60\\%). Drawing on experiment logs, video observations, subjects' feedback, and a subjective workload assessment questionnaire, results revealed two main findings: a) mimetic gestures tend to evolve into diverse variations (within the activities they mimic) under high error rates, while alphabet gestures tend to become more rigid and structured and b) mimetic gestures were tolerated under recognition error rates of up to 40\\%, while alphabet gestures incur significant overall workload with up to only 20\\% error rates. Thus, while alphabet gestures are more robust to recognition errors in keeping their signature, mimetic gestures are more robust to recognition errors from a usability and user experience standpoint, and thus better suited for inclusion into mainstream device-based gesture interaction with mobile phones.},\n\turldate = {2014-06-05TZ},\n\tbooktitle = {Proceedings of the 14th {ACM} {International} {Conference} on {Multimodal} {Interaction}},\n\tpublisher = {ACM},\n\tauthor = {El Ali, Abdallah and Kildal, Johan and Lantz, Vuokko},\n\tyear = {2012},\n\tpages = {93--100}\n}\n\n","author_short":["El Ali, A.","Kildal, J.","Lantz, V."],"key":"el_ali_fishing_2012","id":"el_ali_fishing_2012","bibbaseid":"elali-kildal-lantz-fishingorazinvestigatingtheeffectsoferroronmimeticandalphabetdevicebasedgestureinteraction-2012","role":"author","urls":{"Paper":"http://doi.acm.org/10.1145/2388676.2388701"},"downloads":0},"search_terms":["fishing","investigating","effects","error","mimetic","alphabet","device","based","gesture","interaction","el ali","kildal","lantz"],"keywords":[],"authorIDs":[],"dataSources":["tudya6YojbqEiF783"]}