ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data. Yi, X., Yu, C., Zhang, M., Gao, S., Sun, K., & Shi, Y. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), of UIST '15, pages 539-548, 11, 2015. ACM.
ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data [link]Website  abstract   bibtex   
Ten-finger freehand mid-air typing is a potential solution for post-desktop interaction. However, the absence of tactile feedback as well as the inability to accurately distinguish tapping finger or target keys exists as the major challenge for mid-air typing. In this paper, we present ATK, a novel interaction technique that enables freehand ten-finger typing in the air based on 3D hand tracking data. Our hypothesis is that expert typists are able to transfer their typing ability from physical keyboards to mid-air typing. We followed an iterative approach in designing ATK. We first empirically investigated users' mid-air typing behavior, and examined fingertip kinematics during tapping, correlated movement among fingers and 3D distribution of tapping endpoints. Based on the findings, we proposed a probabilistic tap detection algorithm, and augmented Goodman's input correction model to account for the ambiguity in distinguishing tapping finger. We finally evaluated the performance of ATK with a 4-block study. Participants typed 23.0 WPM with an uncorrected word-level error rate of 0.3% in the first block, and later achieved 29.2 WPM in the last block without sacrificing accuracy.
@inProceedings{
 title = {ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data},
 type = {inProceedings},
 year = {2015},
 identifiers = {[object Object]},
 keywords = {interaction,leap-motion,mid-air-interaction,typing},
 pages = {539-548},
 websites = {http://doi.acm.org/10.1145/2807442.2807504},
 month = {11},
 publisher = {ACM},
 city = {New York, NY, USA},
 series = {UIST '15},
 id = {025a65b9-d140-38d1-93c7-8bec2ff66c58},
 created = {2018-07-12T21:31:50.170Z},
 file_attached = {false},
 profile_id = {f954d000-ce94-3da6-bd26-b983145a920f},
 group_id = {b0b145a3-980e-3ad7-a16f-c93918c606ed},
 last_modified = {2018-07-12T21:31:50.170Z},
 read = {false},
 starred = {false},
 authored = {false},
 confirmed = {true},
 hidden = {false},
 citation_key = {yi:atk:15},
 source_type = {inproceedings},
 private_publication = {false},
 abstract = {Ten-finger freehand mid-air typing is a potential solution for post-desktop interaction. However, the absence of tactile feedback as well as the inability to accurately distinguish tapping finger or target keys exists as the major challenge for mid-air typing. In this paper, we present ATK, a novel interaction technique that enables freehand ten-finger typing in the air based on 3D hand tracking data. Our hypothesis is that expert typists are able to transfer their typing ability from physical keyboards to mid-air typing. We followed an iterative approach in designing ATK. We first empirically investigated users' mid-air typing behavior, and examined fingertip kinematics during tapping, correlated movement among fingers and 3D distribution of tapping endpoints. Based on the findings, we proposed a probabilistic tap detection algorithm, and augmented Goodman's input correction model to account for the ambiguity in distinguishing tapping finger. We finally evaluated the performance of ATK with a 4-block study. Participants typed 23.0 WPM with an uncorrected word-level error rate of 0.3% in the first block, and later achieved 29.2 WPM in the last block without sacrificing accuracy.},
 bibtype = {inProceedings},
 author = {Yi, Xin and Yu, Chun and Zhang, Mingrui and Gao, Sida and Sun, Ke and Shi, Yuanchun},
 booktitle = {Proceedings of the ACM Symposium on User Interface Software and Technology (UIST)}
}

Downloads: 0