Modeling Multimodal-Multiuser Interactions in Declarative Multimedia Languages

Modeling Multimodal-Multiuser Interactions in Declarative Multimedia Languages. Guedes, Á. L. V., Azevedo, R. G. d. A., Colcher, S., & Barbosa, S. D. In Proceedings of the 19th ACM Symposium on Document Engineering, of DocEng'19, pages 9, Berlin, Germany, 9, 2019. Accepted for publication
abstract bibtex

Recent advances in hardware and software technologies have given rise to a new class of human-computer interfaces that both explores multiple modalities and allows for multiple collaborating users. When compared to the development of traditional single-user WIMP (windows, icons, menus, pointer)-based applications, however, applications supporting the seamless integration of multimodal-multiuser interactions bring new specification and runtime requirements. In this paper, with the aim of assisting the specification of multimedia applications that integrate multimodal-multiuser interactions, we: (1) propose the MMAM (Multimodal-Multiuser Authoring Model); (2) present three different instantiations of it (in NCL, HTML, and a block-based syntax); and (3) evaluate the proposed model through a user study. MMAM enables programmers to design and ponder different solutions for applications with multimodal-multiuser requirements. Its instantiations allow integrating the solution in real execution environments, such as the Web and Digital TV, and served as proofs of concept about the feasibility of our model and enabled us to perform the user study. The user study focused on capturing evidence of both the user understanding and the user acceptance of the proposed model. We asked developers to perform tasks using MMAM and then answer a TAM (Technology Acceptance Model)-based questionnaire focused on both the model and its instantiations. As results, the study indicates that the participants easily understood the model (most of them performed the required tasks with minor or no errors) and found it both useful and easy to use. 94.47% of the participants gave positive answers to the block-based representation TAM questions, whereas 75.17% of them gave positive answers to the instantiations-related questions.

@inproceedings{2019_09_guedes,
title={Modeling Multimodal-Multiuser Interactions in Declarative Multimedia
Languages},
author={Guedes, Álan Lívio Vasconcelos and Azevedo, Roberto Gerson de
Albuquerque and Colcher, Sérgio and Barbosa, Simone D.J.},
year={2019},
month={9},
pages={9},
note={Accepted for publication},
booktitle={Proceedings of the 19th ACM Symposium on Document Engineering},
series={DocEng'19},
address={Berlin, Germany},
abstract={Recent advances in hardware and software technologies have given
rise to a new class of human-computer interfaces that both explores multiple
modalities and allows for multiple collaborating users. When compared to the
development of traditional single-user WIMP~(windows, icons, menus,
pointer)-based applications, however, applications supporting the seamless
integration of multimodal-multiuser interactions bring new specification and
runtime requirements. In this paper, with the aim of assisting the
specification of multimedia applications that integrate multimodal-multiuser
interactions, we: (1)~propose the MMAM~(Multimodal-Multiuser Authoring
Model); (2)~present three different instantiations of it (in NCL, HTML, and a
block-based syntax); and (3)~evaluate the proposed model through a user
study. MMAM enables programmers to design and ponder different solutions for
applications with multimodal-multiuser requirements. Its instantiations allow
integrating the solution in real execution environments, such as the Web and
Digital TV, and served as proofs of concept about the feasibility of our
model and enabled us to perform the user study. The user study focused on
capturing evidence of both the user understanding and the user acceptance of
the proposed model. We asked developers to perform tasks using MMAM and then
answer a TAM~(Technology Acceptance Model)-based questionnaire focused on
both the model and its instantiations. As results, the study indicates that
the participants easily understood the model~(most of them performed the
required tasks with minor or no errors) and found it both useful and easy to
use. 94.47\% of the participants gave positive answers to the block-based
representation TAM questions, whereas 75.17\% of them gave positive answers
to the instantiations-related questions.},
}

Downloads: 0