Modeling Sensory Effects As First-class Entities in Multimedia Applications. Josué, M., Abreu, R., Barreto, F., Mattos, D., Amorim, G., dos Santos, J., & Muchaluat-Saade, D. In Proceedings of the 9th ACM Multimedia Systems Conference, of MMSys '18, pages 225–236, New York, NY, USA, 2018. ACM. 00000![Modeling Sensory Effects As First-class Entities in Multimedia Applications [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex Multimedia applications are usually composed by audiovisual content. Traditional multimedia conceptual models, and consequently declarative multimedia authoring languages, do not support the definition of multiple sensory effects. Multiple sensorial media (mulsemedia) applications consider the use of sensory effects that can stimulate touch, smell and taste, in addition to hearing and sight. Therefore, mulsemedia applications have been usually developed using general-purpose programming languages. In order to fill in this gap, this paper proposes an approach for modeling sensory effects as first-class entities, enabling multimedia applications to synchronize sensorial media to interactive audiovisual content in a high-level specification. Thus, complete descriptions of mulsemedia applications will be made possible with multimedia models and languages. In order to validate our ideas, an interactive mulsemedia application example is presented and specified with NCL (Nested Context Language) and Lua. Lua components are used for translating sensory effect high-level attributes to MPEG-V SEM (Sensory Effect Metadata) files. A sensory effect simulator was developed to receive SEM files and simulate mulsemedia application rendering.
@inproceedings{josue_modeling_2018,
address = {New York, NY, USA},
series = {{MMSys} '18},
title = {Modeling {Sensory} {Effects} {As} {First}-class {Entities} in {Multimedia} {Applications}},
isbn = {978-1-4503-5192-8},
url = {http://doi.acm.org/10.1145/3204949.3204967},
doi = {10.1145/3204949.3204967},
abstract = {Multimedia applications are usually composed by audiovisual content. Traditional multimedia conceptual models, and consequently declarative multimedia authoring languages, do not support the definition of multiple sensory effects. Multiple sensorial media (mulsemedia) applications consider the use of sensory effects that can stimulate touch, smell and taste, in addition to hearing and sight. Therefore, mulsemedia applications have been usually developed using general-purpose programming languages. In order to fill in this gap, this paper proposes an approach for modeling sensory effects as first-class entities, enabling multimedia applications to synchronize sensorial media to interactive audiovisual content in a high-level specification. Thus, complete descriptions of mulsemedia applications will be made possible with multimedia models and languages. In order to validate our ideas, an interactive mulsemedia application example is presented and specified with NCL (Nested Context Language) and Lua. Lua components are used for translating sensory effect high-level attributes to MPEG-V SEM (Sensory Effect Metadata) files. A sensory effect simulator was developed to receive SEM files and simulate mulsemedia application rendering.},
urldate = {2018-09-17},
booktitle = {Proceedings of the 9th {ACM} {Multimedia} {Systems} {Conference}},
publisher = {ACM},
author = {Josué, Marina and Abreu, Raphael and Barreto, Fábio and Mattos, Douglas and Amorim, Glauco and dos Santos, Joel and Muchaluat-Saade, Débora},
year = {2018},
note = {00000},
pages = {225--236}
}
Downloads: 0
{"_id":"CFToyeDbxz7ZDJBWW","bibbaseid":"josu-abreu-barreto-mattos-amorim-dossantos-muchaluatsaade-modelingsensoryeffectsasfirstclassentitiesinmultimediaapplications-2018","authorIDs":[],"author_short":["Josué, M.","Abreu, R.","Barreto, F.","Mattos, D.","Amorim, G.","dos Santos, J.","Muchaluat-Saade, D."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"New York, NY, USA","series":"MMSys '18","title":"Modeling Sensory Effects As First-class Entities in Multimedia Applications","isbn":"978-1-4503-5192-8","url":"http://doi.acm.org/10.1145/3204949.3204967","doi":"10.1145/3204949.3204967","abstract":"Multimedia applications are usually composed by audiovisual content. Traditional multimedia conceptual models, and consequently declarative multimedia authoring languages, do not support the definition of multiple sensory effects. Multiple sensorial media (mulsemedia) applications consider the use of sensory effects that can stimulate touch, smell and taste, in addition to hearing and sight. Therefore, mulsemedia applications have been usually developed using general-purpose programming languages. In order to fill in this gap, this paper proposes an approach for modeling sensory effects as first-class entities, enabling multimedia applications to synchronize sensorial media to interactive audiovisual content in a high-level specification. Thus, complete descriptions of mulsemedia applications will be made possible with multimedia models and languages. In order to validate our ideas, an interactive mulsemedia application example is presented and specified with NCL (Nested Context Language) and Lua. Lua components are used for translating sensory effect high-level attributes to MPEG-V SEM (Sensory Effect Metadata) files. A sensory effect simulator was developed to receive SEM files and simulate mulsemedia application rendering.","urldate":"2018-09-17","booktitle":"Proceedings of the 9th ACM Multimedia Systems Conference","publisher":"ACM","author":[{"propositions":[],"lastnames":["Josué"],"firstnames":["Marina"],"suffixes":[]},{"propositions":[],"lastnames":["Abreu"],"firstnames":["Raphael"],"suffixes":[]},{"propositions":[],"lastnames":["Barreto"],"firstnames":["Fábio"],"suffixes":[]},{"propositions":[],"lastnames":["Mattos"],"firstnames":["Douglas"],"suffixes":[]},{"propositions":[],"lastnames":["Amorim"],"firstnames":["Glauco"],"suffixes":[]},{"propositions":["dos"],"lastnames":["Santos"],"firstnames":["Joel"],"suffixes":[]},{"propositions":[],"lastnames":["Muchaluat-Saade"],"firstnames":["Débora"],"suffixes":[]}],"year":"2018","note":"00000","pages":"225–236","bibtex":"@inproceedings{josue_modeling_2018,\n\taddress = {New York, NY, USA},\n\tseries = {{MMSys} '18},\n\ttitle = {Modeling {Sensory} {Effects} {As} {First}-class {Entities} in {Multimedia} {Applications}},\n\tisbn = {978-1-4503-5192-8},\n\turl = {http://doi.acm.org/10.1145/3204949.3204967},\n\tdoi = {10.1145/3204949.3204967},\n\tabstract = {Multimedia applications are usually composed by audiovisual content. Traditional multimedia conceptual models, and consequently declarative multimedia authoring languages, do not support the definition of multiple sensory effects. Multiple sensorial media (mulsemedia) applications consider the use of sensory effects that can stimulate touch, smell and taste, in addition to hearing and sight. Therefore, mulsemedia applications have been usually developed using general-purpose programming languages. In order to fill in this gap, this paper proposes an approach for modeling sensory effects as first-class entities, enabling multimedia applications to synchronize sensorial media to interactive audiovisual content in a high-level specification. Thus, complete descriptions of mulsemedia applications will be made possible with multimedia models and languages. In order to validate our ideas, an interactive mulsemedia application example is presented and specified with NCL (Nested Context Language) and Lua. Lua components are used for translating sensory effect high-level attributes to MPEG-V SEM (Sensory Effect Metadata) files. A sensory effect simulator was developed to receive SEM files and simulate mulsemedia application rendering.},\n\turldate = {2018-09-17},\n\tbooktitle = {Proceedings of the 9th {ACM} {Multimedia} {Systems} {Conference}},\n\tpublisher = {ACM},\n\tauthor = {Josué, Marina and Abreu, Raphael and Barreto, Fábio and Mattos, Douglas and Amorim, Glauco and dos Santos, Joel and Muchaluat-Saade, Débora},\n\tyear = {2018},\n\tnote = {00000},\n\tpages = {225--236}\n}\n\n","author_short":["Josué, M.","Abreu, R.","Barreto, F.","Mattos, D.","Amorim, G.","dos Santos, J.","Muchaluat-Saade, D."],"key":"josue_modeling_2018","id":"josue_modeling_2018","bibbaseid":"josu-abreu-barreto-mattos-amorim-dossantos-muchaluatsaade-modelingsensoryeffectsasfirstclassentitiesinmultimediaapplications-2018","role":"author","urls":{"Paper":"http://doi.acm.org/10.1145/3204949.3204967"},"downloads":0,"html":""},"bibtype":"inproceedings","biburl":"http://www.telemidia.puc-rio.br/~alan/files/all.bib","creationDate":"2020-03-03T14:08:14.711Z","downloads":0,"keywords":[],"search_terms":["modeling","sensory","effects","first","class","entities","multimedia","applications","josué","abreu","barreto","mattos","amorim","dos santos","muchaluat-saade"],"title":"Modeling Sensory Effects As First-class Entities in Multimedia Applications","year":2018,"dataSources":["jAxurbvLP8q5LTdLa"]}