Embedding Deep Learning Models into Hypermedia Applications. Antonio José G. Busson, Álan Livio V. Guedes, Sérgio Colcher, Ruy Luiz Milidiú, & Edward Hermann Haeusler In Roesler, V., Barrére, E., & Willrich, R., editors, Special Topics in Multimedia, IoT and Web Technologies, pages 91–111. Springer International Publishing, 2020.
Embedding Deep Learning Models into Hypermedia Applications [link]Paper  Embedding Deep Learning Models into Hypermedia Applications [link]Year  abstract   bibtex   18 downloads  
Deep learning research has allowed significant advances in several areas of multimedia, especially in tasks related to speech processing, hearing, and computational vision. Particularly, recent usage scenarios in hypermedia domain already use such deep learning tasks to build applications that are sensitive to its media content semantics. However, the development of such scenarios is usually done from scratch. In particular, current hypermedia standards such as HTML do not fully support such kind of development. To support such development, we propose that a hypermedia language should be extended to support: (1) describe learning using structured media datasets; (2) recognize content semantics of the media elements in presentation time; (3) use the recognized semantics elements as events in during the multimedia. To illustrate our approach, we extended the NCL language, and its model NCM, to support such features. NCL (Nested Context Language) is the declarative language for developing interactive applications for Brazilian Digital TV and an ITU-T Recommendation for IPTV services. As a result of the work, it is presented a usage scenario to highlight how the extended NCL supports the development of content-aware hypermedia presentations, attesting the expressiveness and applicability of the model.
@incollection{antonio_jose_g_busson_embedding_2020,
	location = {Cham},
	title = {Embedding Deep Learning Models into Hypermedia Applications},
	isbn = {978-3-030-35102-1},
	url = {https://doi.org/10.1007/978-3-030-35102-1_4},
	abstract = {Deep learning research has allowed significant advances in several areas of multimedia, especially in tasks related to speech processing, hearing, and computational vision. Particularly, recent usage scenarios in hypermedia domain already use such deep learning tasks to build applications that are sensitive to its media content semantics. However, the development of such scenarios is usually done from scratch. In particular, current hypermedia standards such as {HTML} do not fully support such kind of development. To support such development, we propose that a hypermedia language should be extended to support: (1) describe learning using structured media datasets; (2) recognize content semantics of the media elements in presentation time; (3) use the recognized semantics elements as events in during the multimedia. To illustrate our approach, we extended the {NCL} language, and its model {NCM}, to support such features. {NCL} (Nested Context Language) is the declarative language for developing interactive applications for Brazilian Digital {TV} and an {ITU}-T Recommendation for {IPTV} services. As a result of the work, it is presented a usage scenario to highlight how the extended {NCL} supports the development of content-aware hypermedia presentations, attesting the expressiveness and applicability of the model.},
	pages = {91--111},
	booktitle = {Special Topics in Multimedia, {IoT} and  Web Technologies},
	publisher = {Springer International Publishing},
	author = {{Antonio José G. Busson} and {Álan Livio V. Guedes} and {Sérgio Colcher} and {Ruy Luiz Milidiú} and {Edward Hermann Haeusler}},
	editor = {Roesler, Valter and Barrére, Eduardo and Willrich, Roberto},
	urlyear = {2020},
	year = {2020},
	langid = {english},
}

Downloads: 18