Multimodal Generic Framework for Multimedia Documents Adaptation

TitleMultimodal Generic Framework for Multimedia Documents Adaptation
Publication TypeJournal Article
Year of Publication2019
AuthorsKhallouki, H., and M. Bahaj
JournalInternational Journal of Interactive Multimedia and Artificial Intelligence
IssueSpecial Issue on Artificial Intelligence Applications
Date Published03/2019

Today, people are increasingly capable of creating and sharing documents (which generally are multimedia oriented) via the internet. These multimedia documents can be accessed at anytime and anywhere (city, home, etc.) on a wide variety of devices, such as laptops, tablets and smartphones. The heterogeneity of devices and user preferences has raised a serious issue for multimedia contents adaptation. Our research focuses on multimedia documents adaptation with a strong focus on interaction with users and exploration of multimodality. We propose a multimodal framework for adapting multimedia documents based on a distributed implementation of W3C’s Multimodal Architecture and Interfaces applied to ubiquitous computing. The core of our proposed architecture is the presence of a smart interaction manager that accepts context related information from sensors in the environment as well as from other sources, including information available on the web and multimodal user inputs. The interaction manager integrates and reasons over this information to predict the user’s situation and service use. A key to realizing this framework is the use of an ontology that undergirds the communication and representation, and the use of the cloud to insure the service continuity on heterogeneous mobile devices. Smart city is assumed as the reference scenario.

KeywordsCloud Computing, Heterogeneity Of Devices, Internet of things, Sensor, Smart City, Ubiquitous Computing
ijimai_5_4_14.pdf586.36 KB