|
PhD proposal "Cotutelle de thèse entre École de Technologie Supérieure et l'université de Versailles" Design of a Web Service Component for Interaction Fusion
Keywords: interaction, fusion, scenario, events, ontology, Web service.
Context: Our laboratories (MMS/ETS and LISV/UVSQ) work on the design of architecture for interaction. These interactions use sensors network of modalities in several contexts. For example, to interact with a computer in a noisy environment (context), it is better to use a keyboard or a touch screen instead of using vocal commands where misunderstanding will occur. To design a component of the architecture, Researchers work on different technologies as Multi Agent Systems from the AI domain or webservices [4] from telecommunication domain, both of them have the capability of acting and communicating (receive/send). A recent domain called ambient intelligence is composed of a ubiquitous network with awareness able to interact with a user. This network is connected to all sensors and actuators; it can discover and manage them. Standards [1] exist and must be respected for better interoperability, lower cost and Sustainability. The aim of intelligent component design is to realize:
Machine learning & IA techniques can be used as fuzzy rules, Bayesian networks, knowledge representation and pattern matching is helpful.
Many of applications are possible and integrated in research projects: Home assistant, robotics, intelligent network, security alarms, supervision, games ...etc.
Subject: Candidate objective is to specify and develop a fusion component for interaction in a network of multimodal webservices. This component must create and refine scenarios receiving multimodal events in the EMMA W3C Standard [3]. XML specification for EMMA, an Extensible Multimodal Annotation Markup language, is responding to the documented requirements. This markup language is intended for use by systems that provide semantic interpretations for a variety of inputs, including but not necessarily limited to, speech, natural language text, GUI and ink input. In addition, modality specific XML languages can be studied such as VoiceXML [5] for voice recognition, MPEG-7 for Video annotation, and so on. Primary events and composed events (scenarios) will be stored in a semantic ontology [2] using specific rules. All combinations of primary events will be defined as models to help the composition. The result of the process will be a situational/contextual meaning.
This thesis will be done in 4 parts:
To prove the quality of the study, candidate will develop a Home "Assistant" application to help old people or people with disabilities. One of the solutions can be to recognize user’s activities, infer a situation and execute the most relevant action [7], [8]. For example, abnormal situation is detected if the person is not moving and not eating (did not use the stove), screaming because he needs help, not answering any of the system questions, and so on. Normal situations are stored when the user usually repeats the same actions.
Reference: [1] www.W3.org [2] http://www.w3c.org/TR/webont-req [3] http://www.w3.org/TR/2009/REC-emma-20090210/ [4] http://www.w3.org/2002/ws/ [5] http://www.w3.org/2008/08/siv/summary.html [6] http://www.w3.org/2005/Incubator/mmsem/XGR-mpeg7-20070814/ [7] http://www.mica.edu.vn/Isere/third-meeting_fichiers/TRUMA05(yjhsu).pdf [8] SmartWeb Handheld - Multimodal Interaction with Ontological knowledge bases and Semantic web services - Daniel Sonntag - 2006 (can be downloaded on Google)
Other related publications:
Requirements: Candidate must have computer science research high skills. C/C++/C#/VB.NET/JAVA/XML languages knowledge must be a plus.
Start : ASAP
PhD Advisers: Pr. Chakib Tadj (École de Technologie Supérieure, Quebec University): Chakib Tadj Pr. Amar Ramdane Cherif (Versailles University, France): Amar Ramdane-Cherif
|