Multimodal Interaction in Ambient Intelligence Environments Using Speech, Localization and Robotics

Autor/in	Galatas, Georgios
Titel	Multimodal Interaction in Ambient Intelligence Environments Using Speech, Localization and Robotics
Quelle	(2013), (120 Seiten) PDF als Volltext Verfügbarkeit Ph.D. Dissertation, The University of Texas at Arlington
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
ISBN	978-1-3037-0339-3
Schlagwörter	Hochschulschrift; Dissertation; Speech; Robotics; Artificial Intelligence; Environment; Geographic Location; Identification; Information Technology; Change; Navigation; Interaction; Man Machine Systems + Suchen Sie Ihr Suchwort? Thesis; Dissertations; Academic thesis; Speaking; Sprechen; Robotertechnik; Künstliche Intelligenz; Umwelt; Identifikation; Identifizierung; Informationstechnologie; Wandel; Interaktion; Mensch-Maschine-System
Abstract	An Ambient Intelligence Environment is meant to sense and respond to the presence of people, using its embedded technology. In order to effectively sense the activities and intentions of its inhabitants, such an environment needs to utilize information captured from multiple sensors and modalities. By doing so, the interaction becomes more natural as well as accurate and robust. We have focused on 3 aspects of such an environment, using speech, localization and robotics. Speech is one of the most natural forms of communication for humans. Therefore, it can be used as one of the main information sources for deriving the intentions and needs of a person. In our work, we have extended the traditional speech recognition paradigm by introducing 3 dimensional visual articulation information for recognizing spoken words. The development of our system included the capture of a novel dataset, implementation and extended testing under a variety of audio-visual noise types, demonstrating the usefulness of 3D visual information for this task. Additionally, person localization and identification is of paramount importance in a smart environment, since by knowing each person's location, her/is actions can be derived and abnormal patterns can be recognized. Our implementation conducts person identification by means of RFID. Furthermore, three types of input are combined for multi-person localization, namely, skeletal tracking, audio localization and RFID signal strength. The system was deployed and tested in our simulated assistive apartment exhibiting high accuracy. Finally, every domestic environment changes dynamically over time, creating the need for altering the position, orientation and type of sensors used within it. In our approach, we developed a framework of sensor bearing robots with the ability to relocate automatically to compensate for such a dynamic environment. Their positioning is done in such a way so as to maximize coverage. Navigation is carried out using visual information and autonomous placement uses a decentralized algorithm. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.] (As Provided).
Anmerkungen	ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01