A Robotic Home Assistant with Memory Aid Functionality

Iris Wieser, Sibel Toprak, Andreas Grenzing, Tobias Hinz, Sayantan Auddy, Ethem Karaoğuz, Abhilash Chandran, Melanie Remmels, Ahmed El, Josip Josifovski, Leena Chennuru, Faiz Wahab, Alireza Bahnemiri, Debasish Sahu, Stefan Heinrich, Nicolás Navarro-Guerrero, Erik Strahl, Johannes Twiefel, Stefan Wermter

Conference: Video Session of 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN2016), pp. 369, New York, US, Aug 2016

PDF - Video

Abstract: In this video, we present a robotic system that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. The robot orients its gaze to the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, it produces natural language descriptions for the objects’ positions by using furniture as reference points.