A Fuzzy Inference System for a Visually Grounded Robot State of Mind [Elektronisk resurs]

• In order for robots to interact with humans on real-world scenarios or objects, these robots need to construct a representa- tion (‘state of mind’) of these scenarios that a) are grounded in the robots’ perception and b) ideally should match human understand- ing and concepts. Using table-top settings as scenario, we propose a framework that generates a robot’s ’‘state of mind’ by extracting the objects on the table along with their properties (color, shape and texture) and spatial relations to each other. The scene as perceived by the robot is represented in a dynamic graph in which object at- tributes are encoded as fuzzy linguistic variables that match human spatial concepts. In particular, this paper details the construction of such graph representations by combining low-level neural network- based feature recognition and a high-level fuzzy inference system. Using fuzzy representations allows for easily adapting the robot’s original scene representation to deviations in properties or relations that emerge in language descriptions given by humans viewing the same scene. The framework is implemented on a Pepper humanoid robot and has been evaluated using a data set collected in-house. 

Ämnesord

Natural Sciences  (hsv)

Computer and Information Sciences  (hsv)

Computer Vision and Robotics (Autonomous Systems)  (hsv)

Naturvetenskap  (hsv)

Data- och informationsvetenskap  (hsv)

Datorseende och robotik (autonoma system)  (hsv)

Human Computer Interaction  (hsv)

Människa-datorinteraktion (interaktionsdesign)  (hsv)

Computer Sciences  (hsv)

Datavetenskap (datalogi)  (hsv)

Computer Science  (umu)

datalogi  (umu)

human-computer interaction  (umu)

människa-datorinteraktion  (umu)

Genre

government publication  (marcgt)

Indexterm och SAB-rubrik

human-robot interaction

object detection

reasoning