Roboy Dialog System

The Roboy Dialog (or Dialog Manager) System (RDS) is a sophisticated software module representing the cognitive capabilities of the humanoid anthropomimetic robot Roboy. The goal of the project is to implement dialog routines and knowledge extraction for a realistic human-like conversation flow which is achieved by utilizing various behaviour models represented by the State Machine (RDSM) finite automaton defined via a certain Roboy Personality description (file). Within the particular conversation flow stages, the behavioural variability is obtained by extending and redefining the common RDSM State to produce a certain social interaction. The RDMS State both as actor and as reactor regarding the internally formulated output and externally acquired input. The voice input is processed via the Listening Device -> Speech-to-Text -> Analyzers & Semantic Parser -> Linguistics package -> (InferenceEngine) -> State sequence.

The overview diagram shows the external systems which Dialog System interacts with, and the tasks for which the system is responsible.

Overview diagram

Status

Stable functionality:

  • Roboy introduces himself
  • Roboy answers questions about himself
  • Roboy answers questions about facts
  • Roboy recognizes once someone saying one’s name
  • Roboy asks questions about people he meets
  • Roboy stores and retrieves the information about people he meets
  • Roboy stores and retrieves the information about himself

In development:

  • Roboy updates the information (name, occupation, ect.) about people he meets
  • Roboy updates the information about himself
  • Roboy recognizes the intent behind an asked questions (age, creator, capabilities etc.)

Relevant Background Information and Pre-Requisites

A User should be familiar with:

  • Roboy Personality Files
  • Roboy Context
  • Roboy Memory Module
  • Roboy Semantic Parser Module
  • ROS

A Developer should be familiar with:

  • Roboy Personality Files
  • Roboy Context
  • Roboy Memory Module
  • Roboy Communication Protocol
  • Roboy Semantic Parser Module
  • Java programming language
  • Maven automation tool
  • ROS
  • rosjava
  • Sockets

Reading list for a User:

Reading list for a Developer: