Robot Learning and Robot Behavior Control Software
Skilligent Robot Learning and Robot Behavior Control System

Product Page - Robot Learning and Behavior Control System
Robot Learning Technology for Multi-Task Service Robots [PDF]
Skilligent Robot Learning, Brochure [PDF]
Designing a Control System for a Multifunctional Service Robot [PDF]
All Documents >>

Skilligent Robot Learning and Behavior Control System is a control system for autonomous multi-task service robots, including a behavior control and coordination system, task and skill learning functions, a powerful computer vision system, a social human-to-machine interface, a database for storing knowledge and other integrated components.

The control system enables solution providers to create autonomous robots which can learn procedures and skills directly from human users. The product is a set of software components specifically designed for straightforward integration into control loops of PC-controlled robots.

The software incorporates multiple state-of-the-art robotic technologies including robot learning from demonstration, social robot-to-human interaction, learning of action-to-concept relations, hierarchical behavior control, computer vision and others.

Skilligent Robot Learning From Demonstration and Robot Behavior Control Software

Skilligent Computer Vision System

Product Page - Computer Vision System

Skilligent Computer Vision System is an integral part of the control system product, but it can be used as a standalone system. The computer vision system enables the robots to see, recognize, visually remember and track objects appearing in the view of the onboard camera. The computer vision software provides a perceptual foundation for the navigation, object manipulation and human-to-robot interaction capabilities of a robot.

When used as a standalone system, the computer vision module might be used for guidance, navigation and research purposes.

Multi-Task Service Automation Robots

The Skilligent technology allows a non-professional user to train a service robot to perform a new task in a particular environment. For example:

  • A restaurant owner can train a team of service robots to deliver orders in the restaurant.
  • A soldier can train a robot to patrol a particular area and to react on certain events.
  • A floor manager at an assisted living facility can train a team of service robots to automatically scan the health of patients, remind them of the need to take the medications and entertain the patients .
  • An owner of a budget-priced motel can train a team of service robots to guide guests to their rooms, carry baggage, make deliveries, and patrol the area.

The examples highlight the key advantage of the technology - a user who is not an educated robotics professional, uses the off-the-shelf trainable robots for service automation tasks.

Due to ever increasing competition, small businesses have to change their product lines or services often. Each time a product or a service is updated, a number of installed industrial robots need to be re-programmed. Each time a robot gets re-programmed, the small business loses money. In most cases, small businesses have to hire an external system integration company to do the work.

If an service robot is able to learn procedures and acquire skills, such a robot can be re-trained by an employee when needed - vs. re-programmed by a robotics engineer working for a system integration company. For small businesses, this means a significant reduction of the overall cost of ownership.

Healthcare and Eldercare Robots

Healthcare/Eldercare Robot based on Skilligent Technology [PDF]

Hospitals, nursing homes and eldercare facilities are suitable environments where robots can learn procedures and effectively execute them.

Scanning patients, equipment inspection, firefighting and evacuation of patients in emergencies, helping elder patients, delivery, cleaning, - that is a list of procedures and skills which a robot designed for healthcare applications should be able to learn. Those robots can be trained by hospital personnel or by patients.

Although a service robot cannot provide the same level of care as a human, such a robot can help a lot when human care is limited due to various reasons such as demographic issues, emergencies, conflicts, lack of funding and so on.

Concept of a Healthcare/Eldercare Robot based on Skilligent's technologies

Defense Robots

The ability of tactical robots to learn procedures and skills directly from soldiers gives the armed forces an edge over the adversaries.

Because the robot training process does not require any special technical knowledge, nearly any soldier (vs. a robotics engineer) can train a robot to perform new missions in a particular environment.

For example,

  • A biochemical defense robot can be pre-trained to act in case of a biochemical attack. As the robot has been pre-trained, it will be able to automatically inspect and clean a territory such as a campus, a street - or other territory where it was pre-trained to operate. In case of an attack, the robot needs to be deployed in the area - and it will know what to do.
  • At a maintenance facility, a service robot can be trained by a soldier to perform service assignments such as moving materials around, cleaning, palletizing, and sorting and so on.
  • A military robot can be pre-trained to patrol a particular area such as a street or a checkpoint. A soldier can pre-train a robot to patrol an area, react automatically on different kinds of events and operate autonomously in a particular environment. In case of emergency, such a robot can be deployed in that area in order to secure it.
Research and Education Robots

Skilligent Robot Learning and Behavior Control System can be used for research in the frontier areas of robotics such as:

  • Behavior Control and Coordination
  • Robot Learning from Demonstration/Experience/Observation
  • Task/Procedure Learning
  • Skill Learning, generation of controllers, Feature Selection and Discretization, Adaptive Controllers, Multivariable Controllers
  • Computer Vision: Visual Servoing, Object Recognition, Stereo Vision, Image Feature Detectors, Scale Invariant Features
  • Sound Recognition, Speech Emergence
  • Attention Systems
  • Human-to-robot interaction, Teamwork, Joint Intention, Speech Emergence, Social Interaction, Social Cues
  • Navigation/SLAM
  • Advanced Remote Control and Telepresence
  • Simulations, Augmented Reality
  • Robot Safety

The control system has a modular structure. During a research project, various built-in modules can be replaced with or complemented by new modules in order to improve the system or perform specific research. The diagram below shows various external software modules which can be attached to the core of Skilligent Robot Learning and Behavior Control System.

Skilligent Robot Software

Integration with existing robotics platforms

Skilligent Robot Learning and Behavior Control System can be integrated with various existing robotics software platforms such as Microsoft Robotics Studio. Integration with the Microsoft's robotics platform is currently in progress; integration with other robotic software platforms is planned in subsequent releases. Skilligent software runs as a standalone control system or utilizes those platforms as a hardware abstraction layer or a unified execution environment.

Due to componentized architecture of the Skilligent Robot Learning and Behavior Control System, it can be integrated with various existing software components including:

  1. Robotics software platforms
  2. Simulation Environments
  3. SLAM/navigation systems
  4. Computer Vision systems
  5. Speech Recognition Systems
  6. Tele-operation, remote control, telepresence systems
  7. Swarm coordination systems
Skilligent Kits

Skilligent Kits help integrate the trainable control system into various robots or robotic platforms. The kits provide everything needed to kick start a system integration project or an advanced research project. To purchase the kits, please contact Skilligent or your local Skilligent distributor.