Lifelong Adaptation and Failure Recovery by Evolutionary Computation for Multiple Heterogeneous Robots

Grant Information:

EPSRC grant reference EP/D054419/1

Principal Investigator - Dr Myra S. Wilson

Co-investigator - Dr Joanne Walker

Contact Information:

Dr Myra S. Wilson,
Department of Computer Science,
University of Wales,
Aberystwyth,
Dyfed, SY23 3DB,
Wales, UK

Tel: +44 1970 622928
Fax: +44 1970 628536
Email: mxw@aber.ac.uk

Project Summary

The need for autonomy in the area of mobile robotics is increasing. With more applications relating to areas where robots may be out of contact for extended periods of time (such as during planetary or geographically remote earth-based exploration tasks), it is becoming important that they continue to work effectively and autonomously adapt to different environments without performing inappropriate actions which could jeopardise the robot or its surroundings. Most current systems are grounded in one environment and their competence breaks down when either the environment changes, or on robot degradation. What is required is a robot system that will need little or no on-site programming and which can adapt within limits to its own degradation and to changes in its task or environment to keep going as long as possible without failure. The robots must also deal intelligently with any failures which do occur. Other criteria, such as ensuring that power constraints are met, should also be addressed.

A multi-robot group consisting of heterogeneous robots offers several advantages over single robots or homogeneous teams. These include the ability to use their individual capabilities to deal with a more diverse set of tasks, to complete a task when an individual robot fails through its own degradation, or to take over a task if environmental changes mean that the original robot assigned to the task can no longer perform it.

This proposal envisions a multiple, heterogeneous robot system that is able to operate without external assistance for an extended period of time. This highlights the importance of adaptability, usefulness in diverse environments, and the advantage of not having to perform complex reprogramming. The system should be able to identify when a robot has degraded and is unable to complete a task. The task can then be reallocated to another robot with a similar competence. Where the environment has changed and the robot is no longer appropriate for the task, this should be recognised and the task reassigned to another robot and the original robot assigned elsewhere. This means that the system must have redundancy and adaptability during its lifetime, must be able to dynamically reallocate tasks and recognise task failure, and must have a large degree of autonomy. The proposal will not deal with multiple robots concurrently cooperating to perform a single task as this is a complex issue in its own right. An individual robot will attempt a task and will move away on failure or be treated by the other robots as a new obstacle to be dealt with.

The project intends using genetic and evolutionary computation (GEC) methods to achieve the above adaptation and failure recognition. GEC algorithms are a biologically inspired method of optimisation and search based on the concept of natural selection. Although GECs have been applied to the design of robots and their controllers in the past, they have rarely been applied to the problem of lifelong optimisation and adaptation of robots in dynamic environments. Evolutionary methods differ from most robot learning techniques in two main ways: firstly the amount of supervision required is usually lower, and secondly, the evolution does not impose constraints on what can be evolved. Genetic algorithms and evolutionary strategies have already been shown to enhance the robustness of the behaviour of a robot in changing environments.

Based on Walker's PhD thesis, the principal aim of this project is to develop a heterogeneous multi-robot system which is capable of a large degree of adaptation in diverse environments while performing useful task reallocation on catastrophic robot degradation or environmental/task changes. To do this, the project funds, firstly, a PhD student who will research lifelong adaptation in diverse environments for individual robots. Secondly, a PDRA who will concentrate on the multiple, heterogeneous robot system for recognising task failure or inappropriate behaviour, and robot reassignment, obtaining information through an evolutionary training phase.

Robotics Lab Facilities

The work outlined in this proposal will take place within the Intelligent Systems Lab in the Department of Computer Science at the University of Wales Aberystwyth. The Intelligent Robotics Research Group forms one of four research areas in the department with many members of staff actively involved in research. Support from HEFCW and a series of EPSRC JREI equipment grants have helped to maintain a high level of research infrastructure, including high performance computer workstations and servers, in the department. A recent SRIF grant of 800K plus a further contribution of 500K from Sun Microsystems has also provided a new, completely refurbished laboratory and a large amount of infrastructure, including a high performance computer cluster of V880 multiprocessor systems and several mobile and manipulator robot systems which include four Pioneer2e mobile bases and one Pioneer outdoor mobile. The mobile robotic platforms are equipped with standard sonar sensing plus wireless ethernet connections. Two of the Pioneer bases have 2D gripper arms fitted, and a frame grabber and camera are available, along with other sensors, such as a laser scanner. Several other smaller mobile robots, such as a Khepera, are also present in the lab, along with industrial robot arms (Adept and Puma). A large area in the centre of the lab is dedicated to a robot arena. This provides adequate floor space for running robot experiments. The lab has a 3D motion capture system (Vicon) which can be used for effective and accurate results capture, a facility which is not available in many robotics labs. The department also supports computer officers who perform a wide variety of functions (file-serving, archive, backup, printing, web and mail services, and the installation of all new software). There is also a technician available for electrical installation and maintenance of the robots.