RoboCupRescue 2011 - Robot League Team PANDORA (Greece)

Vassilios Petridis, Zoe Doulgeri, Loukas Petrou, Anastasios Delopoulos, Andreas Symeonidis, Emmanouil Tsardoulias, Charalampos Serenis, Nikos Zikos, Petros Agelidis, Miltos Allamanis, Nikos Michailidis, Dimitrios Papageorgiou, Michail Skolarikis, Marina Stamatiadou, Nikos Tolis, Dimitrios Vitsios

Department of Electrical and Computer Engineering Aristotle University of Thessaloniki

http://www.ee.auth.gr

Abstract This is the TDP of the PANDORA Robotics Team of the Aristotle University of Thessaloniki to sign on for the 2011 RoboCupRescue competition. We are going to use one tracked platform aiming at scoring the victims in the yellow arena and in the blue arena (grasping and carrying a specific object, such as a small bottle of water).

Introduction

The PANDORA Robotics Team (Program for the Advancement of Non Directed Operating Robotic Agents) of the Department of Electrical and Computer Engineering (DECE) of Aristotle University of Thessaloniki (AUTH), Greece aims in developing an experimental robotic platform for space exploration and victim identification. Overall objectives of the team are the application of the existing know-how on a reallife problem, the advancement of the group's state-of-the-art expertise. The PANDORA Robotics Team was founded in 2005 and has already participated in the RoboCupRescue 2008 and 2009 competitions. This year, the team intents to participate in the yellow and blue arenas.

1. Team Members and Their Contributions

The team comprises 5 faculty members of varying expertise and a compilation of postgraduate and undergraduate students. The following list provides the names and responsibilities of the team members.

Team Mentors

• Vassilios Petridis, Professor
• Zoe Doulgeri, Professor
• Loukas Petrou, Associate Professor
• Anastasios Delopoulos, Assistant Professor
• Andreas Symeonidis, Lecturer

Management Team

Alexios Papadopoulos, Marina Stamatiadou

AI Team

Team Leader: Emmanouil Tsardoulias

SLAM: Georgios Apostolidis, Panagiotis Thomaidis Planner: Aikaterini Iliakopoulou, Andreas Kargakos

Kinematic Model: Nikolaos Zikos

Software Architecture Team

Team Leader: Miltiadis Allamanis

Testing: Marina Stamatiadou, Pelagia Sikoudi- Amanatidou GUI: Dimitrios Vitsios, Alaexandros Kalliontzis, Kostas Lamaris

Vision Team

Team Leader: Michail Skolarikis

Face recognition: Fragkiskos Koufogiannis

Tag/Hole/Motion detection: Evaggelos Skartados, Georgios Aprilis, Vasilios Tsakalis

Voice recognition Team

Team Leader: Nikolaos Zikos Sound control: Petros Agelidis

Electronic design Team

Team leader: Charalampos Serenis Sensors: Nikolaos Tolis, Dimitrios Kanlis

Integration: Alexios Papadopoulos, Nikolaos Tselepis

Mechanical Team

Team Leader: Nikolaos Michailidis Motor control: Nikolaos Kourous

RoboArm Team

Team Leader: Nikolaos Michailidis Arm Kinematics: Dimitrios Papageorgiou

Trajectory Planning: Nikolaos Zikos, Maria Grammatikopoulou

The team is going to be represented by 11 members in the competition. Names are going to be listed in the registration form.

2. Operator Station Set-up and Break-Down (10 minutes)

Three operators are needed for setting up the PANDORA robot: the head operator of the system, who carries the base station case, and two operators that carry the platform case.

The initialization process is realized as follows:

• Transfer all objects in the area and deploy (3 minutes).
• Activate the platform and the base station (3 minutes).
• Launch the PANDORA robot OS (2 minutes).
• Perform communication check, in order to establish and validate Wi-Fi connection (1 minute).
• Perform system check and diagnostics, in order to verify that all the systems of the platform are working properly (1 minute).

3. Communications

Following RCR regulations, we are going to use W-LAN 802.11a (5 GHz) and will wait to be assigned with a channel/band from the organizers during the competition.

Table 1. PANDORA communication protocol

4. Control Method and Human-Robot Interface

The PANDORA robot will operate in three modes: the fully autonomous mode, where a number of simultaneous processes will be executed in order to achieve autonomous exploration and victim identification, the tele-operation mode, where the robot will be totally manipulated by an experienced user, and the semi-autonomous mode, where the robot will be steered by a user, nevertheless a number of process will assist the user.

In order to ensure a flexible and modular scheme where reconfiguration is possible, we opted for a component-based software architecture. The selected architecture ensures easy testing and integration, while it decouples the overall system from each component's actual implementation.

4.1 PANDORA Software Architecture

Having considered various off-the-shelf middleware, we adopted ROS (http://www.ros.org) for PANDORA's middleware. A number of factors were considered during the middleware selection process. A messaging communication scheme was preferred to a typical RPC-style middleware, due to its inherent ability to promote loose coupling. Furthermore, messaging provides asynchronous communications with the ability to control dataflow, which is extremely important for complex interconnected systems. The basic advantages of ROS are: open-source nature, transparent architecture, wide-spread usage, interoperability with other robot frameworks, quality of the development toolchain and extensive documentation.

ROS comprises a peer-to-peer network of components (denoted as nodes), which communicate via messages through the respective ROS infrastructure. The channels that messages are sent through are called topics. RPC-style communication is also achieved through services and data persistence is achieved through the Parameter Server.

PANDORA software architecture consists of several packages implementing nodes that perform different tasks (vision, sound, navigation, etc). The selected software design attempts to decouple nodes from each other as much as possible, thus minimizing the induced complexity. For all PANDORA packages, provided and required interfaces were defined through the respective ROS interfaces, thus ensuring language independence and easy integration. Coding standards were defined and are applied for all packages. Figure 1 depicts the PANDORA nodes and their interconnections, which are discussed next.

Table 2. Information displayed in the respective GUI tabs

4.2 PANDORA Graphical User Interface (GUI)

PANDORA provides a user friendly GUI for visualizing information and operating the robot. Three tabs are available, containing information related to navigation, victim identification and debugging. In each of the tabs, related information is displayed, as depicted in Table 2. Nevertheless, the operator can dynamically add/remove sensor information and modify the type and the layout of the widgets displayed in each tab, since PANDORA GUI adopts a widget-like architecture. A mockup of the GUI is provided in Figure 2.

When on tele-operation mode, the robot vehicle is controlled using a wired gamepad or a keyboard, while the robot arm is controlled using a joystick. When on the autonomous mode, GUI is only for visualizing/monitoring and no intervention is allowed, up to the point that a victim is recognized. Then, PANDORA sends an interrupt signal to activate the GUI and expects proper operator action in order to continue.

4.3 PANDORA Hardware Architecture

Figure 3 provides an overview of the hardware peripherals needed to interface with the various sensors of the system. The lowest-level communication protocol to the sensors is implemented through their connection to two Atmel AT90XMEGA128A1 microcontrollers, which employ DMA to read the sensor values in parallel and send data to the PANDORA software infrastructure through the serial port, employing a custom-design communication protocol.

In order to ensure easy debugging of the hardware components and their intercommunication, an LCD touch screen can be connected to the microcontrollers and probe the system for correct functionality and possible errors.

5. Map generation/printing

(Section overview)

5.1 SLAM

PANDORA implements an SMG (Scan Match Genetic) SLAM scheme for space exploration. It employs an occupancy grid map and performs a scan-to-map match, instead of the traditional scan-to-scan matching. Scan matching is realized through a genetic algorithm mechanism (Random Restart Hill Climbing) and ray reduction is employed for performance reasons.

One of the two most important features of SMG SLAM is ray-picking; the main idea is to reduce complexity and time needed for matching by preprocessing the scan and selecting rays that are "critical" for the matching process. We define "critical" in the sense that the remaining ray information is redundant to the matching process, since the "critical" scans act as features of the scan, even if they are extracted from heuristics and not from any feature extraction method. A hill climbing mechanism has been adopted for the identification of the correct transformation between the current scan and the global map (which is the inverse of the robot translation and rotation). Hill climbing is a very popular and efficient genetic method for finding optimal solutions to complex problems. Its setup is like a genetic algorithm but the population consists only of one individual.

The individual genome in the genetic method comprises three numeric values (<Dx, Dy, Dtheta>), representing the correct transformation for scan matching. The fitness value for the individual is calculated by summing the possibilities of occupancy in the selected laser rays, according to the transformation of the hill climbing individual.

5.2 Navigation

PANDORA's navigation module comprises three sub-modules: the Planner, the Navigator and the Data Fusion.

The Planner is the coordinator of the robot's artificial intelligence. It monitors all other PANDORA nodes, providing them with input and allowing them to take control and perform specific tasks. It defines a goal (target) in the environment according to the circumstances, creates the path to it, and feeds the navigator in order to follow it. Also, it (de)activates the stereo camera, sound and arm navigation nodes (subsystems).

6. Sensors for Navigation and Localization

The PANDORA robotic platform is equipped with several sensors in order to determine its current position and its distance from various objects. These sensors are discussed next.

6.1 Laser Range Finder (Hokuyo URG-04LX)

For map creation a Hokuyo URG-04LX Laser Range Finder (Figure 6) has been installed. It has a viewing angle of 240° and a detection range of 20mm up to 4m. The angular resolution is 0.36°, which gives 667 measurements in a single scan, while its linear resolution is 1mm. Measurement accuracy varies from 10mm (for distances from 20mm to 1m) to 1% of the measurement for distances up to 4m (Fig. 6). It operates on 5V DC (possible error of +/- 5%) and has a current consumption of 500mA.

6.2 Ultrasonic Sensors

Five ultrasonic SRF05 sensors (Figure 7) are situated around the robot. They use a simple I/O interface for communicating with a microprocessor, publishing a pulse with width proportional to the distance of the object. Their power consumption is very low (approx. 0.02W). In the front part of the vehicle they will be used to prevent the vehicle from bumping on obstacles. SRF05 sensors have a detection range of 3cm to 4m and will be used as a complement to the Laser Sensor.

6.3 Infrared Sensors

Infrared sensors are placed both on the left and on the right side of the robot and they will cooperate with the ultrasonic sensors in order to give an accurate measurement of the distance of the robot from any obstacle. GP2Y0A21YK (Figure 8) infrared sensors were selected. Their detection distance range is small (10 cm – 80cm), thus they are assigned with monitoring the close surroundings of the robot. One of the sensors is assigned to measure the distance between the bottom side of the robot and the ground, so as to fire an alarm in case the robot is in danger of falling.

7. Sensors for Victim Identification

In order to accurately identify a victim and pinpoint his/her location, a number of sensors have been installed, providing input to sophisticated detection algorithms. Specifically, a stereo vision camera, thermal sensors, a CO2 sensor and three microphones are being used. Sensor results are then fused to determine the behavior of the robot.

7.1 Vision

The autonomous platform is equipped with a stereo vision camera, STOC by Videre Design (Figure 9) and a standard web camera to offer the requested set of detection and identification services. Furthermore, stereo vision processing enhances PANDORA's ability to calculate distance from the victim.

7.2 Temperature

We consider that temperature differences in the environment could imply victims. Thus we have installed Focal Plane Array (FPA) thermal sensors, in order to compare temperature values, find fluctuations and make an estimate of a victim's position, if one is found. The TPA81 (Figure 10) is a thermopile array (thermocouples connected in series), together with a silicon lens and associated electronics, which detects infrared in the 2um-22um range (the range of radiant heat). It can measure the temperature of 8 adjacent points, as well as the ambient temperature, simultaneously. It can detect victim's temperature within 2 meters and its typical field of view is 41˚ by 6. It is connected to a microprocessor via an I C interface and updates its values at a rate of approximately 20Hz.

7.3 CO2 sensor

The CO2 sensor (Figure 12) installed measures the concentration of CO2 gas in the environment. For the detection of the human respiration, we simply track fluctuations in the concentration of CO2 in the air. The selected sensor can detect concentration of CO2 gas, from 0 – 50,000ppm.

7.4 Sound

Pandora's voice processing unit comprises the following components:

• Four microphones (Figure 13) on the head of the robotic arm. Three of them form a triangle, with the two facing forward with an angle of 90^o with each other and the third is on the back, at an angle of 135^o degrees with the other two. The forth microphone is placed at a different level.
• One amplifier with four channels, one for each microphone.
• One analog band-pass filter per microphone.
• One DAS with four inputs with sample and hold, in order to achieve simultaneous recordings, one Analog to Digital converter, and digital filters.
• One Atmel Avr AT32UC3 which is the signal processing unit.

PANDORA Voice node is assigned with two tasks: to find a victim and identify its state. In exploration mode, Voice scans the space in order to grasp a sound that could direct to a victim. Upon the identification of a sound, a request is sent for thorough scan. If granted permission, Voice performs a second scan and provides Data Fusion with an estimate of the position of the victim, as well as a level of certainty of the estimation. When the vehicle approaches the victim and the robotic arm extends to approach him/her, Voice is assigned with the task to recognize his/her state. To do so, Voice measures the intensity of the sound, transforming it to dB. Then, the estimate of the state of the victim, as well as a level of certainty of the estimation is sent to Data Fusion.

8. Robot Locomotion

(Section overview)

8.1 Platform mechanical design

With respect to previous years' mechanical design, we have improved the drawbacks of the platform. The PANDORA vehicle (Figure 14) employs an improved track system for its locomotion. The basic improvements are as follows:

• the use of a tensioner mechanism for the synthetic track (Figure 15)
• a 10mm increase in width and height of the vehicle's chassis
• the adjustment of idle rollers, so as to avoid track oscillations and damage

The metal frame of the robot is made of aluminum. The platform is equipped with two 50W brushless DC motors with a reduction planetary gearhead. The size of the robot is 560x230x200 mm. It is solid enough, appropriate to move in different types of terrain and climb easily a 40^o slope.

9. Other Mechanisms

(Section overview)

9.1 Robotic Arm

The PANDORA Robotic Arm was designed in order to provide the ability to reach most of the points of interest. The geometry selected led to a five degrees of freedom system, with rotational joints and cylindrical links as shown in Figure 16. Cabling issues specified link diameter. Joints are designed to allow folding of the arm and maximize angle limits in order to achieve optimal system workspace. Joints are powered by dc motor-encoder-reduction gearbox assemblies connected to appropriate drivers for control implementation. The head of the arm is designed to accommodate all essential sensors for victim identification and partly for navigation. The arm is provided with a gripper attached at the end of its last link for object manipulation.

9.2 Stabilizer

The stabilization mechanism (Figure 17) is mounted on the chassis of the robotic platform. It allows the laser, the thermal sensors and the stereo vision camera to stay on the horizontal level, regardless of the robot's inclination. The stabilization is achieved via two linear DC-servomotors with fast response using a three dimensional Ocean Server's OS5000 compass, which gives measurements in degrees (Figure 18). It provides the inclination of the robot with respect to the starting inclination. The compass communicates with an AVR microcontroller, through a serial UART. The compass is also used to stabilize the laser of the robot at the desired position. Its accuracy is lower than 0.5 degrees with 0.2 degrees resolution. Its refresh rate is at 40 Hz.

9.3 Computing System (Single Board Computer)

In order to accommodate the processing needs of PANDORA, we have built a Mini-ITX system (Figure 19) and placed it in the main body of the robot. The specifications of the system are the following: MSI IM-GM45 Mini-ITX mainboard, Intel Core2Quad mobile Q9000 processor, 4GB of DDR2 SO-DIMMs, a Solid State Drive with 32GB capacity, all power from a M4-ATX Pico PSU. The board's dimensions are 17x17cm and for peripheral interconnection there are 8 USB ports, 5 RS-232 serial ports, a PCI FireWire add-on card for the Stereo Camera, and a MiniPCIe WiFi capable add-on card with 2 pigtails for external antennas. The system power consumption is estimated at 80Watts at full computing load, without the USB, Serial and FireWire peripherals connected.

Communication between the single board computer (SBC) and the sensor network is performed through a serial interface. The higher level protocol designed allows strict timings and deterministic prediction of the CPU load generated by the sensors. This allows PANDORA to operate almost in real time.

10. Team Training for Operation (Human Factors)

The operator(s) should be familiar with the GUI and the gamepad. He/she should be able to understand the readings of all sensors and act accordingly when allowed. He/she should go through extensive training and accomplish test missions in the specially constructed arena, which emulates a destruction scene.

11. Possibility for Practical Application to Real Disaster Site

The fully deployed robotic platform has not been tested in a real environment yet. Nevertheless, the previous platform was exhibited at EXPO 2008 in Thessaloniki, and it was widely accepted. The Hellenic Rescue Team and the Institute of Engineering Seismology and Earthquake Engineering showed vivid interest in the potential of using the platform in real life. Additionally, we are planning to develop a similar platform with a local company for surveillance purposes.

12. System Cost

The following table provides information on the cost of the parts of the PANDORA platform.

Table 3. Part names, quantities and cost

References

1. Russell, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach. 2nd edn. Upper Saddle River, New Jersey: Prentice Hall (2003)
2. Nidhi Kalra, N. Ferguson, D., Stentz, A.: Incremental reconstruction of generalized Voronoi diagrams on grids, Robotics and Autonomous Systems 57 (2009) 123–128
3. Dijkstra, E.W.: A note on two problems in connexion with graphs, Numerische Mathematik 1 (1959), 269–271
4. WillowGarage: OpenCV 2.1 C++ Reference. Available online at: http://opencv.willowgarage.com/documentation/cpp/index.html
5. Szeliski R.: Computer Vision: Algorithms and Applications, Springer 2011 ISBN 1868- 0941
6. Viola P., Jones M.: Robust Real-Time Face Detection, International Journal of Computer Vision 57(2), 137–154, 2004
7. Joly, A., Buisson, O.: Logo retrieval with a contrario visual query expansion. In:MM '09: Proceedings of the seventeen ACM international conference on Multimedia, New York, NY, USA, ACM (2009) 581-584
8. Joly A., Buisson O.: A Posteriori Multi-Probe Locality Sensitive Hashing, MM'08, October 26-31, 2008. 209-218
9. Lowe D.: Distinctive image features from scale-invariant keypoint, International Journal of Computer Vision, 60, 2 (2004), 91-110