Nexus 2010 3D Soccer Simulation Team Description
Armin Ildermi, M.Hossein Ansari, Mohammad JafarShokri, Mahdi Aledaghi, SinaMolavipoor, AhadHarati, Mahmoud Naghibzadeh
Software Simulation and Modeling Laboratory, Department of Computer Engineering Ferdowsi University of Mashhad, Mashhad, Iran
Abstract This paper presents an overview of Nexus 3D Soccer Simulation Team. Nexus has participated in many Soccer Simulation Competitions from 2003 up to now. Like in the past years we used our soccer playing agents as a test bed to verify our recent research results in the field of AI. We used evolutionary based machine learning algorithmsto enhance and optimize basic skills of the players such as walking and kicking the ball. In this paper, a brief description of our current and future works is presented.
Introduction
Robocup soccer simulation is a client-servermultiagent system in which server periodicallysends the clientssome information about the environment and their status while the clients reply with some commands. Therefore, it's a good platform for studying control of humanoid robots with many degrees of freedom and decision making in multiagent systems. Henceforth, the corresponding leaguehas been gaining popularity in recent international Robocup competitions. The current development of the 3D Soccer Simulation League is based on a humanoid robot known as Nao agent, which can be controlled by a low level interface and still needs lots of low level skills to be properly implemented. Our main research focus encompasses advanced control of walking, dynamic balance as well as multi-agent coordination. We build the source code from scratch and all modules where written by team members so that the whole project is homogeneous and different parts has good compatibility whit each other.
Actions
Actions are divided into three different types: low-level, mid-level and high-level actions [1], each of them are briefly descripted below.
Low-Level Actions
Low-level actions are the ones which need the least calculations and are the most basic actions of the player. For example,Kick is the action of kicking the ball when it is placed in front of the player;or Walk is theaction of walking straight ahead. In fact, at this level there is a direct server command which is closely related to the aimed action of the player. Other examples include Side-Walk, Slow-Walk and Turn.
Walking
A simple PID controller is implemented to control each joint of the Nao simulated robot, separately. Nao robot has 22 degrees of freedom (DOF) whith 6 of them in each leg. There are different ways for implementing Walk behavior. Solving inverse kinematic is one of them which we used in our implementation.
Shooting
Shooting the ball is one of the most important skills of a soccer player. Inverse kinematic method when properly utilized, can lead to effective shoots in addition to fast reaction. A curve is obtained which begins from the current ankle position and ends in the ball position serving as a trajectory for the ankle.
Mid-Level Actions
Mid-level actions are composed of some low-level actions and include scenarios, which is used more often by the player. For example Go-Round is a combination of some Side-Walks and Turns which makes the player move around the ball. Go-To is an action that lets the player go to a place with a certain coordinate. This action is combination of a Turn and a Walk which are done consecutively by the player. Another one, Kick-To is composite of a Go-Round which places the player in the direction of kicking destination, and a Kick which kicks the ball to the destination.
High-Level Actions
High-level actions are combinations of mid-level actions with some parameters which are calculated at run time. For example Shoot is a combination of a Go-Round, and a Kick-To with a parameter which power of the kick in order to delivering the ball to the destination. Other actions like Dribble, Pass, Positioning, Block and Intercept are also among high-level actions.
Decision Making
Having 6 players in a team makes team work more efficient on team's activity. So a good team strategy and decision making is needed to play a better game in the field. We used two phase decision making mechanism for handling different situations.
To determine the best action from amongst all possible ones for a given situation, we first recognize the best of each action type, i.e., the best shoot, the best dribble, and the best pass, independently. It is clear that, when the best possible shoot is sought the parameters that affect the shooting action are considered, only. For dribble and pass actions a similar process is followed. In the next phase, we select the best of bests, i.e., the system chooses the best action from amongst the three best actions shoot, dribble, and pass. In this phase, common measures are used in order to evaluate the actions. Fig.3 shows the overall work diagram.
Conclusion and Future works
As described above, our current simulated robotsare able to walk and perform the necessary actions.Currently we are working on robot's various skills to do them in a more intelligent and real time way for better and more reliable actions in a dynamic environment .We are now working on a method to control balance of the robots in simple collisions.
While not having a coach agent in the field, using goalie, which has a good view of the field as a coach, to analyze opponent's game play, and estimate their abilities like moving speed, makes the team to play a better game in the field.
References
- Amin MilaniFard, VahidSalmani, Mohammad Hossein Ansari, Mahmoud Naghibzadeh, Amir Farzad, MortezaDelgir, Amin Zamiri, HosseinKamyar, EhsanSaboori, FaridSeifi, MehrdadMozafari, "Nexus Robosoccer Development Process from 2D Simulated Agents to 3D Humanoid Soccerbots", Journal of the National Technical University "KharkivPolytechnical Institute" (Herald of the NTU "KhPI "Scientific Works). XIII 5'2007
- Amin Zamiri, Amir Farzad, EhsanSaboori, MojtabaRouhani, Mahmoud Naghibzadeh, Amin MilaniFard, An Evolutionary Gait Generator with Online Parameter Adjustment for Humanoid Robots.
- V. Salmani, M. Naghibzadeh, F. Seifi and A. Taherinia, "A Two Phase Mechanism for Agent's Action Selection in Soccer Simulation", The Second World Enformatika Conference, WEC'05, Istanbul, Turkey, pp. 217-220, February 2005.
- Sutton R, Barto A :Reinforcement Learning,An Introduction
- Daniel Joseph Paluska .Design of a humanoid biped for walking research .Master's thesis, 2000.
- Jerry Pratt and Gill Pratt .Exploiting natural dynamics in the control of a 3d bipedal walking simulation .Conferenceon ClimbingandWalking Robots, 1999.
- Knight, R., and Nehmzow, U., "Walking Robots, A Survey and a Research Proposal", Technical Report.
- Krister Wolff and Peter Nordin .An Evolutionary Based Approach for Control Programming of Humanoids