Motivated reinforcement learning for improved head actuation of humanoid robots

The ability of an autonomous agent to self-localise within its local environment is critically dependent on its ability to make accurate observations of static, salient features. This notion has driven considerable research into the development and improvement of feature extraction and object recognition algorithms, both within RoboCup and the robotics community at large. Instead, this paper focuses on a rarely-considered issue; determining an optimal policy for actuating a robot’s head, to ensure it observes regions of the environment that will maximise the positional nformation provided. The complexity of this task is magnified by a number of common computational issues; specifically high dimensionality state spaces and noisy environmental observations. This paper details the application of motivated reinforcement learning to partially overcome these issues, leading to an 11% improvement (relative to the null case of uniformly distributed actuation policies) in self-localisation for an agent trained online for less than 1 hour. The method is demonstrated as a viable method for improving self-localisation in robotics, without the need for further optimisation of object recognition or tuning of probabilistic filters.