Department of Computer Science Technische Universitaet Muenchen
Home People Teaching Research Publications Info Sitemap
Research | Publications | Teaching | Miscellaneous | Contact

Publications

Sorted by DateClassified by Publication TypeClassified by Research Category

Freek Stulp. Tailoring Robot Actions to Task Contexts using Action Models. Ph.D. Thesis, Technische Universität München, 2007.

Download

[PDF]4.5MB  

Abstract

In motor control, high-level goals must be expressed in terms of low-level motor commands. An effective approach to bridge this gap, widespread in both nature and robotics, is to acquire a set of temporally extended actions, each designed for specific goals and task contexts. An action selection module then selects the appropriate action in a given situation. In this approach, high-level goals are mapped to actions, and actions produce streams of motor commands. The first mapping is often ambiguous, as several actions or action parameterizations can achieve the same goal. Instead of choosing an arbitrary action or parameterization, the robot should select those that best fulfill some pre-specified requirement, such as minimal execution duration, successful execution, or coordination of actions with others. The key to being able to perform this selection lies in prediction. By predicting the performance of different actions and action parameterizations, the robot can also predict which of them best meets the requirement. Action models, which have many similarities with human forward models, enable robots to make such predictions. In this dissertation, we introduce a computational model for the acquisition and application of action models. Robots first learn action models from observed experience, and then use them to optimize their performance with the following methods: 1) Subgoal refinement, which enables robots to optimize actions in action sequences by predicting which action parameterization leads to the best performance. 2) Condition refinement and subgoal assertion, with which robots can adapt existing actions to novel task contexts and goals by predicting when action execution will fail. 3) Implicit coordination, in which multiple robots globally coordinate their actions, by locally making predictions about the performance of other robots. The acquisition and applications of action models have been realized and empirically evaluated in three robotic domains: the Pioneer robots of our RoboCup mid-size league team, a simulated B21 in a kitchen environment, and a PowerCube robot arm. The main principle behind this approach is that in robot controller design, knowledge that robots learn themselves from observed experience complements well the abstract knowledge that humans specify.

BibTeX Entry

@PhdThesis{stulp07tailoring,
  author =            {Freek Stulp},
  title =             {Tailoring Robot Actions to Task Contexts using Action Models},
  school =            {Technische Universit\"at M\"unchen},
  year =              {2007},
  bib2html_pubtype =  {Thesis},
  bib2html_rescat =   {Robotics - Motor Control},
  pdf =               {http://mediatum2.ub.tum.de/doc/617105/617105.pdf},
  url =               {http://mediatum2.ub.tum.de/node?id=617105},
  abstract =          {
  In motor control, high-level goals must be expressed in terms of low-level
  motor commands. An effective approach to bridge this gap, widespread in both
  nature and robotics, is to acquire a set of temporally extended actions, each
  designed for specific goals and task contexts. An action selection module then
  selects the appropriate action in a given situation. In this approach,
  high-level goals are mapped to actions, and actions produce streams of motor
  commands. The first mapping is often ambiguous, as several actions or action
  parameterizations can achieve the same goal. Instead of choosing an arbitrary
  action or parameterization, the robot should select those that best fulfill
  some pre-specified requirement, such as minimal execution duration, successful
  execution, or coordination of actions with others.
  The key to being able to perform this selection lies in prediction. By
  predicting the performance of different actions and action parameterizations,
  the robot can also predict which of them best meets the requirement. Action
  models, which have many similarities with human forward models, enable robots
  to make such predictions.
  In this dissertation, we introduce a computational model for the acquisition
  and application of action models. Robots first learn action models from
  observed experience, and then use them to optimize their performance with the
  following methods: 1) Subgoal refinement, which enables robots to
  optimize actions in action sequences by predicting which action
  parameterization leads to the best performance. 2) Condition refinement
  and subgoal assertion, with which robots can adapt existing actions to
  novel task contexts and goals by predicting when action execution will fail.
  3) Implicit coordination, in which multiple robots globally coordinate
  their actions, by locally making predictions about the performance of other
  robots. The acquisition and applications of action models have been realized
  and empirically evaluated in three robotic domains: the Pioneer robots of our
  RoboCup mid-size league team, a simulated B21 in a kitchen environment, and a
  PowerCube robot arm.
  The main principle behind this approach is that in robot controller design,
  knowledge that robots learn themselves from observed experience complements
  well the abstract knowledge that humans specify.
  }
}

Generated by bib2html.pl (written by Patrick Riley ) on Fri Jul 11, 2008 22:06:33 UTC


Computer Science IX | Technische Universität München