Department of Computer Science Technische Universitaet Muenchen
Home People Teaching Research Publications Info Sitemap
Research | Publications | Teaching | Miscellaneous | Contact

Publications

Sorted by DateClassified by Publication TypeClassified by Research Category

Freek Stulp, Suat Gedikli, and Michael Beetz. Evaluating Multi-Agent Robotic Systems Using Ground Truth. In Proceedings of the Workshop on Methods and Technology for Empirical Evaluation of Multi-agent Systems and Multi-robot Teams (MTEE), 2004.

Download

[PDF]286.6kB  

Abstract

A thorough empirical evaluation of multi-agent robotic systems is greatly facilitated if the \em true state of the world over time can be obtained. The accuracy of the beliefs as well as the overall performance can then be measured objectively and efficiently. In this paper we present a system for determining the \em ground truth state of the world, similar to the ceiling cameras used in RoboCup small-size league. We have used this ground truth data to evaluate the accuracy of the self- and object-localization of the robots in our RoboCup mid-size league team, the Agilo RoboCuppers. More complex models of the state estimation module have also been learned. These models provide insight into the workings and shortcomings of this module, and can be used to improve it.

BibTeX Entry

@InProceedings{stulp04evaluating,
  author =            {Freek Stulp and Suat Gedikli and Michael Beetz},
  title =             {Evaluating Multi-Agent Robotic Systems Using Ground Truth},
  year =              {2004},
  booktitle =         {Proceedings of the Workshop on Methods and Technology for Empirical Evaluation
                       of Multi-agent Systems and Multi-robot Teams (MTEE)},
  pdf =               {http://www9.in.tum.de/publications/2004/KI-04-Stulp-etal.pdf},
  url =               {},
  bib2html_pubtype =  {Refereed Workshop Paper},
  bib2html_rescat =   {Robotics - RoboCup},
  abstract =          {A thorough empirical evaluation of multi-agent robotic
  systems is greatly facilitated if the {\em true} state of the world over time
  can be obtained. The accuracy of the beliefs as well as the overall
  performance can then be measured objectively and efficiently. In this paper we
  present a system for determining the {\em ground truth} state of the world,
  similar to the ceiling cameras used in RoboCup small-size league. We have used
  this ground truth data to evaluate the accuracy of the self- and
  object-localization of the robots in our RoboCup mid-size league team, the
  Agilo RoboCuppers. More complex models of the state estimation module have
  also been learned. These models provide insight into the workings and
  shortcomings of this module, and can be used to improve it.}
}

Generated by bib2html.pl (written by Patrick Riley ) on Tue Sep 23, 2008 15:09:11 UTC


Computer Science IX | Technische Universität München