Seminar Markovian Robotics SS 2008

Submitted by stf on 9. February 2008 - 17:11

An announcement of the course can also be found in the course information system CAMPUS.
There is an L²P-Lernraum for this course. You need to register for this room by entering the registration on the CAMPUS site above while you are logged in with your CAMPUS-Office account.


Agents are autonomous, computational entities (programs, robots) which perceive their environment through sensors and which are able to take influence on it through effectors. Many entities in robotics such as the environment itself, sensing results, and action effects are uncertain. To be able to cope with those uncertainties in complex domains one usually uses probabilistic mechanism. Many of those mechanism employ the Markov Assumption which refers to the dependence of temporal states. With it, values in any given state are only influenced by the values of the state directly preceding it.
We will cover various methods and formalism using the Markov Assumption like Markov Chains, Markov Decision Processes (in several forms), and Hidden Markov Models and investigate their applications to robotics. Theoretical backgrounds as well as practical aspects will be discussed and illuminated.


Participants have already been selected and notified.


  • basic study period completed (Vordiplom)
  • profound skills in mathematics, especially probability theory


Participant Topic Advisor
Paul KöhlerHMMS for Speech RecognitinSTF
Matthias SchifferHMMS for Complex Action RecognitionDB
Dan ZhouMarkov Chain Monte Carlo Data AssociationSTF
Michael WolfMarkov Chain Monte Carlo for Topological MapsDB
Patrick JüptnerEKF-Markov LocalizationSTF
Damian LukowskiMonte Carlo LocalizationDB
Deni RacoEKF Visual Tracking (Condensation Alg.)STF
Christian BienRao-Blackwellised Particle Filter visual SLAMDB
Carsten CordesMarkov Decision Processes - PlanningSTF
Daniel SchmitzMarkov Decision Processes - LearningDB
Christian FerberMarkov Decision Processes - Adv. TopicsSTF
Chitra Hapsari AyuningtyasSemi-MDPs and continuous TimeDB
Johanna NellenPOMDPsSTF


Here is the list of literature.

Additional information

Seminar Procedure

Seminar talks will be held weekly throughout the semester. Participation is bindingly for achieving the credit. The preparation of the talks and the written workout should not be a translation or renarration of the given paper(s). The given literature is meant to be a starting point for own literature investigation on the topic. The literature should then be discussed with the instructor.

No later than 6 weeks before the talk the seminarist should hand in a preliminary workout and 3 week (latest!) before the talk the final version of the slides/transparencies must be given to the respective seminar instructor.
You are of course more than welcome to discuss and coordinate with us way before those final deadlines.

Instructions on a good seminar talk

Additional Info

Renate Eschenbach from our library offers guided tours on how to find literature in the library and how to prepare a seminar.
Interested students should enlist for a tour in the preliminary discussion.