Probabilistic Machine Learning (RO5101 T)

The lecture Probabilistic Machine Learning belongs to the Module Robot Learning (RO5100).

In the winter semester, Prof. Dr. Elmar Rueckert is teaching the course Probabilistic Machine Learning (RO5101 T).

In the summer semester, Prof. Dr. Elmar Rueckert is teaching the course Reinforcement Learning (RO5102 T).

Important: Due to the study regulations, students have to attend both lectures to receive a final grade. Thus, there will be only a single written exam for both lectures. You can register for the written exam at the end of a semester. Note that students are only allowed to attend the exam if they achieve at least 50 percent of the points for there assignments in each of the two accompanying exercises.

The book of this lecture can be found here: https://drive.google.com/file/d/1ETcGr-VNiLwYiKZt7uLALdF-uuvFJJFh/view?usp=sharing

Note that is book is work in progress and the pdf will be constantly updated.

The course topics are

  1. Introduction to Probability Theory (Statistics refresher, Bayes Theorem, Common Probability distributions, Gaussian Calculus).
  2. Linear Probabilistic Regression (Linear models, Maximum Likelihood, Bayes & Logistic Regression).
  3. Nonlinear Probabilistic Regression (Radial basis function networks, Gaussian Processes, Recent research results in Robotic Movement Primitives, Hierarchical Bayesian & Mixture Models).
  4. Probabilistic Inference for Filtering, Smoothing and Planning (Classic, Extended & Unscented Kalman Filters, Particle Filters, Gibbs Sampling, Recent research results in Neural Planning).
  5. Probabilistic Optimization (Stochastic black-box Optimizer Covariance Matrix Analysis Evolutionary Strategies & Natural Evolutionary Strategies, Bayesian Optimization).

The learning objectives / qualifications are

  • Students get a comprehensive understanding of basic probability theory concepts and methods.
  • Students learn to analyze the challenges in a task and to identify promising machine learning approaches.
  • Students will understand the difference between deterministic and probabilistic algorithms and can define underlying assumptions and requirements.
  • Students understand and can apply advanced regression, inference and optimization techniques to real world problems.
  • Students know how to analyze the models’ results, improve the model parameters and can interpret the model predictions and their relevance.
  • Students understand how the basic concepts are used in current state-of-the-art research in robot movement primitive learning and in neural planning.

Follow this link to register for the course: https://moodle.uni-luebeck.de

Location & Times

Requirements

Strong statistical and mathematical knowledge is required beforehand. It is highly recommended to attend the course Humanoid Robotics (RO5300) prior to attending this course. The students will also experiment with state-of-the-art machine learning methods and robotic simulation tools which require strong programming skills.

Grading

The course is accompanied by regular tutorials, programming  exercises  and written assignments. The written assignments as well as the programming exercises will be graded. After the summer semester a single written exam for both lectures, probabilistic machine learning and reinforcement learning, has to be passed. Details will be presented in the first course unit on October the 17th, 2019.

Course dates & materials (tentative schedule)

Dates Chapter (1 to 5)TopicsLinks
17.10.2019VOAn Introduction to the Probabilistic Machine Learning (PML) lectureSlides
24.10.2019VO1 An Introduction to Probability TheoryPart I/II: Random Variables, Fundamental Rules, Fundamental Distributions, Conjugate Priors, Information Theory
28.10.2019UE1 An Introduction to Probability TheoryPart I/II: Random Variables, Fundamental Rules
31.10.2019--public holiday----
07.11.2019VO 2 Linear Probabilistic RegressionLinear Regression, Bayesian Regression
11.11.2019VO3 Nonlinear Probabilistic RegressionAttention! The excise is on the 14.11 and the lecture on the 15.11
14.11.2019--
18.11.2019UEMovement Primitives
21.11.2019VO3 Nonlinear Probabilistic RegressionMixture Models
25.11.2019UE3 Nonlinear Probabilistic RegressionGaussian Processes
28.11.2019UE
02.12.2019VO3 Nonlinear Probabilistic RegressionMovement Primitives
05.12.2019VO
09.12.2019UERecap of Ch. 1 to 3Q & A Intermediate Exam
12.12.2019VOIntermediate Exam 1 (IE1)Intermediate exam where 20 pts can be received.
16.12.2019UE
19.12.2019VO4 Probabilistic InferenceFiltering & Planning
09.01.2020VO4 Probabilistic InferenceDecision Making
13.01.2020UE
16.01.2020VO5 Probabilistic Optimization2nd Order Stochastic Search
20.01.2020UE
23.01.2020VO5 Probabilistic OptimizationBayesian Optimization
27.01.2020UE
30.01.2020VO5 Probabilistic OptimizationBayesian Optimization
03.02.2020UE
06.02.2020VOSummary and Potential Exam Questions
XX.07.2021ExamFinal ExamTentative Date of the written final exam.

Lecturer:
Prof. Dr. Elmar Rueckert
Teaching Assistant:
Nils Rottmann, M.Sc.
Language:
English only

Literature

  • Daphne Koller, Nir Friedman. Probabilistic Graphical Models: Principles and Techniques. ISBN 978-0-262-01319-2
  • Christopher M. Bishop. Pattern Recognition and Machine Learning. Springer (2006). ISBN 978-0-387-31073-2.
  • David Barber. Bayesian Reasoning and Machine Learning, Cambridge University Press (2012). ISBN 978-0-521-51814-7.
  • Kevin P. Murphy. Machine Learning: A Probabilistic Perspective. ISBN 978-0-262-01802-9

Bonus Points and Group Numbers

You can find the list of bonus points as well as the list of group numbers regarding the assignments here (coming soon).

Materials for the exercise

The course is accompanied by three graded assignments on Probabilistic Regression, Probabilistic Inference and on Probabilistic Optimization. The assignments will include algorithmic implementations in Matlab, Python or C++ and will be presented during the exercise sessions. The Robot Operating System (ROS) will also be part in some assignments as well as the simulation environment Gazebo. To experiment with state-of-the-art robot control and learning methods Mathworks’ MATLAB will be used. If you do not have it installed yet, please follow the instructions of our IT-Service Center.