Learning-Based Control for Robotics

Course Description

Model-based methods provide a powerful framework for controlling challenging robotic systems; however, imperfect models often lead to poor performance during real-world deployment. Machine learning methods provide one means of addressing deficient models, either through explicitly learning a model of the system dynamics or computing a control policy directly from data. In this course, we will explore the intersection between optimal control and machine learning, covering both model-free and model-based methods for learning-based control. We will start with a review of dynamic programming and its relationship to reinforcement learning. We will then explore the three primary means of incorporating learning into controller synthesis: learning value functions, control policies, and dynamics models. The course will culminate in a discussion of model-based reinforcement learning and adaptive optimal control. We will also discuss advanced topics such as learning Lyapunov functions and contraction metrics from data, iterative learning control, and techniques for adaptive nonlinear model predictive control. Instructor approval required, submit request to enroll through SIS. No audits allowed.

Code

EN.530.696

Credits

3

Subject

Mechanical Engineering