ABC-LMPC: Safe Sample-Based Learning MPC for Stochastic Nonlinear Dynamical Systems with Adjustable Boundary Conditions
Abstract
Sample-based learning model predictive control (LMPC) strategies have recently attracted attention due to their desirable theoretical properties and good empirical performance on robotic tasks. However, prior analysis of LMPC controllers for stochastic systems has mainly focused on linear systems in the iterative learning control setting. We present a novel LMPC algorithm, Adjustable Boundary Condition LMPC (ABC-LMPC), which enables rapid adaptation to novel start and goal configurations and theoretically show that the resulting controller guarantees iterative improvement in expectation for stochastic nonlinear systems. We present results with a practical instantiation of this algorithm and experimentally demonstrate that the resulting controller adapts to a variety of initial and terminal conditions on 3 stochastic continuous control tasks.
Additional Information
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2021. First Online: 09 February 2021. This research was performed at the AUTOLAB at UC Berkeley in affiliation with the Berkeley AI Research (BAIR) Lab. Authors were also supported by the Scalable Collaborative Human-Robot Learning (SCHooL) Project, a NSF National Robotics Initiative Award 1734633, and in part by donations from Google and Toyota Research Institute. Ashwin Balakrishna is supported by an NSF GRFP. This article solely reflects the opinions and conclusions of its authors and does not reflect the views of the sponsors. We thank our colleagues who provided helpful feedback and suggestions, especially Michael Danielczuk, Daniel Brown and Suraj Nair.Attached Files
Submitted - 2003.01410.pdf
Supplemental Material - 501328_1_En_1_MOESM1_ESM.pdf
Files
Name | Size | Download all |
---|---|---|
md5:8f8cac4ba01181f7a0f27775e43b325d
|
186.5 kB | Preview Download |
md5:ab2e12300d83e2b3a64344dffbdbf6a8
|
1.3 MB | Preview Download |
Additional details
- Eprint ID
- 108278
- Resolver ID
- CaltechAUTHORS:20210302-153300449
- NSF
- IIS-1734633
- Toyota Research Institute
- NSF Graduate Research Fellowship
- Created
-
2021-03-03Created from EPrint's datestamp field
- Updated
-
2021-11-16Created from EPrint's last_modified field
- Series Name
- Springer Proceedings in Advanced Robotics
- Series Volume or Issue Number
- 17