Model predictive control for systems described by stochastic differential equations

Morten Hagdrup: In daily life we are surrounded by an increasing number of devices that each involve some element of automatic control. Drones and self-driving cars are just the most recent examples.

In case a model is available for the dynamics of the system to be controlled, an optimization-based predictive control technique may well be an attractive option. However, the faster the systems dynamics, the more stringent requirements it puts on the execution of the optimization. This thesis offers an efficient implementation of an optimization problem occurring in the context of linear stochastic systems subject to constraints. Modelling of the linear system is done in continuous time and comprises both a deterministic and stochastic model part. To obtain a parsimonious parametrization, transfer functions are used. Also the cost function of the control problem is formulated in continuous time. This thesis analyzes the behaviour of the corresponding discretized control problems for increasingly fast sampling rate. Convergence theorems are proved for the case of uniform sampling with sampling time tending to zero.

Often a single deterministic model is not sufficient to capture the behavior of a system. The description may then be augmented with a stochastic part quantifying the degree of confidence in the deterministic model part. The presentation bridges the gap between deterministic and stochastic descriptions for sufficiently regular linear time-variant systems on state space form. It is shown how a description in terms of stochastic differential equations (SDE) results if one requires the state equations to hold in the sense of distributions. In particular it becomes clear why the stochastic integral appearing in the SDE must be defined the way it is.

PhD project by Morten Hagdrup

Section: Scientific Computing, Dynamical Systems

Principal supervisor: John B. Jørgensen
Co-supervisors: Henrik Madsen, Niels K. Poulsen

Title of project: Model Predictive Control based on Stochastic Differential Equations - An Artificial Pancreas with Fast Insulin, Glucagon and Multiple Sensors

Effective start/end date 01/09/2014 → 31/08/2018

Report published: Model predictive control for systems described by stochastic differential equations

Contact

John Bagterp Jørgensen
Professor
DTU Compute
+45 45 25 30 88

Contact

Henrik Madsen
Professor, Head of section
DTU Compute
+45 45 25 34 08