Overview

When we want to control a dynamical system, the natural question that arises is to what extent can we achive this? The term controllability is used to describe whether a systme is controllable altogether. We will see that whether a system is controllable or not is determined completely by the controllability matrix [1]

Controllability

Recall that we deal with linear systems of the form

$$\frac{d\mathbf{x}}{dt} = \mathbf{A}\mathbf{x} + \mathbf{B}\mathbf{u}, ~~ \mathbf{y} = \mathbf{C}\mathbf{x} + \mathbf{D}\mathbf{u}$$

We can understand whether the linear system above is controllable or not by examing the controllability matrix $\mathbf{\cal{C}}$. In particular, the column space of that matrix. This matrix is defined as follows

$$\mathbf{\cal{C}} = \begin{bmatrix}\mathbf{B} && \mathbf{AB} && \mathbf{A}^2\mathbf{B} && \dots && \mathbf{A}^{n-1}\mathbf{B} \end{bmatrix}$$

Where $n$ is the number of state variables. If the controllability matrix has $n$ linearly independent columns, then the system under consideration is controllable [1]. Note that this does not mean that the columns of $\mathbf{\cal{C}}$ should be linearly independent. All that we require, is that we can find $n$ linearly independent columns (see example 2 below). Let's see two examples taken from [1].

Example 1

Let's consider the following system

$$\frac{d}{dt}\begin{bmatrix}x_1 \\ x_2 \end{bmatrix} = \begin{bmatrix}1 && 0 \\ 0 && 2 \end{bmatrix}\begin{bmatrix}x_1 \\ x_2 \end{bmatrix} + \begin{bmatrix}0 \\ 1 \end{bmatrix} u$$

Immediatelly, we can see that the system is not controllable. This is because the two state variables are decoupled and the control input affects only $x_2$. The controllability matrix is

$$\mathbf{\cal{C}} = \begin{bmatrix}0 && 0 \\ 1 && 2 \end{bmatrix} $$

and we can see that the columns of that matrix are not independent.

Example 2

If we include a control signal for the both state variables, we can turn this system into a controllable one. The new system now is

$$\frac{d}{dt}\begin{bmatrix}x_1 \\ x_2 \end{bmatrix} = \begin{bmatrix}1 && 0 \\ 0 && 2 \end{bmatrix}\begin{bmatrix}x_1 \\ x_2 \end{bmatrix} + \begin{bmatrix}1 && 0\\0 && 1 \end{bmatrix}\begin{bmatrix} u_1 \\ u_2 \end{bmatrix} u$$

By including a control signal for bith state variables, we can control them independently. The controllability matrix now becomes [1]

$$\mathbf{\cal{C}} = \begin{bmatrix}1 && 0 && 1 && 0 \\ 0 && 1 && 0 && 2 \end{bmatrix} $$

and we can verify that the columns of this matrix do span $\mathbb{R}^2$. Note that the columns of the matrix above are not linearly independent. Indeed the third column is a copy of the first and the fourth is a product of the second. However, the first two columns do span $\mathbb{R}^2$.

Three equivalent conditions

The span of the columns of matrix $\mathbf{\cal{C}}$ form a Krylov subspace [1]. The space determines which state vectors can be controlled. Hence, controllability implies two things [1]

  • Eigenvalue placement
  • Any state vector $\boldsymbol{\xi} \in \mathbb{R}^n$ is reachable with some actuation signal

The following three conditions are equivalent [1]

  • Controllability
  • Arbitrary eigenvalue placement
  • Reachability of $\mathbb{R}^n$

We already saw what controllability means in terms of the controllability matrix. Arbitrary eigenvalue placement means that we can design the eigenvalues of the system through the choice of the feedback signal $\mathbf{u}$. In particular, for $\mathbf{u} = -\mathbf{K}\mathbf{x}$, the system becomes

$$\frac{d\mathbf{x}}{dt} = (\mathbf{A} - \mathbf{B}\mathbf{K})\mathbf{x}$$

The matrix $\mathbf{K}$ is called the gain matrix. There are various methods to design this matrix. Finally, reachability in practical terms means that we can steer the system to any arbitrary state with some actuation signal, or, conversely, there exists an actuation signal so that the system can be pushed to an arbitrary state $\boldsymbol{\xi} \in \mathbb{R}^n$ [1].

References

  1. Steven L. Brunton, J. Nathan Kutz, Data-Driven Science and Engineering. Machine Learning, Dynamical System and Control, Cambridge University Press.