State observer

In control theory, a state observer or state estimator is a system that provides an estimate of the internal state of a given real system, from measurements of the input and output of the real system. It is typically computer-implemented, and provides the basis of many practical applications.

Knowing the system state is necessary to solve many control theory problems; for example, stabilizing a system using state feedback. In most practical cases, the physical state of the system cannot be determined by direct observation. Instead, indirect effects of the internal state are observed by way of the system outputs. A simple example is that of vehicles in a tunnel: the rates and velocities at which vehicles enter and leave the tunnel can be observed directly, but the exact state inside the tunnel can only be estimated. If a system is observable, it is possible to fully reconstruct the system state from its output measurements using the state observer.

Typical observer model

Block diagram of Luenberger Observer. Input of observer gain L is $y\mathbf {-} {\hat {y}}$.

Linear, delayed, sliding mode, high gain, Tau, homogeneity-based, extended and cubic observers are among several observer structures used for state estimation of linear and nonlinear systems. A linear observer structure is described in the following sections.

Discrete-time case

The state of a linear, time-invariant discrete-time system is assumed to satisfy

$x(k+1)=Ax(k)+Bu(k)$

$y(k)=Cx(k)+Du(k)$

where, at time $k$, $x(k)$ is the plant's state; $u(k)$ is its inputs; and $y(k)$ is its outputs. These equations simply say that the plant's current outputs and its future state are both determined solely by its current states and the current inputs. (Although these equations are expressed in terms of discrete time steps, very similar equations hold for continuous systems). If this system is observable then the output of the plant, $y(k)$, can be used to steer the state of the state observer.

The observer model of the physical system is then typically derived from the above equations. Additional terms may be included in order to ensure that, on receiving successive measured values of the plant's inputs and outputs, the model's state converges to that of the plant. In particular, the output of the observer may be subtracted from the output of the plant and then multiplied by a matrix $L$; this is then added to the equations for the state of the observer to produce a so-called Luenberger observer, defined by the equations below. Note that the variables of a state observer are commonly denoted by a "hat": ${\hat {x}}(k)$ and ${\hat {y}}(k)$ to distinguish them from the variables of the equations satisfied by the physical system.

${\hat {x}}(k+1)=A{\hat {x}}(k)+L\left[y(k)-{\hat {y}}(k)\right]+Bu(k)$

${\hat {y}}(k)=C{\hat {x}}(k)+Du(k)$

The observer is called asymptotically stable if the observer error $e(k)={\hat {x}}(k)-x(k)$ converges to zero when $k\to \infty$. For a Luenberger observer, the observer error satisfies $e(k+1)=(A-LC)e(k)$. The Luenberger observer for this discrete-time system is therefore asymptotically stable when the matrix $A-LC$ has all the eigenvalues inside the unit circle.

For control purposes the output of the observer system is fed back to the input of both the observer and the plant through the gains matrix $K$.

$u(k)=-K{\hat {x}}(k)$

The observer equations then become:

${\hat {x}}(k+1)=A{\hat {x}}(k)+L\left(y(k)-{\hat {y}}(k)\right)-BK{\hat {x}}(k)$

${\hat {y}}(k)=C{\hat {x}}(k)-DK{\hat {x}}(k)$

or, more simply,

${\hat {x}}(k+1)=\left(A-BK\right){\hat {x}}(k)+L\left(y(k)-{\hat {y}}(k)\right)$

${\hat {y}}(k)=\left(C-DK\right){\hat {x}}(k)$

Due to the separation principle we know that we can choose $K$ and $L$ independently without harm to the overall stability of the systems. As a rule of thumb, the poles of the observer $A-LC$ are usually chosen to converge 10 times faster than the poles of the system $A-BK$.

Continuous-time case

The previous example was for an observer implemented in a discrete-time LTI system. However, the process is similar for the continuous-time case; the observer gains $L$ are chosen to make the continuous-time error dynamics converge to zero asymptotically (i.e., when $A-LC$ is a Hurwitz matrix).

For a continuous-time linear system

${\dot {x}}=Ax+Bu,$

$y=Cx+Du,$

where $x\in \mathbb {R} ^{n},u\in \mathbb {R} ^{m},y\in \mathbb {R} ^{r}$, the observer looks similar to discrete-time case described above:

${\dot {\hat {x}}}=A{\hat {x}}+Bu+L\left(y-{\hat {y}}\right)$.

${\hat {y}}=C{\hat {x}}+Du,$

The observer error $e=x-{\hat {x}}$ satisfies the equation

${\dot {e}}=(A-LC)e$.

The eigenvalues of the matrix $A-LC$ can be chosen arbitrarily by appropriate choice of the observer gain $L$ when the pair $[A,C]$ is observable, i.e. observability condition holds. In particular, it can be made Hurwitz, so the observer error $e(t)\to 0$ when $t\to \infty$.

Peaking and other observer methods

When the observer gain $L$ is high, the linear Luenberger observer converges to the system states very quickly. However, high observer gain leads to a peaking phenomenon in which initial estimator error can be prohibitively large (i.e., impractical or unsafe to use). As a consequence, nonlinear high-gain observer methods are available that converge quickly without the peaking phenomenon. For example, sliding mode control can be used to design an observer that brings one estimated state's error to zero in finite time even in the presence of measurement error; the other states have error that behaves similarly to the error in a Luenberger observer after peaking has subsided. Sliding mode observers also have attractive noise resilience properties that are similar to a Kalman filter. Another approach is to apply multi observer, that significantly improves transients and reduces observer overshoot. Multi-observer can be adapted to every system where high-gain observer is applicable.

State observers for nonlinear systems

High gain, sliding mode and extended observers are the most common observers for nonlinear systems. To illustrate the application of sliding mode observers for nonlinear systems, first consider the no-input non-linear system:

${\dot {x}}=f(x)$

where $x\in \mathbb {R} ^{n}$. Also assume that there is a measurable output $y\in \mathbb {R}$ given by

$y=h(x).$

There are several non-approximate approaches for designing an observer. The two observers given below also apply to the case when the system has an input. That is,

${\dot {x}}=f(x)+B(x)u$

$y=h(x).$

Linearizable error dynamics

One suggestion by Krener and Isidori and Krener and Respondek can be applied in a situation when there exists a linearizing transformation (i.e., a diffeomorphism, like the one used in feedback linearization) $z=\Phi (x)$ such that in new variables the system equations read

${\dot {z}}=Az+\phi (y),$

$y=Cz.$

The Luenberger observer is then designed as

${\dot {\hat {z}}}=A{\hat {z}}+\phi (y)-L\left(C{\hat {z}}-y\right)$.

The observer error for the transformed variable $e={\hat {z}}-z$ satisfies the same equation as in classical linear case.

${\dot {e}}=(A-LC)e$.

As shown by Gauthier, Hammouri, and Othman and Hammouri and Kinnaert, if there exists transformation $z=\Phi (x)$ such that the system can be transformed into the form

${\dot {z}}=A(u(t))z+\phi (y,u(t)),$

$y=Cz,$

then the observer is designed as

${\dot {\hat {z}}}=A(u(t)){\hat {z}}+\phi (y,u(t))-L(t)\left(C{\hat {z}}-y\right)$,

where $L(t)$ is a time-varying observer gain.

Ciccarella, Dalla Mora, and Germani obtained more advanced and general results, removing the need for a nonlinear transform and proving global asymptotic convergence of the estimated state to the true state using only simple assumptions on regularity.

Switched observers

As discussed for the linear case above, the peaking phenomenon present in Luenberger observers justifies the use of switched observers. A switched observer encompasses a relay or binary switch that acts upon detecting minute changes in the measured output. Some common types of switched observers include the sliding mode observer, nonlinear extended state observer, fixed time observer, switched high gain observer and uniting observer. The sliding mode observer uses non-linear high-gain feedback to drive estimated states to a hypersurface where there is no difference between the estimated output and the measured output. The non-linear gain used in the observer is typically implemented with a scaled switching function, like the signum (i.e., sgn) of the estimated – measured output error. Hence, due to this high-gain feedback, the vector field of the observer has a crease in it so that observer trajectories slide along a curve where the estimated output matches the measured output exactly. So, if the system is observable from its output, the observer states will all be driven to the actual system states. Additionally, by using the sign of the error to drive the sliding mode observer, the observer trajectories become insensitive to many forms of noise. Hence, some sliding mode observers have attractive properties similar to the Kalman filter but with simpler implementation.

As suggested by Drakunov, a sliding mode observer can also be designed for a class of non-linear systems. Such an observer can be written in terms of original variable estimate ${\hat {x}}$ and has the form

${\dot {\hat {x}}}=\left[{\frac {\partial H({\hat {x}})}{\partial x}}\right]^{-1}M({\hat {x}})\operatorname {sgn}(V(t)-H({\hat {x}}))$

where:

• The $\operatorname {sgn}({\mathord {\cdot }})$ vector extends the scalar signum function to $n$ dimensions. That is,

  $\operatorname {sgn}(z)={\begin{bmatrix}\operatorname {sgn}(z_{1})\\\operatorname {sgn}(z_{2})\\\vdots \\\operatorname {sgn}(z_{i})\\\vdots \\\operatorname {sgn}(z_{n})\end{bmatrix}}$

  for the vector $z\in \mathbb {R} ^{n}$.

• The vector $H(x)$ has components that are the output function $h(x)$ and its repeated Lie derivatives. In particular,

  $H(x)\triangleq {\begin{bmatrix}h_{1}(x)\\h_{2}(x)\\h_{3}(x)\\\vdots \\h_{n}(x)\end{bmatrix}}\triangleq {\begin{bmatrix}h(x)\\L_{f}h(x)\\L_{f}^{2}h(x)\\\vdots \\L_{f}^{n-1}h(x)\end{bmatrix}}$

  where $L_{f}^{i}h$ is the i^th Lie derivative of output function $h$ along the vector field $f$ (i.e., along $x$ trajectories of the non-linear system). In the special case where the system has no input or has a relative degree of n, $H(x(t))$ is a collection of the output $y(t)=h(x(t))$ and its $n-1$ derivatives. Because the inverse of the Jacobian linearization of $H(x)$ must exist for this observer to be well defined, the transformation $H(x)$ is guaranteed to be a local diffeomorphism.

• The diagonal matrix $M({\hat {x}})$ of gains is such that

  $M({\hat {x}})\triangleq \operatorname {diag} (m_{1}({\hat {x}}),m_{2}({\hat {x}}),\ldots ,m_{n}({\hat {x}}))={\begin{bmatrix}m_{1}({\hat {x}})&&&&&\\&m_{2}({\hat {x}})&&&&\\&&\ddots &&&\\&&&m_{i}({\hat {x}})&&\\&&&&\ddots &\\&&&&&m_{n}({\hat {x}})\end{bmatrix}}$

  where, for each $i\in \{1,2,\dots ,n\}$, element $m_{i}({\hat {x}})>0$ and suitably large to ensure reachability of the sliding mode.

• The observer vector $V(t)$ is such that

  $V(t)\triangleq {\begin{bmatrix}v_{1}(t)\\v_{2}(t)\\v_{3}(t)\\\vdots \\v_{i}(t)\\\vdots \\v_{n}(t)\end{bmatrix}}\triangleq {\begin{bmatrix}y(t)\\\{m_{1}({\hat {x}})\operatorname {sgn}(v_{1}(t)-h_{1}({\hat {x}}(t)))\}_{\text{eq}}\\\{m_{2}({\hat {x}})\operatorname {sgn}(v_{2}(t)-h_{2}({\hat {x}}(t)))\}_{\text{eq}}\\\vdots \\\{m_{i-1}({\hat {x}})\operatorname {sgn}(v_{i-1}(t)-h_{i-1}({\hat {x}}(t)))\}_{\text{eq}}\\\vdots \\\{m_{n-1}({\hat {x}})\operatorname {sgn}(v_{n-1}(t)-h_{n-1}({\hat {x}}(t)))\}_{\text{eq}}\end{bmatrix}}$

  where $\operatorname {sgn}({\mathord {\cdot }})$ here is the normal signum function defined for scalars, and $\{\ldots \}_{\text{eq}}$ denotes an "equivalent value operator" of a discontinuous function in sliding mode.

The idea can be briefly explained as follows. According to the theory of sliding modes, in order to describe the system behavior, once sliding mode starts, the function $\operatorname {sgn}(v_{i}(t)\!-\!h_{i}({\hat {x}}(t)))$ should be replaced by equivalent values (see equivalent control in the theory of sliding modes). In practice, it switches (chatters) with high frequency with slow component being equal to the equivalent value. Applying appropriate lowpass filter to get rid of the high frequency component on can obtain the value of the equivalent control, which contains more information about the state of the estimated system. The observer described above uses this method several times to obtain the state of the nonlinear system ideally in finite time.

The modified observation error can be written in the transformed states $e=H(x)-H({\hat {x}})$. In particular,

${\begin{aligned}{\dot {e}}&={\frac {\mathrm {d} }{\mathrm {d} t}}H(x)-{\frac {\mathrm {d} }{\mathrm {d} t}}H({\hat {x}})\\&={\frac {\mathrm {d} }{\mathrm {d} t}}H(x)-M({\hat {x}})\,\operatorname {sgn}(V(t)-H({\hat {x}}(t))),\end{aligned}}$

and so

${\begin{aligned}{\begin{bmatrix}{\dot {e}}_{1}\\{\dot {e}}_{2}\\\vdots \\{\dot {e}}_{i}\\\vdots \\{\dot {e}}_{n-1}\\{\dot {e}}_{n}\end{bmatrix}}&={\mathord {\overbrace {\begin{bmatrix}{\dot {h}}_{1}(x)\\{\dot {h}}_{2}(x)\\\vdots \\{\dot {h}}_{i}(x)\\\vdots \\{\dot {h}}_{n-1}(x)\\{\dot {h}}_{n}(x)\end{bmatrix}} ^{{\tfrac {\mathrm {d} }{\mathrm {d} t}}H(x)}}}-{\mathord {\overbrace {M({\hat {x}})\,\operatorname {sgn}(V(t)-H({\hat {x}}(t)))} ^{{\tfrac {\mathrm {d} }{\mathrm {d} t}}H({\hat {x}})}}}={\begin{bmatrix}h_{2}(x)\\h_{3}(x)\\\vdots \\h_{i+1}(x)\\\vdots \\h_{n}(x)\\L_{f}^{n}h(x)\end{bmatrix}}-{\begin{bmatrix}m_{1}\operatorname {sgn}(v_{1}(t)-h_{1}({\hat {x}}(t)))\\m_{2}\operatorname {sgn}(v_{2}(t)-h_{2}({\hat {x}}(t)))\\\vdots \\m_{i}\operatorname {sgn}(v_{i}(t)-h_{i}({\hat {x}}(t)))\\\vdots \\m_{n-1}\operatorname {sgn}(v_{n-1}(t)-h_{n-1}({\hat {x}}(t)))\\m_{n}\operatorname {sgn}(v_{n}(t)-h_{n}({\hat {x}}(t)))\end{bmatrix}}\\&={\begin{bmatrix}h_{2}(x)-m_{1}({\hat {x}})\operatorname {sgn}({\mathord {\overbrace {{\mathord {\overbrace {v_{1}(t)} ^{v_{1}(t)=y(t)=h_{1}(x)}}}-h_{1}({\hat {x}}(t))} ^{e_{1}}}})\\h_{3}(x)-m_{2}({\hat {x}})\operatorname {sgn}(v_{2}(t)-h_{2}({\hat {x}}(t)))\\\vdots \\h_{i+1}(x)-m_{i}({\hat {x}})\operatorname {sgn}(v_{i}(t)-h_{i}({\hat {x}}(t)))\\\vdots \\h_{n}(x)-m_{n-1}({\hat {x}})\operatorname {sgn}(v_{n-1}(t)-h_{n-1}({\hat {x}}(t)))\\L_{f}^{n}h(x)-m_{n}({\hat {x}})\operatorname {sgn}(v_{n}(t)-h_{n}({\hat {x}}(t)))\end{bmatrix}}.\end{aligned}}$

So:

1. As long as $m_{1}({\hat {x}})\geq |h_{2}(x(t))|$, the first row of the error dynamics, ${\dot {e}}_{1}=h_{2}({\hat {x}})-m_{1}({\hat {x}})\operatorname {sgn}(e_{1})$, will meet sufficient conditions to enter the $e_{1}=0$ sliding mode in finite time.
2. Along the $e_{1}=0$ surface, the corresponding $v_{2}(t)=\{m_{1}({\hat {x}})\operatorname {sgn}(e_{1})\}_{\text{eq}}$ equivalent control will be equal to $h_{2}(x)$, and so $v_{2}(t)-h_{2}({\hat {x}})=h_{2}(x)-h_{2}({\hat {x}})=e_{2}$. Hence, so long as $m_{2}({\hat {x}})\geq |h_{3}(x(t))|$, the second row of the error dynamics, ${\dot {e}}_{2}=h_{3}({\hat {x}})-m_{2}({\hat {x}})\operatorname {sgn}(e_{2})$, will enter the $e_{2}=0$ sliding mode in finite time.
3. Along the $e_{i}=0$ surface, the corresponding $v_{i+1}(t)=\{\ldots \}_{\text{eq}}$ equivalent control will be equal to $h_{i+1}(x)$. Hence, so long as $m_{i+1}({\hat {x}})\geq |h_{i+2}(x(t))|$, the $(i+1)$^th row of the error dynamics, ${\dot {e}}_{i+1}=h_{i+2}({\hat {x}})-m_{i+1}({\hat {x}})\operatorname {sgn}(e_{i+1})$, will enter the $e_{i+1}=0$ sliding mode in finite time.

So, for sufficiently large $m_{i}$ gains, all observer estimated states reach the actual states in finite time. In fact, increasing $m_{i}$ allows for convergence in any desired finite time so long as each $|h_{i}(x(0))|$ function can be bounded with certainty. Hence, the requirement that the map $H:\mathbb {R} ^{n}\to \mathbb {R} ^{n}$ is a diffeomorphism (i.e., that its Jacobian linearization is invertible) asserts that convergence of the estimated output implies convergence of the estimated state. That is, the requirement is an observability condition.

In the case of the sliding mode observer for the system with the input, additional conditions are needed for the observation error to be independent of the input. For example, that

${\frac {\partial H(x)}{\partial x}}B(x)$

does not depend on time. The observer is then

${\dot {\hat {x}}}=\left[{\frac {\partial H({\hat {x}})}{\partial x}}\right]^{-1}M({\hat {x}})\operatorname {sgn}(V(t)-H({\hat {x}}))+B({\hat {x}})u.$

Multi-observer

Multi-observer extends the high-gain observer structure from single to multi observer, with many models working simultaneously. This has two layers: the first consists of multiple high-gain observers with different estimation states, and the second determines the importance weights of the first layer observers. The algorithm is simple to implement and does not contain any risky operations like differentiation. The idea of multiple models was previously applied to obtain information in adaptive control.

• 
  Multi-observer schema

Assuming that the number of high-gain observers equals $n+1$,

${\dot {\hat {x}}}_{k}(t)=A{\hat {x_{k}}}(t)+B\phi _{0}({\hat {x}}(t),u(t))-L({\hat {y_{k}}}(t)-y(t))$

${\hat {y_{k}}}(t)=C{\hat {x_{k}}}(t)$

where $k=1,\dots ,n+1$ is the observer index. The first layer observers consists of the same gain $L$ but they differ with the initial state $x_{k}(0)$. In the second layer all $x_{k}(t)$ from $k=1...n+1$ observers are combined into one to obtain single state vector estimation

${\hat {y_{k}}}(t)=\sum \limits _{k=1}^{n+1}\alpha _{k}(t){\hat {x_{k}}}(t)$

where $\alpha _{k}\in \mathbb {R}$ are weight factors. These factors are changed to provide the estimation in the second layer and to improve the observation process.

Let assume that

$\sum \limits _{k=1}^{n+1}\alpha _{k}(t)\xi _{k}(t)=0$

and

$\sum \limits _{k=1}^{n+1}\alpha _{k}(t)=1$

where $\xi _{k}\in \mathbb {R} ^{n\times 1}$ is some vector that depends on $kth$ observer error $e_{k}(t)$.

Some transformation yields to linear regression problem

$[-\xi _{n+1}(t)]=[\xi _{1}(t)-\xi _{n+1}(t)\dots \xi _{k}(t)-\xi _{n+1}(t)\dots \xi _{n}(t)-\xi _{n+1}(t)]^{T}{\begin{bmatrix}\alpha _{1}(t)\\\vdots \\\alpha _{k}(t)\\\vdots \\\alpha _{n}(t)\end{bmatrix}}$

This formula gives possibility to estimate $\alpha _{k}(t)$. To construct manifold we need mapping $m:\mathbb {R} ^{n}\to \mathbb {R} ^{n}$ between $\xi _{k}(t)=m(e_{k}(t))$ and ensurance that $\xi _{k}(t)$ is calculable relying on measurable signals. First thing is to eliminate parking phenomenon for $\alpha _{k}(t)$ from observer error

$e_{\sigma }(t)=\sum \limits _{k=1}^{n+1}\alpha _{k}(t)e_{k}(t)$.

Calculate $n$ times derivative on $\eta _{k}(t)={\hat {y}}_{k}(t)-y(t)$ to find mapping m lead to $\xi _{k}(t)$ defined as

$\xi _{k}(t)={\begin{bmatrix}1&0&0&\cdots &0\\CL&1&0&\cdots &0\\CAL&CL&1&\cdots &0\\CA^{2}L&CAL&CL&\cdots &0\\\vdots &\vdots &\vdots &\ddots \\CA^{n-2}L&CA^{n-3}L&CA^{n-4}L&\cdots &1\end{bmatrix}}{\begin{bmatrix}\int \limits _{t-t_{d}}^{t}{{n-1} \atop \cdots }\int \limits _{t-t_{d}}^{t}\eta _{k}(\tau )d\tau \\\vdots \\\eta (t)-\eta (t-(n-1)t_{d})\end{bmatrix}}$

where $t_{d}>0$ is some time constant. Note that $\xi _{k}(t)$ relays on both $\eta _{k}(t)$ and its integrals hence it is easily available in the control system. Further $\alpha _{k}(t)$ is specified by estimation law; and thus it proves that manifold is measurable. In the second layer ${\hat {\alpha }}_{k}(t)$ for $k=1\dots n+1$ is introduced as estimates of $\alpha _{k}(t)$ coefficients. The mapping error is specified as

$e_{\xi }(t)=\sum \limits _{k=1}^{n+1}{\hat {\alpha }}_{k}(t)\xi _{k}(t)$

where $e_{\xi }(t)\in \mathbb {R} ^{n\times 1},{\hat {\alpha }}_{k}(t)\in \mathbb {R}$. If coefficients ${\hat {\alpha }}(t)$ are equal to $\alpha _{k}(t)$ , then mapping error $e_{\xi }(t)=0$ Now it is possible to calculate ${\hat {x}}$ from above equation and hence the peaking phenomenon is reduced thanks to properties of manifold. The created mapping gives a lot of flexibility in the estimation process. Even it is possible to estimate the value of $x(t)$ in the second layer and to calculate the state $x$.

Bounding observers

Bounding or interval observers constitute a class of observers that provide two estimations of the state simultaneously: one of the estimations provides an upper bound on the real value of the state, whereas the second one provides a lower bound. The real value of the state is then known to be always within these two estimations.

These bounds are very important in practical applications, as they make possible to know at each time the precision of the estimation.

Mathematically, two Luenberger observers can be used, if $L$ is properly selected, using, for example, positive systems properties: one for the upper bound ${\hat {x}}_{U}(k)$ (that ensures that $e(k)={\hat {x}}_{U}(k)-x(k)$ converges to zero from above when $k\to \infty$, in the absence of noise and uncertainty), and a lower bound ${\hat {x}}_{L}(k)$ (that ensures that $e(k)={\hat {x}}_{L}(k)-x(k)$ converges to zero from below). That is, always ${\hat {x}}_{U}(k)\geq x(k)\geq {\hat {x}}_{L}(k)$

See also

• Moving horizon estimation
• Kalman filter
• Extended Kalman filter
• Positive systems

References

In-line references

General references

• Sontag, Eduardo (1998), Mathematical Control Theory: Deterministic Finite Dimensional Systems. Second Edition, Springer, ISBN 978-0-387-98489-6

External links

• Kalman Filter Explained Simply, Step-by-Step Tutorial of the Kalman Filter with Equations