First-Order Systems and the Matrix Exponential
mathdifferential-equationssystemslecture
1Introduction
For a constant matrix A\in\mathbb K^{n\times n}, where \mathbb K=\mathbb R or \mathbb C, this lecture constructs the unique solution of
\boldsymbol{x}'=A\boldsymbol{x},\qquad \boldsymbol{x}(t_0)=\boldsymbol{x}_0
as \boldsymbol{x}(t)=e^{A(t-t_0)}\boldsymbol{x}_0.
2Convergence and Termwise Differentiation
Define
e^{At}=\sum_{k=0}^{\infty}\frac{A^kt^k}{k!}.
For any submultiplicative matrix norm,
\left\|\frac{A^kt^k}{k!}\right\|\le\frac{(\|A\||t|)^k}{k!}.
The scalar majorant converges and is uniform on bounded time intervals. The differentiated series has the same type of majorant; termwise differentiation is therefore valid and gives
\frac{d}{dt}e^{At}=Ae^{At}=e^{At}A.
For the maximum row-sum norm,
\|B\|_\infty=\max_i\sum_j|b_{ij}|,
we have
\sum_j|(BC)_{ij}|
\le\sum_k|b_{ik}|\sum_j|c_{kj}|
\le\|C\|_\infty\sum_k|b_{ik}|
\le\|B\|_\infty\|C\|_\infty.
Thus this norm is submultiplicative and supplies the preceding majorant.
3Invertibility, Uniqueness, and the Composition (Group) Law
Since e^{A0}=I and
\frac d{dt}(e^{-At}e^{At})
=-Ae^{-At}e^{At}+e^{-At}Ae^{At}=0,
the product equals I for every t. Reversing the factors gives the other inverse identity, so
(e^{At})^{-1}=e^{-At}.
The proposed solution satisfies the equation and initial condition. If \boldsymbol y is any other solution, then
\frac d{dt}\left(e^{-A(t-t_0)}\boldsymbol y(t)\right)=\boldsymbol0,
which proves uniqueness. Applying uniqueness to two matrix solutions yields
e^{A(t+s)}=e^{At}e^{As}.
4Computation and Real Matrices
If A=PDP^{-1}, then
e^{At}=Pe^{Dt}P^{-1}.
For a real matrix diagonalizable only over \mathbb C, conjugate complex solutions combine through their real and imaginary parts to form real solutions. A nonorthogonal eigenbasis still gives the exact evolution, although eigenvalues alone need not describe transient Euclidean norm growth.
For
A=\begin{pmatrix}0&-\omega\\\omega&0\end{pmatrix},
the identity A^2=-\omega^2I gives
e^{At}=\begin{pmatrix}\cos\omega t&-\sin\omega t\\\sin\omega t&\cos\omega t\end{pmatrix}.
Because A^{\mathsf T}=-A, this evolution preserves the Euclidean norm.
It rotates counterclockwise for \omega>0 and clockwise for \omega<0, with angular speed |\omega|. This norm preservation follows from skew-symmetry; purely imaginary eigenvalues alone do not imply norm preservation for an arbitrary matrix.
5Reduction of Higher-Order Equations
Introducing \boldsymbol{x}=(y,y',\ldots,y^{(m-1)})^{\mathsf T} converts
y^{(m)}+a_{m-1}y^{(m-1)}+\cdots+a_1y'+a_0y=f(t)
into a first-order companion system. Its initial vector contains the values of y and its first m-1 derivatives. Constant coefficients produce a constant matrix; variable coefficients produce a time-dependent matrix.
Explicitly,
\boldsymbol{x}'=
\begin{pmatrix}
0&1&0&\cdots&0\\
0&0&1&\cdots&0\\
\vdots&\vdots&\vdots&\ddots&\vdots\\
0&0&0&\cdots&1\\
-a_0&-a_1&-a_2&\cdots&-a_{m-1}
\end{pmatrix}\boldsymbol{x}
+\begin{pmatrix}0\\0\\\vdots\\0\\f(t)\end{pmatrix}.
6Variation of Constants
For continuous \boldsymbol b,
\boldsymbol{x}'=A\boldsymbol{x}+\boldsymbol b(t),\qquad
\boldsymbol{x}(t_0)=\boldsymbol{x}_0
has the solution
\boldsymbol{x}(t)=e^{A(t-t_0)}\boldsymbol{x}_0+
\int_{t_0}^{t}e^{A(t-s)}\boldsymbol b(s)\,ds.
Differentiation verifies both the equation and initial condition.
Indeed, writing \boldsymbol{x}=e^{A(t-t_0)}\boldsymbol u(t) gives
\boldsymbol u'(t)=e^{-A(t-t_0)}\boldsymbol b(t),
and integration from t_0 to t yields the formula. The difference of two solutions satisfies the homogeneous system, so uniqueness follows from the homogeneous result.
7Boundary for Time-Dependent Matrices
For continuous A(t), the corresponding initial-value problem has a unique solution. However, the expression
\exp\left(\int_{t_0}^{t}A(s)\,ds\right)
is valid as the evolution operator when A(t)A(s)=A(s)A(t) for every pair of times. Without this commutativity, chronological order matters and a time-ordered construction is required. The formula e^{A(t-t_0)} in this lecture is restricted to constant A.
8Previous Lecture
data/lecture/math/differential-equations/euler-cauchy-and-higher-order-equations.lecture.n.md
9Next Lecture
data/lecture/math/differential-equations/diagonalization-jordan-form-and-systems.lecture.n.md
10Exercises
data/exercise/math/differential-equations/linear-systems-and-matrix-exponentials.exercise.n.md
11Previously Studied Method
data/lecture/math/differential-equations/variation-of-parameters-and-wronskian.lecture.n.md