ODE: Matrix Methods for Linear Systems

Mastering matrix methods for linear systems of ordinary differential equations (ODEs) is a cornerstone of engineering analysis. These techniques transform coupled differential equations into elegant linear algebra problems, providing the tools to model everything from vibrating mechanical structures and electrical circuits to control systems and population dynamics. By leveraging eigenvalues and eigenvectors, you can systematically predict system behavior—whether it settles into equilibrium, oscillates, or grows uncontrollably.

1. Foundation: Eigenvalues, Eigenvectors, and the General Solution

A system of linear, homogeneous, constant-coefficient ODEs can be written in compact matrix form:

$${\mathbf{x}}^{\prime }=A\mathbf{x}$$

where $\mathbf{x}$ is a vector of unknown functions (e.g., $\mathbf{x}=[x_1(t),x_2(t){]}^T$) and $A$ is an $n\times n$ matrix of constants. The core idea is to find solutions that scale with themselves upon differentiation. This leads us directly to the concepts of eigenvalues and eigenvectors. An eigenvector $\vec{v}$ of matrix $A$ is a non-zero vector that satisfies $A\vec{v}=\lambda \vec{v}$, where the scalar $\lambda$ is the corresponding eigenvalue.

Why is this useful? If we assume a solution of the form $\mathbf{x}=e^{\lambda t}\vec{v}$, then by substitution: ${\mathbf{x}}^{\prime }=\lambda e^{\lambda t}\vec{v}$ and $A\mathbf{x}=A{e}^{\lambda t}\vec{v}=e^{\lambda t}A\vec{v}=e^{\lambda t}\lambda \vec{v}$. The equation ${\mathbf{x}}^{\prime }=A\mathbf{x}$ holds precisely because $A\vec{v}=\lambda \vec{v}$. Therefore, every eigenvalue-eigenvector pair generates a solution of the form $e^{\lambda t}\vec{v}$.

The general solution to the system is a linear combination of all such linearly independent solutions. If $A$ has $n$ linearly independent eigenvectors ${\vec{v}}_1,{\vec{v}}_2,...,{\vec{v}}_n$ with corresponding eigenvalues ${\lambda }_1,{\lambda }_2,...,{\lambda }_n$ (not necessarily distinct), the general solution is:

$$\mathbf{x}(t)=c_1{e}^{{\lambda }_{1}t}{\vec{v}}_1+c_2{e}^{{\lambda }_{2}t}{\vec{v}}_2+...+c_n{e}^{{\lambda }_{n}t}{\vec{v}}_n$$

The constants $c_1,c_2,...,c_n$ are determined by the initial conditions $\mathbf{x}(0)$.

2. Case 1: Distinct Real Eigenvalues

This is the most straightforward scenario. When the characteristic equation $\det (A-\lambda I)=0$ yields $n$ distinct real roots, the process is algorithmic.

Step-by-Step Solution:

1. Find Eigenvalues: Solve $\det (A-\lambda I)=0$.
2. Find Eigenvectors: For each ${\lambda }_i$, solve $(A-{\lambda }_{i}I){\vec{v}}_i=\vec{0}$.
3. Construct General Solution: Assemble the solution as shown above.

Example: Solve ${\mathbf{x}}^{\prime }=\left[\begin{array}{cc}1& 1\\ 4& 1\end{array}\right]\mathbf{x}$.

1. Eigenvalues: $\det \left[\begin{array}{cc}1-\lambda & 1\\ 4& 1-\lambda \end{array}\right]=(1-\lambda {)}^2-4=0⟹{\lambda }^2-2\lambda -3=0$. Thus, ${\lambda }_1=3,{\lambda }_2=-1$.
2. Eigenvectors:

• For ${\lambda }_1=3$: $(A-3I){\vec{v}}_1=\left[\begin{array}{cc}-2& 1\\ 4& -2\end{array}\right]{\vec{v}}_1=\vec{0}⟹{\vec{v}}_1=\left[\begin{array}{c}1\\ 2\end{array}\right]$.
• For ${\lambda }_2=-1$: $(A+1I){\vec{v}}_2=\left[\begin{array}{cc}2& 1\\ 4& 2\end{array}\right]{\vec{v}}_2=\vec{0}⟹{\vec{v}}_2=\left[\begin{array}{c}1\\ -2\end{array}\right]$.

1. General Solution:

$$\mathbf{x}(t)=c_1{e}^{3t}\left[\begin{array}{c}1\\ 2\end{array}\right]+c_2{e}^{-t}\left[\begin{array}{c}1\\ -2\end{array}\right]$$ The solution describes a saddle point dynamics, common in unstable systems, where one mode ($e^{3t}$) grows and the other ($e^{-t}$) decays.

3. Case 2: Complex Conjugate Eigenvalues

Complex eigenvalues always appear in conjugate pairs for real matrices ($\lambda =\alpha \pm i\beta$). Their eigenvectors are also complex conjugates. The resulting complex solutions are mathematically valid, but for engineering applications, we extract real-valued solutions using Euler's formula: $e^{(\alpha +i\beta )t}=e^{\alpha t}(\cos (\beta t)+i\sin (\beta t))$.

Solution Construction:

1. Find the complex eigenvalue $\lambda =\alpha +i\beta$ and its eigenvector $\vec{v}=\vec{a}+i\vec{b}$, where $\vec{a}$ and $\vec{b}$ are real vectors.
2. Two linearly independent real solutions are given by the real and imaginary parts of $e^{\lambda t}\vec{v}$:

$$\begin{array}{rl}{\mathbf{x}}_1(t)& =e^{\alpha t}[\vec{a}\cos (\beta t)-\vec{b}\sin (\beta t)]\\ {\mathbf{x}}_2(t)& =e^{\alpha t}[\vec{a}\sin (\beta t)+\vec{b}\cos (\beta t)]\end{array}$$

1. The general real solution is $\mathbf{x}(t)=c_1{\mathbf{x}}_1(t)+c_2{\mathbf{x}}_2(t)$.

This generates solutions that are oscillations of frequency $\beta$, modulated by an exponential growth ($\alpha >0$) or decay ($\alpha <0$). A pure imaginary eigenvalue ($\alpha =0$) yields stable oscillations, modeling systems like an undamped mass-spring or LC circuit.

4. The Fundamental Matrix and Matrix Exponential

The fundamental matrix $\Phi (t)$ is an $n\times n$ matrix whose columns are $n$ linearly independent solution vectors of ${\mathbf{x}}^{\prime }=A\mathbf{x}$. Using our general solution form with distinct eigenvalues, it can be constructed as:

$$\Phi (t)=\left[\begin{array}{cccc}{e}^{{\lambda }_{1}t}{\vec{v}}_1& e^{{\lambda }_{2}t}{\vec{v}}_2& \cdots & e^{{\lambda }_{n}t}{\vec{v}}_n\end{array}\right]$$

The general solution can then be written compactly as $\mathbf{x}(t)=\Phi (t)\vec{c}$, where $\vec{c}$ is the vector of constants. The fundamental matrix is crucial for solving nonhomogeneous systems via variation of parameters.

A more powerful and elegant concept is the matrix exponential $e^{At}$, defined by the infinite series $I+At+\frac{(At{)}^2}{2!}+\frac{(At{)}^3}{3!}+...$. For the system ${\mathbf{x}}^{\prime }=A\mathbf{x}$, the matrix exponential is itself a fundamental matrix. Most importantly, the solution to any initial value problem ${\mathbf{x}}^{\prime }=A\mathbf{x},\mathbf{x}(0)={\mathbf{x}}_0$ is given simply by:

$$\mathbf{x}(t)=e^{At}{\mathbf{x}}_0$$

When $A$ has a full set of eigenvectors, $e^{At}$ can be computed via diagonalization: $e^{At}=P{e}^{Dt}{P}^{-1}$, where $D$ is the diagonal matrix of eigenvalues and $P$ is the matrix of eigenvectors. This makes the matrix exponential a formidable tool for analytical and numerical analysis of linear systems.

Common Pitfalls

1. Mishandling Complex Solutions: A common error is to treat the complex solution $e^{(\alpha +i\beta )t}\vec{v}$ as the final answer for a physical system. Always remember to extract two real, linearly independent solutions using the formula involving sine and cosine. Forgetting to do this yields an answer with imaginary components, which is not physically meaningful for most engineering contexts.
2. Assuming Eigenvectors are Unique: When solving $(A-\lambda I)\vec{v}=\vec{0}$, the eigenvector is not a single vector but an entire eigenspace (a line for a single eigenvalue). Any non-zero scalar multiple of an eigenvector is also an eigenvector. Your answer can use any valid representative. However, consistency is key when constructing the fundamental matrix or using diagonalization.
3. Incorrect General Solution for Defective Matrices: The formula $\mathbf{x}(t)=\sum c_i{e}^{{\lambda }_{i}t}{\vec{v}}_i$ only works if $A$ has $n$ linearly independent eigenvectors. If $A$ is defective (missing eigenvectors, e.g., repeated eigenvalues without enough eigenvectors), this form is incomplete. You must then use generalized eigenvectors to construct solutions of the form $t{e}^{\lambda t}\vec{v}$. Always check that you have found enough eigenvectors before writing the final solution.
4. Misconstructing the Fundamental Matrix: The columns of $\Phi (t)$ must be linearly independent solutions. Simply putting any solutions as columns is not sufficient. A reliable method is to use the solution set derived from a basis of eigenvectors (or generalized eigenvectors). A quick check: $\Phi (0)$ should be an invertible matrix.

Summary

• The matrix method solves ${\mathbf{x}}^{\prime }=A\mathbf{x}$ by finding eigenvalues $\lambda$ and eigenvectors $\vec{v}$ of $A$, yielding fundamental solutions of the form $e^{\lambda t}\vec{v}$.
• For distinct real eigenvalues, the general solution is a direct linear combination of these exponential solutions, dictating purely exponential growth or decay.
• For complex conjugate eigenvalues $\alpha \pm i\beta$, the general real solution involves combinations of $e^{\alpha t}\cos (\beta t)$ and $e^{\alpha t}\sin (\beta t)$, describing oscillatory behavior that may grow or decay.
• The fundamental matrix $\Phi (t)$ organizes solutions into columns, and the matrix exponential $e^{At}$ provides the most compact and powerful solution form, especially for initial value problems: $\mathbf{x}(t)=e^{At}{\mathbf{x}}_0$.