Questions tagged [diagonalization]

For questions about matrix diagonalization. Diagonalization is the process of finding a corresponding diagonal matrix for a diagonalizable matrix or linear map. This tag is NOT for diagonalization arguments common to logic and set theory.

A square matrix $A$ is diagonalizable if there is an invertible matrix $P$ such that $P^{-1}AP$ is a diagonal matrix. One can view $P$ as a change of basis matrix so that, if $A$ is viewed as the standard matrix of a linear map $T$ from a vector space to itself in some basis, it is equivalent to saying there exists an ordered basis such that the standard matrix of $T$ is diagonal. Diagonal matrices present the eigenvalues of the corresponding linear transformation along its diagonal. A square matrix that is not diagonalizable is called defective.

Not every matrix is diagonalizable over $\mathbb{R}$ (i.e. only allowing real matrices $P$). For example, $$\begin{pmatrix} 0 & -1 \\ 1 & 0 \end{pmatrix}$$

Diagonalization can be used to compute the powers of a matrix $A$ efficiently, provided the matrix is diagonalizable.

Diagonalization Procedure:

Let $A$ be the $n \times n$ matrix that you want to diagonalize (if possible).

  • Find the characteristic polynomial $p(t)$ of $A$.

  • Find eigenvalues $\lambda$ of the matrix $A$ and their algebraic multiplicities from the characteristic polynomial $p(t)$.

  • For each eigenvalue $λ$ of $A$, find a basis of the eigenspace $E_λ$. If there is an eigenvalue $\lambda$ such that the geometric multiplicity of $λ$, $\dim(E_{\lambda})$, is less than the algebraic multiplicity of $λ$, then the matrix $A$ is not diagonalizable. If not, $A$ is diagonalizable, and proceed to the next step.

  • If we combine all basis vectors for all eigenspaces, we obtained $n$ linearly independent eigenvectors $v_1,v_2, \ldots, v_n$.

  • Define the nonsingular matrix $$P=[v_1\quad v_2\quad \cdots \quad v_n]$$

  • Define the diagonal matrix $D$, whose $(i,i)$-entry is the eigenvalue $\lambda$ such that the $i^{th}$ column vector $v_i$ is in the eigenspace $E_λ$.

  • Then the matrix A is diagonalized as $$P^{−1}AP=D.$$

References:

Diagonal Matrix on Wikipedia

Matrix Diagonalization on Wolfram MathWorld

2569 questions
217
votes
8 answers

Intuitively, what is the difference between Eigendecomposition and Singular Value Decomposition?

I'm trying to intuitively understand the difference between SVD and eigendecomposition. From my understanding, eigendecomposition seeks to describe a linear transformation as a sequence of three basic operations ($P^{-1}DP$) on a vector: Rotation…
82
votes
3 answers

Eigenvalues of the rank one matrix $uv^T$

Suppose $A=uv^T$ where $u$ and $v$ are non-zero column vectors in ${\mathbb R}^n$, $n\geq 3$. $\lambda=0$ is an eigenvalue of $A$ since $A$ is not of full rank. $\lambda=v^Tu$ is also an eigenvalue of $A$ since $$Au = (uv^T)u=u(v^Tu)=(v^Tu)u.$$…
61
votes
4 answers

Diagonalizable transformation restricted to an invariant subspace is diagonalizable

Suppose $V$ is a vector space over $\mathbb{C}$, and $A$ is a linear transformation on $V$ which is diagonalizable. I.e. there is a basis of $V$ consisting of eigenvectors of $A$. If $W\subseteq V$ is an invariant subspace of $A$ (so $A(W)\subseteq…
58
votes
3 answers

Simultaneous diagonalization of commuting linear transformations

Let $V$ be a vector space of finite dimension and let $T,S$ linear diagonalizable transformations from $V$ to itself. I need to prove that if $TS=ST$ every eigenspace $V_\lambda$ of $S$ is $T$-invariant and the restriction of $T$ to $V_\lambda$…
user6163
43
votes
2 answers

Are most matrices diagonalizable?

More precisely, does the set of non-diagonalizable (over $\mathbb C$) matrices have Lebesgue measure zero in $\mathbb R^{n\times n}$ or $\mathbb C^{n\times n}$? Intuitively, I would think yes, since in order for a matrix to be non-diagonalizable…
38
votes
5 answers

Symmetric matrix is always diagonalizable?

I'm reading my linear algebra textbook and there are two sentences that make me confused. (1) Symmetric matrix $A$ can be factored into $A=Q\lambda Q^{T}$ where $Q$ is orthogonal matrix : Diagonalizable ($Q$ has eigenvectors of $A$ in its columns,…
36
votes
4 answers

Are idempotent matrices always diagonalizable?

How to prove that any idempotent matrix is diagonalizable?
34
votes
5 answers

If two matrices have the same eigenvalues and eigenvectors are they equal?

The question stems from a problem i stumbled upon while working with eigenvalues. Asking to explain why $A^{100}$ is close to $A^\infty$ $$A= \left[ \begin{array}{cc} .6 & .2 \\ .4 & .8 \end{array} \right] $$ $$A^\infty= \left[…
33
votes
2 answers

Can a matrix be invertible but not diagonalizable?

While reading a chapter on diagonalizable matrices, I found myself wondering: Can a matrix $A \in \mathbb R^{n \times n}$ be invertible but not diagonalizable? My quick Google search did not return a clear answer.
32
votes
5 answers

How to determine the diagonalizability of these two matrices?

I am trying to figure out how to determine the diagonalizability of the following two matrices. For the first matrix $$\left[\begin{matrix} 0 & 1 & 0\\0 & 0 & 1\\2 & -5 & 4\end{matrix}\right]$$ There are two distinct eigenvalues, $\lambda_1 =…
29
votes
2 answers

Quick way to check if a matrix is diagonalizable.

Is there any quick way to check whether a matrix is diagonalizable or not? In exam if a question is asked like "Which of the following matrix is diagonalizable?" and four options are given then how can one check it quickly? I hope my question makes…
zafran
  • 942
28
votes
3 answers

Square root of Positive Definite Matrix

Let $A$ be an $n\times n$ positive definite matrix. Show that there exists a unique positive definite matrix $B$ such that $B^2=A$. I do know the existence. But what about the uniqueness? Would you help me out? Thank you.
XLDD
  • 2,115
  • 1
  • 17
  • 22
26
votes
4 answers

Intuition on spectral theorem

In the last month I studied the spectral theorems and I formally understood them. But I would like some intuition about them. If you didn’t know spectral theorems, how would you come up with the idea that symmetric/normal endomorphisms are the only…
25
votes
3 answers

Why is there not a test for diagonalizability of a matrix

Let $A$ be square. This question is a bit opinion-based unless there is a technical answer. I think it is helpful tho. Also, this question is closely related to this question : quick way to check if a matrix is diagonalizable. Based on the answers,…
25
votes
4 answers

Block diagonal matrix diagonalizable

I am trying to prove that: The matrix $C = \left(\begin{smallmatrix}A& 0\\0 & B\end{smallmatrix}\right)$ is diagonalizable, if only if $A$ and $B$ are diagonalizable. If $A\in GL(\mathbb{C}^n)$ and $B\in GL(\mathbb{C}^m)$ are diagonalizable, then…
FASCH
  • 1,762
  • 1
  • 21
  • 31
1
2 3
99 100