Hermitian matrix

In mathematics, a Hermitian matrix (or self-adjoint matrix) is a complex square matrix that is equal to its own conjugate transpose—that is, the element in the $i$ -th row and $j$ -th column is equal to the complex conjugate of the element in the $j$ -th row and $i$ -th column, for all indices $i$ and $j$ :

$A{\text{ Hermitian}}\quad \iff \quad a_{ij}={\overline {{a}_{ji}}}$

or in matrix form:

A{\text{ Hermitian}}\quad \iff \quad A={\overline {A^{\mathsf {T}}}}.

Hermitian matrices can be understood as the complex extension of real symmetric matrices.

If the conjugate transpose of a matrix $A$ is denoted by $A^{\mathsf {H}},$ then the Hermitian property can be written concisely as

$A{\text{ Hermitian}}\quad \iff \quad A=A^{\mathsf {H}}$

Hermitian matrices are named after Charles Hermite, who demonstrated in 1855 that matrices of this form share a property with real symmetric matrices of always having real eigenvalues. Other, equivalent notations in common use are $A^{\mathsf {H}}=A^{\dagger }=A^{\ast },$ although in quantum mechanics, $A^{\ast }$ typically means the complex conjugate only, and not the conjugate transpose.

Alternative characterizations

Hermitian matrices can be characterized in a number of equivalent ways, some of which are listed below:

Equality with the adjoint

A square matrix $A$ is Hermitian if and only if it is equal to its adjoint, that is, it satisfies

\langle \mathbf {w} ,A\mathbf {v} \rangle =\langle A\mathbf {w} ,\mathbf {v} \rangle ,

for any pair of vectors $\mathbf {v} ,\mathbf {w} ,$ where $\langle \cdot ,\cdot \rangle$ denotes the inner product operation.

This is also the way that the more general concept of self-adjoint operator is defined.

Reality of quadratic forms

An $n\times {}n$ matrix $A$ is Hermitian if and only if

\langle \mathbf {v} ,A\mathbf {v} \rangle \in \mathbb {R} ,\quad \mathbf {v} \in \mathbb {C} ^{n}.

Spectral properties

A square matrix $A$ is Hermitian if and only if it is unitarily diagonalizable with real eigenvalues.

Applications

Hermitian matrices are fundamental to quantum mechanics because they describe operators with necessarily real eigenvalues. An eigenvalue $a$ of an operator ${\hat {A}}$ on some quantum state $|\psi \rangle$ is one of the possible measurement outcomes of the operator, which necessitates the need for operators with real eigenvalues.

Examples and solutions

In this section, the conjugate transpose of matrix $A$ is denoted as $A^{\mathsf {H}},$ the transpose of matrix $A$ is denoted as $A^{\mathsf {T}}$ and conjugate of matrix $A$ is denoted as ${\overline {A}}.$

See the following example:

{\begin{bmatrix}0&a-ib&c-id\\a+ib&1&m-in\\c+id&m+in&2\end{bmatrix}}

The diagonal elements must be real, as they must be their own complex conjugate.

Well-known families of Hermitian matrices include the Pauli matrices, the Gell-Mann matrices and their generalizations. In theoretical physics such Hermitian matrices are often multiplied by imaginary coefficients,[1][2] which results in skew-Hermitian matrices.

Here, we offer another useful Hermitian matrix using an abstract example. If a square matrix $A$ equals the product of a matrix with its conjugate transpose, that is, $A=BB^{\mathsf {H}},$ then $A$ is a Hermitian positive semi-definite matrix. Furthermore, if $B$ is row full-rank, then $A$ is positive definite.

Properties

Main diagonal values are real

The entries on the main diagonal (top left to bottom right) of any Hermitian matrix are real.

Proof

By definition of the Hermitian matrix

H_{ij}={\overline {H}}_{ji}

so for $i = j$ the above follows.

Only the main diagonal entries are necessarily real; Hermitian matrices can have arbitrary complex-valued entries in their off-diagonal elements, as long as diagonally-opposite entries are complex conjugates.

Symmetric

A matrix that has only real entries is symmetric if and only if it is Hermitian matrix. A real and symmetric matrix is simply a special case of a Hermitian matrix.

Proof

$H_{ij}={\overline {H}}_{ji}$ by definition. Thus $H_{ij}=H_{ji}$ (matrix symmetry) if and only if $H_{ij}={\overline {H}}_{ij}$ ( $H_{ij}$ is real).

So, if a real anti-symmetric matrix is multiplied by a real multiple of the imaginary unit $i,$ then it becomes Hermitian.

Normal

Every Hermitian matrix is a normal matrix. That is to say, $AA^{\mathsf {H}}=A^{\mathsf {H}}A.$

Proof

$A=A^{\mathsf {H}},$ so $AA^{\mathsf {H}}=AA=A^{\mathsf {H}}A.$

Diagonalizable

The finite-dimensional spectral theorem says that any Hermitian matrix can be diagonalized by a unitary matrix, and that the resulting diagonal matrix has only real entries. This implies that all eigenvalues of a Hermitian matrix $A$ with dimension $n$ are real, and that $A$ has $n$ linearly independent eigenvectors. Moreover, a Hermitian matrix has orthogonal eigenvectors for distinct eigenvalues. Even if there are degenerate eigenvalues, it is always possible to find an orthogonal basis of $C n$ consisting of $n$ eigenvectors of $A$ .

Sum of Hermitian matrices

The sum of any two Hermitian matrices is Hermitian.

Proof

(A+B)_{ij}=A_{ij}+B_{ij}={\overline {A}}_{ji}+{\overline {B}}_{ji}={\overline {(A+B)}}_{ji},

as claimed.

Inverse is Hermitian

The inverse of an invertible Hermitian matrix is Hermitian as well.

Proof

If $A^{-1}A=I,$ then $I=I^{\mathsf {H}}=\left(A^{-1}A\right)^{\mathsf {H}}=A^{\mathsf {H}}\left(A^{-1}\right)^{\mathsf {H}}=A\left(A^{-1}\right)^{\mathsf {H}},$ so $A^{-1}=\left(A^{-1}\right)^{\mathsf {H}}$ as claimed.

Associative product of Hermitian matrices

The product of two Hermitian matrices $A$ and $B$ is Hermitian if and only if $AB = BA$ .

Proof

(AB)^{\mathsf {H}}={\overline {(AB)^{\mathsf {T}}}}={\overline {B^{\mathsf {T}}A^{\mathsf {T}}}}={\overline {B^{\mathsf {T}}}}\ {\overline {A^{\mathsf {T}}}}=B^{\mathsf {H}}A^{\mathsf {H}}=BA.

Thus

(AB)^{\mathsf {H}}=AB

if and only if

AB=BA.

Thus $A n$ is Hermitian if $A$ is Hermitian and $n$ is an integer.

ABA Hermitian

If A and B are Hermitian, then ABA is also Hermitian.

Proof

(ABA)^{\mathsf {H}}=(A(BA))^{\mathsf {H}}=(BA)^{\mathsf {H}}A^{\mathsf {H}}=A^{\mathsf {H}}B^{\mathsf {H}}A^{\mathsf {H}}=ABA

$v H A v$ is real for complex $v$

For an arbitrary complex valued vector $v$ the product $\mathbf {v} ^{\mathsf {H}}A\mathbf {v}$ is real because of $\mathbf {v} ^{\mathsf {H}}A\mathbf {v} =\left(\mathbf {v} ^{\mathsf {H}}A\mathbf {v} \right)^{\mathsf {H}}.$ This is especially important in quantum physics where Hermitian matrices are operators that measure properties of a system, e.g. total spin, which have to be real.

Complex Hermitian forms vector space over $R$

The Hermitian complex $n$ -by- $n$ matrices do not form a vector space over the complex numbers, $C$ , since the identity matrix $I n$ is Hermitian, but $i I n$ is not. However the complex Hermitian matrices do form a vector space over the real numbers $R$ . In the $2 n 2$ -dimensional vector space of complex $n \times n$ matrices over $R$ , the complex Hermitian matrices form a subspace of dimension $n 2$ . If $E jk$ denotes the $n$ -by- $n$ matrix with a $1$ in the $j, k$ position and zeros elsewhere, a basis (orthonormal with respect to the Frobenius inner product) can be described as follows:

E_{jj}{\text{ for }}1\leq j\leq n\quad (n{\text{ matrices}})

together with the set of matrices of the form

{\frac {1}{\sqrt {2}}}\left(E_{jk}+E_{kj}\right){\text{ for }}1\leq j<k\leq n\quad \left({\frac {n^{2}-n}{2}}{\text{ matrices}}\right)

and the matrices

{\frac {i}{\sqrt {2}}}\left(E_{jk}-E_{kj}\right){\text{ for }}1\leq j<k\leq n\quad \left({\frac {n^{2}-n}{2}}{\text{ matrices}}\right)

where $i$ denotes the imaginary unit, $i={\sqrt {-1}}~.$

An example is that the four Pauli matrices form a complete basis for the vector space of all complex 2-by-2 Hermitian matrices over $R$ .

Eigendecomposition

If $n$ orthonormal eigenvectors $\mathbf {u} _{1},\dots ,\mathbf {u} _{n}$ of a Hermitian matrix are chosen and written as the columns of the matrix $U$ , then one eigendecomposition of $A$ is $A=U\Lambda U^{\mathsf {H}}$ where $UU^{\mathsf {H}}=I=U^{\mathsf {H}}U$ and therefore

A=\sum _{j}\lambda _{j}\mathbf {u} _{j}\mathbf {u} _{j}^{\mathsf {H}},

where $\lambda _{j}$ are the eigenvalues on the diagonal of the diagonal matrix $\Lambda .$

Singular values[3]

The singular values of $A$ are the absolute values of its eigenvalues:

Since $A$ has an eigendecomposition $A=U\Lambda U^{H}$ , where $U$ is a unitary matrix (its columns are orthonormal vectors; see above), a singular value decomposition of $A$ is $A=U|\Lambda |{\text{sgn}}(\Lambda )U^{H}$ , where $|\Lambda |$ and ${\text{sgn}}(\Lambda )$ are diagonal matrices containing the absolute values $|\lambda |$ and signs ${\text{sgn}}(\lambda )$ of $A$ 's eigenvalues, respectively. $\operatorname {sgn}(\Lambda )U^{H}$ is unitary, since the columns of $U^{H}$ are only getting multiplied by $\pm 1$ . $|\Lambda |$ contains the singular values of $A$ , namely, the absolute values of its eigenvalues.

Real determinant

The determinant of a Hermitian matrix is real:

Proof

$\det(A)=\det \left(A^{\mathsf {T}}\right)\quad \Rightarrow \quad \det \left(A^{\mathsf {H}}\right)={\overline {\det(A)}}$ Therefore if $A=A^{\mathsf {H}}\quad \Rightarrow \quad \det(A)={\overline {\det(A)}}.$

(Alternatively, the determinant is the product of the matrix's eigenvalues, and as mentioned before, the eigenvalues of a Hermitian matrix are real.)

Decomposition into Hermitian and skew-Hermitian matrices

Additional facts related to Hermitian matrices include:

The sum of a square matrix and its conjugate transpose $\left(A+A^{\mathsf {H}}\right)$ is Hermitian.
The difference of a square matrix and its conjugate transpose $\left(A-A^{\mathsf {H}}\right)$ is skew-Hermitian (also called antihermitian). This implies that the commutator of two Hermitian matrices is skew-Hermitian.
An arbitrary square matrix $C$ can be written as the sum of a Hermitian matrix $A$ and a skew-Hermitian matrix $B$ . This is known as the Toeplitz decomposition of $C$ .[4]^: 227 $C=A+B\quad {\text{with}}\quad A={\frac {1}{2}}\left(C+C^{\mathsf {H}}\right)\quad {\text{and}}\quad B={\frac {1}{2}}\left(C-C^{\mathsf {H}}\right)$

Rayleigh quotient

In mathematics, for a given complex Hermitian matrix $M$ and nonzero vector $x$ , the Rayleigh quotient[5] $R(M,\mathbf {x} ),$ is defined as:[4]^{: p. 234}[6]

R(M,\mathbf {x} ):={\frac {\mathbf {x} ^{\mathsf {H}}M\mathbf {x} }{\mathbf {x} ^{\mathsf {H}}\mathbf {x} }}.

For real matrices and vectors, the condition of being Hermitian reduces to that of being symmetric, and the conjugate transpose $\mathbf {x} ^{\mathsf {H}}$ to the usual transpose $\mathbf {x} ^{\mathsf {T}}.$ $R(M,c\mathbf {x} )=R(M,\mathbf {x} )$ for any non-zero real scalar $c.$ Also, recall that a Hermitian (or real symmetric) matrix has real eigenvalues.

It can be shown[4] that, for a given matrix, the Rayleigh quotient reaches its minimum value $\lambda _{\min }$ (the smallest eigenvalue of M) when $\mathbf {x}$ is $\mathbf {v} _{\min }$ (the corresponding eigenvector). Similarly, $R(M,\mathbf {x} )\leq \lambda _{\max }$ and $R(M,\mathbf {v} _{\max })=\lambda _{\max }.$

The Rayleigh quotient is used in the min-max theorem to get exact values of all eigenvalues. It is also used in eigenvalue algorithms to obtain an eigenvalue approximation from an eigenvector approximation. Specifically, this is the basis for Rayleigh quotient iteration.

The range of the Rayleigh quotient (for matrix that is not necessarily Hermitian) is called a numerical range (or spectrum in functional analysis). When the matrix is Hermitian, the numerical range is equal to the spectral norm. Still in functional analysis, $\lambda _{\max }$ is known as the spectral radius. In the context of C*-algebras or algebraic quantum mechanics, the function that to $M$ associates the Rayleigh quotient $R (M, x)$ for a fixed $x$ and $M$ varying through the algebra would be referred to as "vector state" of the algebra.

References

Frankel, Theodore (2004). The Geometry of Physics: an introduction. Cambridge University Press. p. 652. ISBN 0-521-53927-7.
Physics 125 Course Notes at California Institute of Technology
Trefethan, Lloyd N.; Bau, III, David (1997). Numerical linear algebra. Philadelphia, PA, USA: SIAM. p. 34. ISBN 0-89871-361-7.
Horn, Roger A.; Johnson, Charles R. (2013). Matrix Analysis, second edition. Cambridge University Press. ISBN 9780521839402.
Also known as the Rayleigh–Ritz ratio; named after Walther Ritz and Lord Rayleigh.
Parlet B. N. The symmetric eigenvalue problem, SIAM, Classics in Applied Mathematics,1998

External links

"Hermitian matrix", Encyclopedia of Mathematics, EMS Press, 2001 [1994]
Visualizing Hermitian Matrix as An Ellipse with Dr. Geo, by Chao-Kuei Hung from Chaoyang University, gives a more geometric explanation.
"Hermitian Matrices". MathPages.com.

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.

[1] Frankel, Theodore (2004). The Geometry of Physics: an introduction. Cambridge University Press. p. 652. ISBN 0-521-53927-7.

[2] Physics 125 Course Notes at California Institute of Technology

[3] Trefethan, Lloyd N.; Bau, III, David (1997). Numerical linear algebra. Philadelphia, PA, USA: SIAM. p. 34. ISBN 0-89871-361-7.

[HornJohnson-4] Horn, Roger A.; Johnson, Charles R. (2013). Matrix Analysis, second edition. Cambridge University Press. ISBN 9780521839402.

[5] Also known as the Rayleigh–Ritz ratio; named after Walther Ritz and Lord Rayleigh.

[6] Parlet B. N. The symmetric eigenvalue problem, SIAM, Classics in Applied Mathematics,1998

Matrix classes
Explicitly constrained entries	Alternant Anti-diagonal Anti-Hermitian Anti-symmetric Arrowhead Band Bidiagonal Bisymmetric Block-diagonal Block Block tridiagonal Boolean Cauchy Centrosymmetric Conference Complex Hadamard Copositive Diagonally dominant Diagonal Discrete Fourier Transform Elementary Equivalent Frobenius Generalized permutation Hadamard Hankel Hermitian Hessenberg Hollow Integer Logical Matrix unit Metzler Moore Nonnegative Pentadiagonal Permutation Persymmetric Polynomial Quaternionic Signature Skew-Hermitian Skew-symmetric Skyline Sparse Sylvester Symmetric Toeplitz Triangular Tridiagonal Vandermonde Walsh Z
Constant	Exchange Hilbert Identity Lehmer Of ones Pascal Pauli Redheffer Shift Zero
Conditions on eigenvalues or eigenvectors	Companion Convergent Defective Definite Diagonalizable Hurwitz Positive-definite Stieltjes
Satisfying conditions on products or inverses	Congruent Idempotent or Projection Invertible Involutory Nilpotent Normal Orthogonal Unimodular Unipotent Unitary Totally unimodular Weighing
With specific applications	Adjugate Alternating sign Augmented Bézout Carleman Cartan Circulant Cofactor Commutation Confusion Coxeter Distance Duplication and elimination Euclidean distance Fundamental (linear differential equation) Generator Gram Hessian Householder Jacobian Moment Payoff Pick Random Rotation Seifert Shear Similarity Symplectic Totally positive Transformation
Used in statistics	Centering Correlation Covariance Design Doubly stochastic Fisher information Hat Precision Stochastic Transition
Used in graph theory	Adjacency Biadjacency Degree Edmonds Incidence Laplacian Seidel adjacency Tutte
Used in science and engineering	Cabibbo–Kobayashi–Maskawa Density Fundamental (computer vision) Fuzzy associative Gamma Gell-Mann Hamiltonian Irregular Overlap S State transition Substitution Z (chemistry)
Related terms	Jordan normal form Linear independence Matrix exponential Matrix representation of conic sections Perfect matrix Pseudoinverse Row echelon form Wronskian
Mathematics portal List of matrices Category:Matrices

Hermitian matrix

Alternative characterizations

Equality with the adjoint

Reality of quadratic forms

Spectral properties

Applications

Examples and solutions

Properties

Main diagonal values are real

Symmetric

Normal

Diagonalizable

Sum of Hermitian matrices

Inverse is Hermitian

Associative product of Hermitian matrices

ABA Hermitian

vHAv is real for complex v

Complex Hermitian forms vector space over R

Eigendecomposition

Singular values[3]

Real determinant

Decomposition into Hermitian and skew-Hermitian matrices

Rayleigh quotient

See also

References

External links

$v H A v$ is real for complex $v$

Complex Hermitian forms vector space over $R$