Block matrix

A 168×168 element block matrix with 12×12, 12×24, 24×12, and 24×24 sub-matrices. Non-zero elements are in blue, zero elements are grayed.

The matrix

${\displaystyle \mathbf {P} ={\begin{bmatrix}1&2&2&7\\1&5&6&2\\3&3&4&5\\3&3&6&7\end{bmatrix}}}$

can be partitioned into four 2×2 blocks

${\displaystyle \mathbf {P} _{11}={\begin{bmatrix}1&2\\1&5\end{bmatrix}},\quad \mathbf {P} _{12}={\begin{bmatrix}2&7\\6&2\end{bmatrix}},\quad \mathbf {P} _{21}={\begin{bmatrix}3&3\\3&3\end{bmatrix}},\quad \mathbf {P} _{22}={\begin{bmatrix}4&5\\6&7\end{bmatrix}}.}$

The partitioned matrix can then be written as

${\displaystyle \mathbf {P} ={\begin{bmatrix}\mathbf {P} _{11}&\mathbf {P} _{12}\\\mathbf {P} _{21}&\mathbf {P} _{22}\end{bmatrix}}.}$

It is possible to use a block partitioned matrix product that involves only algebra on submatrices of the factors. The partitioning of the factors is not arbitrary, however, and requires "conformable partitions"[4] between two matrices ${\displaystyle A}$ and ${\displaystyle B}$ such that all submatrix products that will be used are defined.[5] Given an ${\displaystyle (m\times p)}$ matrix ${\displaystyle \mathbf {A} }$ with ${\displaystyle q}$ row partitions and ${\displaystyle s}$ column partitions

${\displaystyle \mathbf {A} ={\begin{bmatrix}\mathbf {A} _{11}&\mathbf {A} _{12}&\cdots &\mathbf {A} _{1s}\\\mathbf {A} _{21}&\mathbf {A} _{22}&\cdots &\mathbf {A} _{2s}\\\vdots &\vdots &\ddots &\vdots \\\mathbf {A} _{q1}&\mathbf {A} _{q2}&\cdots &\mathbf {A} _{qs}\end{bmatrix}}}$

and a ${\displaystyle (p\times n)}$ matrix ${\displaystyle \mathbf {B} }$ with ${\displaystyle s}$ row partitions and ${\displaystyle r}$ column partitions

${\displaystyle \mathbf {B} ={\begin{bmatrix}\mathbf {B} _{11}&\mathbf {B} _{12}&\cdots &\mathbf {B} _{1r}\\\mathbf {B} _{21}&\mathbf {B} _{22}&\cdots &\mathbf {B} _{2r}\\\vdots &\vdots &\ddots &\vdots \\\mathbf {B} _{s1}&\mathbf {B} _{s2}&\cdots &\mathbf {B} _{sr}\end{bmatrix}},}$

that are compatible with the partitions of ${\displaystyle A}$, the matrix product

${\displaystyle \mathbf {C} =\mathbf {A} \mathbf {B} }$

can be performed blockwise, yielding ${\displaystyle \mathbf {C} }$ as an ${\displaystyle (m\times n)}$ matrix with ${\displaystyle q}$ row partitions and ${\displaystyle r}$ column partitions. The matrices in the resulting matrix ${\displaystyle \mathbf {C} }$ are calculated by multiplying:

${\displaystyle \mathbf {C} _{qr}=\sum _{i=1}^{s}\mathbf {A} _{qi}\mathbf {B} _{ir}.}$

Or, using the Einstein notation that implicitly sums over repeated indices:

${\displaystyle \mathbf {C} _{qr}=\mathbf {A} _{qi}\mathbf {B} _{ir}.}$

If a matrix is partitioned into four blocks, it can be inverted blockwise as follows:

${\displaystyle \mathbf {P} ={\begin{bmatrix}\mathbf {A} &\mathbf {B} \\\mathbf {C} &\mathbf {D} \end{bmatrix}}^{-1}={\begin{bmatrix}\mathbf {A} ^{-1}+\mathbf {A} ^{-1}\mathbf {B} \left(\mathbf {D} -\mathbf {CA} ^{-1}\mathbf {B} \right)^{-1}\mathbf {CA} ^{-1}&-\mathbf {A} ^{-1}\mathbf {B} \left(\mathbf {D} -\mathbf {CA} ^{-1}\mathbf {B} \right)^{-1}\\-\left(\mathbf {D} -\mathbf {CA} ^{-1}\mathbf {B} \right)^{-1}\mathbf {CA} ^{-1}&\left(\mathbf {D} -\mathbf {CA} ^{-1}\mathbf {B} \right)^{-1}\end{bmatrix}},}$

where A and D are square blocks of arbitrary size, and B and C are conformable with them for partitioning. Furthermore, A and the Schur complement of A in P: P/A = D − CA⁻¹B must be invertible.[6]

Equivalently, by permuting the blocks:

${\displaystyle \mathbf {P} ={\begin{bmatrix}\mathbf {A} &\mathbf {B} \\\mathbf {C} &\mathbf {D} \end{bmatrix}}^{-1}={\begin{bmatrix}\left(\mathbf {A} -\mathbf {BD} ^{-1}\mathbf {C} \right)^{-1}&-\left(\mathbf {A} -\mathbf {BD} ^{-1}\mathbf {C} \right)^{-1}\mathbf {BD} ^{-1}\\-\mathbf {D} ^{-1}\mathbf {C} \left(\mathbf {A} -\mathbf {BD} ^{-1}\mathbf {C} \right)^{-1}&\quad \mathbf {D} ^{-1}+\mathbf {D} ^{-1}\mathbf {C} \left(\mathbf {A} -\mathbf {BD} ^{-1}\mathbf {C} \right)^{-1}\mathbf {BD} ^{-1}\end{bmatrix}}.}$

Here, D and the Schur complement of D in P: P/D = A − BD⁻¹C must be invertible.

If A and D are both invertible, then:

${\displaystyle {\begin{bmatrix}\mathbf {A} &\mathbf {B} \\\mathbf {C} &\mathbf {D} \end{bmatrix}}^{-1}={\begin{bmatrix}\left(\mathbf {A} -\mathbf {B} \mathbf {D} ^{-1}\mathbf {C} \right)^{-1}&\mathbf {0} \\\mathbf {0} &\left(\mathbf {D} -\mathbf {C} \mathbf {A} ^{-1}\mathbf {B} \right)^{-1}\end{bmatrix}}{\begin{bmatrix}\mathbf {I} &-\mathbf {B} \mathbf {D} ^{-1}\\-\mathbf {C} \mathbf {A} ^{-1}&\mathbf {I} \end{bmatrix}}.}$

By the Weinstein–Aronszajn identity, one of the two matrices in the block-diagonal matrix is invertible exactly when the other is.

The formula for the determinant of a ${\displaystyle 2\times 2}$-matrix above continues to hold, under appropriate further assumptions, for a matrix composed of four submatrices ${\displaystyle A,B,C,D}$. The easiest such formula, which can be proven using either the Leibniz formula or a factorization involving the Schur complement, is

${\displaystyle \det {\begin{pmatrix}A&0\\C&D\end{pmatrix}}=\det(A)\det(D)=\det {\begin{pmatrix}A&B\\0&D\end{pmatrix}}.}$

Using this formula, we can derive that characteristic polynomials of ${\displaystyle {\begin{pmatrix}A&0\\C&D\end{pmatrix}}}$ and ${\displaystyle {\begin{pmatrix}A&B\\0&D\end{pmatrix}}}$ are same and equal to the product of characteristic polynomials of ${\displaystyle A}$ and ${\displaystyle D}$. Furthermore, If ${\displaystyle {\begin{pmatrix}A&0\\C&D\end{pmatrix}}}$ or ${\displaystyle {\begin{pmatrix}A&B\\0&D\end{pmatrix}}}$ is diagonalizable, then ${\displaystyle A}$ and ${\displaystyle D}$ are diagonalizable too. The converse is false; simply check ${\displaystyle {\begin{pmatrix}1&1\\0&1\end{pmatrix}}}$.

If ${\displaystyle A}$ is invertible (and similarly if ${\displaystyle D}$ is invertible[7]), one has

${\displaystyle \det {\begin{pmatrix}A&B\\C&D\end{pmatrix}}=\det(A)\det \left(D-CA^{-1}B\right).}$

If ${\displaystyle D}$ is a ${\displaystyle 1\times 1}$-matrix, this simplifies to ${\displaystyle \det(A)(D-CA^{-1}B)}$.

If the blocks are square matrices of the same size further formulas hold. For example, if ${\displaystyle C}$ and ${\displaystyle D}$ commute (i.e., ${\displaystyle CD=DC}$), then

${\displaystyle \det {\begin{pmatrix}A&B\\C&D\end{pmatrix}}=\det(AD-BC).}$[8]

This formula has been generalized to matrices composed of more than ${\displaystyle 2\times 2}$ blocks, again under appropriate commutativity conditions among the individual blocks.[9]

For ${\displaystyle A=D}$ and ${\displaystyle B=C}$, the following formula holds (even if ${\displaystyle A}$ and ${\displaystyle B}$ do not commute)

${\displaystyle \det {\begin{pmatrix}A&B\\B&A\end{pmatrix}}=\det(A-B)\det(A+B).}$

A block diagonal matrix is a block matrix that is a square matrix such that the main-diagonal blocks are square matrices and all off-diagonal blocks are zero matrices. That is, a block diagonal matrix A has the form

${\displaystyle \mathbf {A} ={\begin{bmatrix}\mathbf {A} _{1}&\mathbf {0} &\cdots &\mathbf {0} \\\mathbf {0} &\mathbf {A} _{2}&\cdots &\mathbf {0} \\\vdots &\vdots &\ddots &\vdots \\\mathbf {0} &\mathbf {0} &\cdots &\mathbf {A} _{n}\end{bmatrix}}}$

where A_k is a square matrix for all k = 1, ..., n. In other words, matrix A is the direct sum of A₁, ..., A_n. It can also be indicated as A₁ ⊕ A₂ ⊕ ... ⊕ A_n or diag(A₁, A₂, ..., A_n)  (the latter being the same formalism used for a diagonal matrix). Any square matrix can trivially be considered a block diagonal matrix with only one block.

For the determinant and trace, the following properties hold

${\displaystyle {\begin{aligned}\det \mathbf {A} &=\det \mathbf {A} _{1}\times \cdots \times \det \mathbf {A} _{n},\\\operatorname {tr} \mathbf {A} &=\operatorname {tr} \mathbf {A} _{1}+\cdots +\operatorname {tr} \mathbf {A} _{n}.\end{aligned}}}$

A block diagonal matrix is invertible if and only if each of its main-diagonal blocks are invertible, and in this case its inverse is another block diagonal matrix given by

${\displaystyle {\begin{bmatrix}\mathbf {A} _{1}&\mathbf {0} &\cdots &\mathbf {0} \\\mathbf {0} &\mathbf {A} _{2}&\cdots &\mathbf {0} \\\vdots &\vdots &\ddots &\vdots \\\mathbf {0} &\mathbf {0} &\cdots &\mathbf {A} _{n}\end{bmatrix}}^{-1}={\begin{bmatrix}\mathbf {A} _{1}^{-1}&\mathbf {0} &\cdots &\mathbf {0} \\\mathbf {0} &\mathbf {A} _{2}^{-1}&\cdots &\mathbf {0} \\\vdots &\vdots &\ddots &\vdots \\\mathbf {0} &\mathbf {0} &\cdots &\mathbf {A} _{n}^{-1}\end{bmatrix}}.}$

The eigenvalues and eigenvectors of ${\displaystyle \mathbf {A} }$ are simply those of the ${\displaystyle \mathbf {A} _{k}}$s combined.

A block tridiagonal matrix is another special block matrix, which is just like the block diagonal matrix a square matrix, having square matrices (blocks) in the lower diagonal, main diagonal and upper diagonal, with all other blocks being zero matrices. It is essentially a tridiagonal matrix but has submatrices in places of scalars. A block tridiagonal matrix A has the form

${\displaystyle \mathbf {A} ={\begin{bmatrix}\mathbf {B} _{1}&\mathbf {C} _{1}&&&\cdots &&\mathbf {0} \\\mathbf {A} _{2}&\mathbf {B} _{2}&\mathbf {C} _{2}&&&&\\&\ddots &\ddots &\ddots &&&\vdots \\&&\mathbf {A} _{k}&\mathbf {B} _{k}&\mathbf {C} _{k}&&\\\vdots &&&\ddots &\ddots &\ddots &\\&&&&\mathbf {A} _{n-1}&\mathbf {B} _{n-1}&\mathbf {C} _{n-1}\\\mathbf {0} &&\cdots &&&\mathbf {A} _{n}&\mathbf {B} _{n}\end{bmatrix}}}$

where A_k, B_k and C_k are square sub-matrices of the lower, main and upper diagonal respectively.

Block tridiagonal matrices are often encountered in numerical solutions of engineering problems (e.g., computational fluid dynamics). Optimized numerical methods for LU factorization are available and hence efficient solution algorithms for equation systems with a block tridiagonal matrix as coefficient matrix. The Thomas algorithm, used for efficient solution of equation systems involving a tridiagonal matrix can also be applied using matrix operations to block tridiagonal matrices (see also Block LU decomposition).

A block Toeplitz matrix is another special block matrix, which contains blocks that are repeated down the diagonals of the matrix, as a Toeplitz matrix has elements repeated down the diagonal.

A block Toeplitz matrix A has the form

${\displaystyle \mathbf {A} ={\begin{bmatrix}\mathbf {A} _{(1,1)}&\mathbf {A} _{(1,2)}&&&\cdots &\mathbf {A} _{(1,n-1)}&\mathbf {A} _{(1,n)}\\\mathbf {A} _{(2,1)}&\mathbf {A} _{(1,1)}&\mathbf {A} _{(1,2)}&&&&\mathbf {A} _{(1,n-1)}\\&\ddots &\ddots &\ddots &&&\vdots \\&&\mathbf {A} _{(2,1)}&\mathbf {A} _{(1,1)}&\mathbf {A} _{(1,2)}&&\\\vdots &&&\ddots &\ddots &\ddots &\\\mathbf {A} _{(n-1,1)}&&&&\mathbf {A} _{(2,1)}&\mathbf {A} _{(1,1)}&\mathbf {A} _{(1,2)}\\\mathbf {A} _{(n,1)}&\mathbf {A} _{(n-1,1)}&\cdots &&&\mathbf {A} _{(2,1)}&\mathbf {A} _{(1,1)}\end{bmatrix}}.}$

A special form of matrix transpose can also be defined for block matrices, where individual blocks are reordered but not transposed. Let ${\displaystyle A=(B_{ij})}$ be a ${\displaystyle k\times l}$ block matrix with ${\displaystyle m\times n}$ blocks ${\displaystyle B_{ij}}$, the block transpose of ${\displaystyle A}$ is the ${\displaystyle l\times k}$ block matrix ${\displaystyle A^{\mathcal {B}}}$ with ${\displaystyle m\times n}$ blocks ${\displaystyle \left(A^{\mathcal {B}}\right)_{ij}=B_{ji}}$.[10]

As with the conventional trace operator, the block transpose is a linear mapping such that ${\displaystyle (A+C)^{\mathcal {B}}=A^{\mathcal {B}}+C^{\mathcal {B}}}$. However, in general the property ${\displaystyle (AC)^{\mathcal {B}}=C^{\mathcal {B}}A^{\mathcal {B}}}$ does not hold unless the blocks of ${\displaystyle A}$ and ${\displaystyle C}$ commute.

For any arbitrary matrices A (of size m × n) and B (of size p × q), we have the direct sum of A and B, denoted by A ${\displaystyle \oplus }$ B and defined as

${\displaystyle \mathbf {A} \oplus \mathbf {B} ={\begin{bmatrix}a_{11}&\cdots &a_{1n}&0&\cdots &0\\\vdots &\ddots &\vdots &\vdots &\ddots &\vdots \\a_{m1}&\cdots &a_{mn}&0&\cdots &0\\0&\cdots &0&b_{11}&\cdots &b_{1q}\\\vdots &\ddots &\vdots &\vdots &\ddots &\vdots \\0&\cdots &0&b_{p1}&\cdots &b_{pq}\end{bmatrix}}.}$

For instance,

${\displaystyle {\begin{bmatrix}1&3&2\\2&3&1\end{bmatrix}}\oplus {\begin{bmatrix}1&6\\0&1\end{bmatrix}}={\begin{bmatrix}1&3&2&0&0\\2&3&1&0&0\\0&0&0&1&6\\0&0&0&0&1\end{bmatrix}}.}$

This operation generalizes naturally to arbitrary dimensioned arrays (provided that A and B have the same number of dimensions).

Note that any element in the direct sum of two vector spaces of matrices could be represented as a direct sum of two matrices.

In linear algebra terms, the use of a block matrix corresponds to having a linear mapping thought of in terms of corresponding 'bunches' of basis vectors. That again matches the idea of having distinguished direct sum decompositions of the domain and range. It is always particularly significant if a block is the zero matrix; that carries the information that a summand maps into a sub-sum.

Given the interpretation via linear mappings and direct sums, there is a special type of block matrix that occurs for square matrices (the case m = n). For those we can assume an interpretation as an endomorphism of an n-dimensional space V; the block structure in which the bunching of rows and columns is the same is of importance because it corresponds to having a single direct sum decomposition on V (rather than two). In that case, for example, the diagonal blocks in the obvious sense are all square. This type of structure is required to describe the Jordan normal form.

This technique is used to cut down calculations of matrices, column-row expansions, and many computer science applications, including VLSI chip design. An example is the Strassen algorithm for fast matrix multiplication, as well as the Hamming(7,4) encoding for error detection and recovery in data transmissions.

The technique can also be used where the elements of the A,B,C, and D matrices do not all require the same field for their elements. For example, The matrix A can be over the field of complex numbers, while the matrix D can be over the field of real numbers. This can lead to valid operations involving the matrices, while simplifying the operations within one of the matrices. For example, if D has only real elements finding its inverse takes less calculations than if complex elements must be considered. But the reals is a subfield of the complex numbers (further it can be considered a projection), so the matrices operations can be well defined.

• Kronecker product (matrix direct product resulting in a block matrix)

• Strang, Gilbert (1999). "Lecture 3: Multiplication and inverse matrices". MIT Open Course ware. 18:30–21:10.