Numerical Linear Algebra
where the algebra stops being the arithmetic
Concept

Schur form — where it appears

The triangular matrix — block triangular, over the reals — that an orthogonal similarity reduces any matrix to. Its diagonal carries the eigenvalues, and the reduction is what a practical eigenvalue routine returns instead of a diagonalisation.

Named by 2 essays across 2 fields — each of them below, with the objects they name alongside it.

first · leading5.47·10⁻⁶first · trailing4.62·10⁻⁵second · leading4.27·10⁻⁵second · trailing2.23·10⁻⁴symmetric · leading5.47·10⁻⁶symmetric · trailing4.05·10⁻⁵all six are the same algebrabest route5.5·10⁻⁶worst route2.2·10⁻⁴spread across the six41condition of the linearisation8.3·10¹²the spectra agreeand the arithmetic does not

Six routes to one spectrum

Three linearisations of one quadratic, each reduced to a standard eigenvalue problem two ways. All six have exactly the same eigenvalues in exact arithmetic. On a well-scaled problem they differ by noise; on a badly scaled one by a factor of forty; and two of the six are the same matrix.

polynomial · linearisation backward error 01234567810⁻⁵10⁻⁴10⁻³10⁻²10⁻¹110¹μ, the entry above the diagonalsep, and the eigenvalue gapmin |λᵢ + μⱼ|sep(A, B)the spectra never moveeigenvalue gap, throughout2sep at μ = 02sep at μ = 89.5·10⁻⁴amplification there1056solvability is the eigenvaluesand conditioning is not

An equation whose unknown is a matrix

AX + XB = C is linear in X, so it has a coefficient matrix, and writing it down is the obvious thing to do. At n = 100 that matrix has a hundred million entries for a problem with ten thousand unknowns, and the algorithm everybody uses instead never forms it. Its conditioning is not the eigenvalue gap either, which is the number a reader is invited to consult.

structure · matrix equation

Named alongside it

The objects these essays reach for when they reach for this one.

Condition numberBack-substitutionBackward errorCompanion formEigenvaluesFlop countKronecker productLinearisationMatrix equationMatrix polynomialNon-normalityQuadratic eigenvalue problem

All concepts