Numerical Linear Algebra
where the algebra stops being the arithmetic
Concept

Weyl's inequality — where it appears

The bound saying that a perturbation moves each eigenvalue of a symmetric matrix by at most the perturbation's norm. It is why symmetry is worth more than precision here: no condition number multiplies the perturbation.

Named by 2 essays across one field — each of them below, with the objects they name alongside it.

10⁻¹⁶10⁻¹³10⁻¹⁰10⁻⁷10⁻⁴10⁻¹10⁻¹⁶10⁻¹³10⁻¹⁰10⁻⁷10⁻⁴10⁻¹size of the perturbation ‖δA‖how far the eigenvalues moveJordan block, ε^(1/8)symmetric, ≤ ‖δA‖rounding error alone moves it to 10⁻²six seeds per symmetric point; Jordan is closed formsymmetry beats precision

Symmetry is worth more than precision

A symmetric matrix gives up its eigenvalues to full accuracy however ill-conditioned it is. An unsymmetric one can move them by the eighth root of a perturbation, so the rounding involved in merely storing the matrix shifts the spectrum by a hundredth.

spectra · Eigen conditioning 10⁻⁹10⁻⁷10⁻⁵10⁻³10⁻⁸10⁻⁵10⁻²gap between the two eigenvalueshow far it movedthe eigenvectorsthe eigenvaluestheir plane‖E‖ / gapone perturbation, three answerseigenvalue shift, spread over the sweep1plane angle, spread over the sweep1eigenvector angle, spread1.6·10⁵the dashed line is Davis–Kahan's ‖E‖/gaptwo of the three never noticed

The gap decides the eigenvector

A symmetric matrix's eigenvalues move by at most the size of the perturbation, whatever the spectrum looks like. Its eigenvectors are governed by a completely different quantity — the distance to the neighbouring eigenvalue — and at a gap of 10⁻⁹ the same perturbation turns them through 27°.

spectra · Eigen conditioning

Named alongside it

The objects these essays reach for when they reach for this one.

PerturbationCondition numberDavis kahanEigenvalue gapEigenvalue sensitivityEigenvector conditioningJacobi's eigenvalue methodNon-normalityOrthogonalityPrincipal anglesSingular valuesSymmetric eigenproblem

All concepts