Numerical Linear Algebra
where the algebra stops being the arithmetic
Concept

Mixed precision — where it appears

Running different parts of one computation in different formats, on the argument that not every part needs the accuracy of the answer.

Named by 2 essays across 2 fields — each of them below, with the objects they name alongside it.

21018263442500102030405060708090100110120130140150160170180190200210220230240250260270280290300310320330340significand bitsiterationspreconditioner roundedarithmetic roundedno preconditionersame bits, different casualtyerror, 3-bit preconditioner8.8·10⁻¹³error, 3-bit arithmetic0.16‖A − LLᵀ‖/‖A‖ of the factor0.083a direction may be roundeda measurement may not

The part of a solver that may be rounded

A preconditioner computed and applied with a three-bit significand still returns thirteen correct digits — it costs seventeen extra iterations and nothing else. Round the working arithmetic instead and the step count barely moves while the answer loses exactly the digits the format dropped.

combination · mixed precision 012345610⁻¹⁶10⁻¹³10⁻¹⁰10⁻⁷10⁻⁴10⁻¹refinement step‖x − x*‖ / ‖x*‖a full double-precision solveresidual in24-bitresidual indoubleone argument apartκ·u of the factorisation6·10⁻⁴double residual, final3.2·10⁻¹³same-precision, final1.3·10⁻⁴30×30, κ = 10⁴, same factors in both runsidentical cost

Buying the accuracy back

Factorise in single precision, then correct the answer using residuals computed in double, and the result is what a full double-precision solve would have given. Compute those residuals in single instead and the identical algorithm, at identical cost, recovers nothing.

arithmetic · mixed precision

Named alongside it

The objects these essays reach for when they reach for this one.

Forward errorResidualBackward errorCatastrophic cancellationConjugate gradientsHalf precisionIncomplete choleskyIterative refinementPerturbationPreconditioningStopping criterionUnit roundoff

All concepts