Scaled norm — where it appears
Named by 2 essays across 2 fields — each of them below, with the objects they name alongside it.
The units the matrix is measured in
One linear system, written twice. The rows of the second are the rows of the first in different units, the solution is identical to the last bit, and the condition number has moved by eight orders of magnitude. One of those two numbers is a fact about the problem and the other is a fact about the notation.
A norm that overflows before it is a norm
The vector of sixteen thousands has a Euclidean norm of 4,000, which fp16 represents exactly. Written as the square root of the sum of squares it returns infinity, because squaring doubles the exponent — and the expression costs half the format's range on the one computation every iterative method performs at every step.
Named alongside it
The objects these essays reach for when they reach for this one.
bfloat16Catastrophic cancellationComponentwise condition numberCondition numberDynamic rangeEquilibrationExact ground truthForward errorHalf precisionHilbert matrixhypotOverflow