The collection

Every essay — page 18

Essays 409 to 432 of 586, in the same order.

Exact arithmetic, and what it costs instead

An integer matrix eliminated over the rationals commits no rounding anywhere, so the forward error is zero, the residual is the zero vector, and the identity the rest of this site is built on has nothing left to say. The cost does not disappear with the error — it moves into the length of the numbers, where three eliminations returning the same integer differ by four orders of magnitude in the widest one they form. What is left to decide is which route pays: divide by the previous pivot and stay in the integers, reduce every fraction and pay a gcd per operation, or work modulo primes where nothing can grow and put the answer back together afterwards.

3456789101110²10³nbitsthe answerthe question · det Abits in, bits outn11question484answer729det A33widest part37the answer is the floorand no route writes it down more cheaply

The answer is longer than the question

An exact solution of an integer system is a vector of fractions, each of them a ratio of two determinants.

6 figures · Exact cost, essay 2
34567891011110¹10²nbitsthe budget and what it buysrandom, bound47random, actual33primes needed2Hadamard n = 8, bound13Hadamard n = 8, actual13the count is decided by a theorembefore any arithmetic happens

How many primes the answer needs

Work modulo a word-sized prime and no intermediate can exceed twenty-six bits, whatever the matrix does.

7 figures · Modular lift, essay 1
det mod p, as a fraction of p3713a prime that divides the answerdet A3·10⁴primes swept25unlucky5rate0.2det, in bits15singular mod p is not singularand one residue cannot tell them apart

A prime that divides the answer

A modular elimination reports a singular matrix and is telling the truth — over the field with p elements the matrix is singular.

10 figures · Modular lift, essay 2
2^18modulus, as a power of twoa lattice with one short vectornumerator355denominator1132·max(n, d)², bits18first recovered at18moduli tried42below the bound there are two answersand the algorithm cannot prefer one

A fraction recovered from one remainder

A solution over the rationals can be computed modulo a prime power and then recovered — the residue determines the fraction uniquely, but only once the modulus is twice the square of the fraction's longer part.

4 figures · Modular lift, essay 3
ℚ6𝔽24𝔽35𝔽56𝔽76𝔽116𝔽136𝔽1016𝔽655376rank, by the ring the entries are read inthe rank of one matrixover ℚ6over 𝔽24over 𝔽35over 𝔽56over 𝔽76nothing is rounded hereand the answer still is not a property of the matrix

The rank depends on the ring

A floating-point rank is a decision about a threshold.

6 figures · Exact rank, essay 1
s10 bitss20 bitss30 bitss40 bitss514 bitsinvariant factors, in bitstwo routes, and a conserved quantitydet A-2.3·10⁴Π invariants2.3·10⁴SNF widest15HNF widest24det of the transform-1an algorithm and a definitionagreeing as integers

What a determinant does not determine

Two integer matrices can have the same determinant, the same rank and the same size, and define genuinely different maps.

3 figures · Normal forms, essay 1
the same lattice, twicewhat the reduction may not changedet, before1det, after1defect, before7.1defect, after1LLL steps1the determinant is the invariantand the defect is what is being reduced

A basis that describes its lattice badly

The same set of points has infinitely many bases, they are all correct, and they are not equally useful.

3 figures · Lattice reduction, essay 1
10⁻¹⁶10⁻¹⁴10⁻¹²10⁻¹⁰10⁻⁸10⁻⁶10⁻⁴10⁻²110⁻⁷10⁻⁵10⁻³10⁻¹10¹relative error in the datarelative error in the answerthe answer's errorthe data's errornothing here is the arithmetic'sdata error10⁻¹²answer error10·10⁻⁴amplification10·10⁸rounding committed0residual0the residual is exactly zeroand the answer is wrong anyway

An exact answer to a measured problem

The residual is the zero vector, nothing was rounded at any step, and the answer is wrong in its first digit.

7 figures · Exact cost, essay 3
4914192429343900.20.40.60.81decimal digits of the numbers the lattice is givenshare of trials recovering the relationa double has about this many digitsnumbers that are exactthe same numbers, measureda window with two edgescoefficients up to30exact, at 12 digits1exact, at 401doubles, at 121doubles, at 250doubles, at 400.13one edge is the relationand the other is the data

A relation among digits that were not there

A lattice finds the exact integer combination of several numbers that vanishes, and it needs enough digits of them to do it.

6 figures · Lattice reduction, essay 4
10¹110¹skew of the starting basisdistance ÷ the distance to the nearest pointthe nearest lattice pointdashes: the skewed basis's orthogonality defectrounding in the skewed basisrounding in the reduced basisthe same three lines of arithmeticskew40defect there40worst, skewed40mean, skewed26mean, reduced1exact share, skewed0one lattice, one targetand two descriptions

Rounding a coordinate in the wrong basis

The nearest lattice point is found by writing the target in the basis and rounding each coordinate, which is three lines of arithmetic and is wrong.

6 figures · Lattice reduction, essay 2
38434853586368110¹10²10³10⁴e, where the skew is 2ᵉ + 12345orthogonality defect of the basis returneda double holds k exactlyan orthogonal basisthe invariant sees none of itfloat, at 2^521float, at 2^531.4float, at 2^701.2·10⁴residue at 2^701.2·10⁴exact, everywhere1determinant, always1every step was unimodularand the answer is 12,345 times worse

The knob and the rounding

The Lovász parameter is the number a lattice reduction is specified by, and moving it from 0.50 to 0.99 strengthens the proved bound from 16.00 to 1.83, costs 91 per cent more steps, and returns a basis with the same orthogonality defect.

6 figures · Lattice reduction, essay 3
10×10, ±6determinant, bits27Hadamard's bound36median slack10024680510152025303540elimination stepbitsHadamard, on the minorsthe intermediatesevery intermediate is a minor of the originalso a bound on the minors bounds the run

A bound on every intermediate at once

Fraction-free elimination's intermediates are minors of the original, which is a theorem about exactness.

6 figures · Fraction-free, essay 2
20 matricespeak, every rule29the determinant's own length29area, smallest ÷ natural0.9602468051015202530elimination stepbits, longest entrythe determinant: 29 bitsswap only on a zerolargest pivotsmallest nonzero pivotthree orders, three sequences of minorsand one last entry they all arrive at

Three orders and one last entry

Over the integers there is no stability to pivot for, so a fraction-free elimination swaps rows only when the pivot is zero.

6 figures · Fraction-free, essay 3
4 numbers, coefficients to 30found relations72with a gap of a digit or more54accidents56accidents with that gap05101520253001234decimal digits the numbers are scaled togap, in digitsexact relation foundnot a relationthe room a relation hashorizontal: a gap of one digitdashed vertical: the digits a double has

The room a relation has to stand out

A lattice search for an integer relation returns its shortest vector, and the proposal was to return the gap to the next one as well, so a caller could tell a relation from an accident.

6 figures · Lattice reduction, essay 5
6 numbers, coefficients to 30relations, both agree34relations, they differ1accidents, both agree5accidents, they differ88510152025300123decimal digits the numbers are scaled togap, in digitsrelation, both agreerelation, they differaccident, both agreeaccident, they differhorizontal: a gap of one digitdashed vertical: the digits a double has

Two precisions guard the other edge

Run a lattice relation search at N digits and again at N/10, and accept its answer only if both runs return the same vector.

5 figures · Lattice reduction, essay 6
largest pivot, area1.037largest pivot, cost1.293smallest pivot, area0.969smallest pivot, cost0.704shortest row, original, area0.966shortest row, original, cost0.841shortest row, current, area0.964shortest row, current, cost0.760over the natural order: below one is cheaperthe rules agree on area and part on cost

The pivot is in every product

A fraction-free elimination's intermediates are minors, and Hadamard bounds a minor by the lengths of the rows it is made of — so the rule that picks the smallest pivot entry looked like a proxy for a rule that picks the shortest row.

6 figures · Fraction-free, essay 4
pooled over every settingaccidents, one digit apart62accidents, three digits apart5relations lost on the way109110¹10²10³digits between the two searchesruns123relations keptaccidents acceptedlogarithmic vertical axiseach digit apart divides the accidents by three or four

The digits between the two searches

A lattice relation search run at N digits and again at N/10 never agrees with itself on a relation among the rounding, but it does agree on 62 approximate relations at fifteen digits or fewer — accidents that really are the shortest vector there, and that dropping a digit was said to be unable to dislodge, since a combination that cancels to D digits cancels to D − 1.

5 figures · Lattice reduction, essay 7
1.001.251.501.752.002.252.50cost ÷ the least any row order reachesnatural order1.733 · worst 2.41 · least on 0smallest pivot1.199 · worst 1.61 · least on 0cheapest step1.187 · worst 1.57 · least on 1two pivots ahead1.025 · worst 1.87 · least on 8three pivots ahead1.000 · worst 1.27 · least on 13smallest, then next1.217 · worst 1.89 · least on 0two ahead, estimated1.160 · worst 1.87 · least on 2bar: median · whisker: worst of twenty-fourthree pivots ahead finds the least on thirteen

What reading the next pivot buys

In a fraction-free elimination every pivot is paid for twice — it multiplies every entry of its own step and divides every entry of the next — and the rule that picks the smallest pivot entry left a median 20 per cent above the least arithmetic any row order reaches.

5 figures · Fraction-free, essay 5
invertible sharerationals, n = 201𝔽₂, n = 200.29𝔽₃, n = 200.56𝔽₅, n = 200.74𝔽₇, n = 200.83246810121416182000.20.40.60.81size nshare invertibleover rationalsover 𝔽₂over 𝔽₃over 𝔽₅over 𝔽₇dashed: a matrix uniform over the fieldthe fields part company as n grows

The field decides it, usually

A matrix whose rank depends on the field it is read over was built, the first time, from its invariant factors outward, because random integer matrices never seemed to show the effect.

6 figures · Exact rank, essay 2
1.01.21.41.61.82.0median member's cost over the least any row order reachesindependent entriesa shared zero patternshared row scalesone matrix, two entries redrawnnatural order1.60the median order1.72another member's best1.54best over the other eleven1.46rows by their norms1.49smallest pivot entry1.24natural order1.65the median order1.72another member's best1.59best over the other eleven1.36rows by their norms1.35smallest pivot entry1.08natural order1.88the median order1.86another member's best1.13best over the other eleven1.16rows by their norms1.05smallest pivot entry1.01natural order1.28the median order1.51another member's best1.16best over the other eleven1.07rows by their norms1.42smallest pivot entry1.14dashed: the least cost of all 40,320 ordersthe rule wins wherever the rows show why

An order found once knows what the rows know

Searching for a fraction-free elimination's least-cost row order costs forty to two hundred and sixty times the elimination, so it can only pay if one order serves a whole family.

5 figures · Fraction-free, essay 6
10¹10²10³10⁴nwidest entry, bits48163264plain: the formplain: the transformplain: finished transformmodular: before reductionmodular: stored|det A|at n = 80: 13835 bits against 390the determinant bounds everything modulo itself

Every entry under the determinant

The Hermite form's swell was put down to its transform — the record of how the answer was reached — while the form's own entries stayed bounded.

5 figures · Normal forms, essay 2
10³10⁵10⁷10⁹10¹¹size nbit operations48163264modular Hermitemodular Smithplain Hermiteplain Smithschoolbook bit operations, independent of the machinebounded is not cheaper

The swell was one-sided

The Smith form can be computed modulo the determinant, and it was predicted to return the right invariant factors, to stay within twice the determinant's width, and to cost about what the modular Hermite form costs instead of the far larger count of the plain Smith routine.

5 figures · Normal forms, essay 3
012345610⁻⁴10⁻³10⁻²10⁻¹1extra columnsshare losing rank modulo qmodulo 2modulo 3modulo 5modulo 7twenty rows · dashed: the uniform law · floored at 10⁻⁴each column divides by q

Each column divides by the prime

Square random 0/1 matrices are almost always invertible over the rationals and invertible modulo a small prime only at that field's uniform law — so at twenty rows, 72% of the rationally invertible ones are singular modulo two.

5 figures · Exact rank, essay 3
8910111213141516171819202100.10.20.30.40.50.6ordershare invertible modulo twograph adjacencywith random loopsgeneral 0/1dashed: symmetric law · dotted: uniform lawzero at every odd order

A graph is alternating modulo two

Random 0/1 matrices are invertible modulo two at the uniform law's rate, 0.289, and a random graph's adjacency matrix was predicted to follow the symmetric law instead, about 0.42.

5 figures · Exact rank, essay 4