Neither sparse nor dense

Separated, and narrower

The cos(κr)/r block between two facing segments has a rank that turns linear in the Fresnel number with a slope near 1.4, not the 1.9 of a real kernel's two directions, because the band of directions the source is seen over overlaps its own reflection through zero. Shift the source along its line until the target sees it entirely to one side, and the bands were predicted to separate and the slope to rise to 1.9, the change happening near half a segment's length. The bands do separate: from an offset of one length the union is exactly twice the band. But the band has narrowed by the same factor, because the source is now seen obliquely, and the separated union is no wider than the overlapping one was. The rank's slope is 1.58 at one length, 1.67 at its steepest between a half and three quarters, and 0.92 at two lengths. At every offset it runs 0.1 to 0.2 above the union's slope: the phase-space count tracks it, and the count was never going to double.

Worth reading first: A block nobody can call sparse.

A line at the real kernel’s slope settled how the rank of an oscillatory interaction block grows once the two clusters are many wavelengths across. The block is the cos(κr)/r kernel sampled between two equal parallel segments at the separation a hierarchical matrix calls admissible. Past a Fresnel number F=κab/(2πD)F = \kappa ab/(2\pi D) of about 16 its rank at 10−810^{-8} is a straight line in FF, with a slope of 1.4 to 1.6. That was below the prediction of two, one family of waves for each direction a real kernel travels in, and the essay found why. At each point of the target the source is seen over a band of directions; the block’s columns oscillate there at local frequencies κsin⁡θ\kappa\sin\theta across that band. A complex kernel eiκre^{i\kappa r} needs one band, a real one needs the band and its reflection through zero — and when the segments face each other the two overlap in the middle of the target. The rank counts their union, 1.40F1.40F, not their sum, 1.89F1.89F.

That essay ended by naming the geometry that should remove the overlap. “For two equal segments offset along their own line so that the target sees the source entirely to one side, the outgoing and incoming bands never overlap. The prediction with a sign is that such a block’s rank, at the same FF, follows twice the complex count — a slope near 1.9 rather than 1.4 — and that the change from one slope to the other happens as the offset carries the band past zero, at an offset of about half the segment length.”

The bands separate as predicted. The slope does not follow them, and the reason is in the same picture the prediction drew.

The same block, slid sideways

Everything is the earlier construction: segments of equal length aa at the admissible separation D=2aD = 2a, twelve samples a wavelength, wavenumber 40, ranks counted from a randomised range finder at 10−810^{-8}. The only change is that the source segment is shifted along its own line by s as\,a, for ss from 0 to 2, so that at s=1s = 1 the source’s near end is level with the target’s far end and every line from target to source leans the same way. The Fresnel number keeps its definition through the perpendicular separation, so a given FF is the same pair of segments at every offset.

The slope of the oscillatory block's rank from F = 24 to 48 against how far the source segment is shifted along its line, with the slopes of the union of the frequency band and its reflection and of twice the bandrank: 1.542 at 0, 1.583 at 0.25, 1.667 at 0.5, 1.667 at 0.75, 1.583 at 1, 1.250 at 1.5, 0.917 at 2; union of the bands: 1.396 at 0, 1.423 at 0.25, 1.508 at 0.5, 1.542 at 0.75, 1.425 at 1, 1.052 at 1.5, 0.739 at 2; twice the band: 1.889 at 0, 1.853 at 0.25, 1.754 at 0.5, 1.604 at 0.75, 1.425 at 1, 1.052 at 1.5, 0.739 at 2. The prediction was 1.89 from an offset of half a length.00.511.520.50.7511.251.51.752offset, segment lengthsslope per unit of Fthe predicted 1.89rankunion of the bandstwice the bandslopes from F = 24 to 48the band narrows as it separates
Fig. 1 The rank’s slope per unit of FF, from F=24F = 24 to 48, against the offset in segment lengths (red), with the slopes of the union of the frequency band and its reflection (blue) and of twice the band (dotted); the dashed line is the predicted 1.89.

The rank’s slope is 1.54 centred, 1.58 at a quarter of a length, 1.67 at a half and three quarters, 1.58 again at one length, 1.25 at one and a half and 0.92 at two. It never comes near 1.89. It rises by a twelfth between centred and its peak and then falls below where it started. The union’s slope — the phase-space count of the earlier essay, computed for each offset — runs below it at every offset by 0.12 to 0.18, and has the same shape.

The band and its reflection

The phase-space picture shows what the prediction saw and what it did not.

At F = 32, over the target segment, the band of directions sin θ from which the source is seen, and its reflection through zero, for a source facing the target and for one shifted along its line by a segment lengthcentred: the band runs from -0.24 to 0.24 at the target's centre; band area 30.2, union with the reflection 44.7, in wave counts at F = 32; offset by one length: the band runs from 0.24 to 0.60 at the target's centre; band area 22.8, union with the reflection 45.6, in wave counts at F = 32.centred−101position on the targetoffset by one length−101position on the targetsin θred: the band · green: its reflectionthe overlap is the centred block's discountapart, and thinner
Fig. 2 At F=32F = 32, over the target segment, the band of directions sin⁡θ\sin\theta from which the source is seen (red) and its reflection through zero (green), for the facing source and for the source shifted by one length.

Facing, the band runs from −0.24-0.24 to 0.240.24 at the target’s centre, crossing zero, and its reflection covers almost the same strip; over the middle of the target the two coincide, and the union is three quarters of their sum. Shifted by a length, the band sits wholly above zero — from 0.24 to 0.60 at the target’s centre — and its reflection wholly below, and the union is exactly the sum, twice the band. That much of the prediction is exactly true.

What the picture also shows is the band’s width. Facing, it spans almost half the range of sin⁡θ\sin\theta; shifted, it is thinner, because the source is seen obliquely: sin⁡θ=t/t2+D2\sin\theta = t/\sqrt{t^2 + D^2} is steep near zero and flat towards one, and a segment of the same length seen from the side subtends a smaller range of sines than one seen head-on. The band’s area — the complex kernel’s count of independent waves — falls from 0.94 per unit of FF facing to 0.71 at one length and 0.37 at two.

The narrowing is a matter of the sine’s slope. A source point at horizontal offset tt from a target point, at height DD, is seen at sin⁡θ=t/t2+D2\sin\theta = t/\sqrt{t^2 + D^2}, whose rate of change with tt is D2/(t2+D2)3/2D^2/(t^2 + D^2)^{3/2}: largest at t=0t = 0 and falling as the point moves off to the side. A source facing the target is spread around t=0t = 0, where each unit of its length buys the most directions; a source a length to the side is spread over tt from a/2a/2 to 3a/23a/2 at the target’s centre, where the sine is flattening. The numbers at the centre of the target bear it out: facing, the source covers sines from −0.24-0.24 to 0.240.24, a width of 0.49; shifted by a length, from 0.24 to 0.60, a width of 0.36 — three quarters as wide, which is the ratio of the two blocks’ band areas, 0.71 to 0.94, to within the variation along the target.

The overlap was worth what the obliquity costs

At F = 32, the phase-space counts per unit of F against the source's offset: the complex kernel's band, the union of the band and its reflection, and twice the bandthe band: 0.944 at 0, 0.927 at 0.25, 0.877 at 0.5, 0.802 at 0.75, 0.713 at 1, 0.526 at 1.5, 0.370 at 2; union with reflection: 1.396 at 0, 1.423 at 0.25, 1.508 at 0.5, 1.542 at 0.75, 1.425 at 1, 1.052 at 1.5, 0.739 at 2; twice the band: 1.889 at 0, 1.853 at 0.25, 1.754 at 0.5, 1.604 at 0.75, 1.425 at 1, 1.052 at 1.5, 0.739 at 2.00.511.5200.511.52offset, segment lengthscount over Fthe bandunion with reflectiontwice the bandF = 32the union and twice meet at one length
Fig. 3 At F=32F = 32, the band’s area, its union with the reflection, and twice the band, each per unit of FF, against the offset.

The three counts tell the whole story between them. Twice the band starts at 1.89 and falls steadily as the source slides sideways. The union starts at 1.40, below twice the band by the overlap; it rises a little as the overlap shrinks, to 1.54 at three quarters of a length; and at one length, where the overlap is gone, it meets twice the band at 1.42 — almost exactly the facing union’s 1.40. Beyond that the two are the same curve, falling. Removing the overlap gains back what the overlap cost, and moving the source far enough to remove it costs, in obliquity, almost exactly as much.

The prediction’s error was to hold the band fixed while moving the source. In the earlier essay’s phrasing, the facing block’s discount from 1.89 to 1.40 was “the overlap”; it is equally true to say that a facing source is seen at the steepest part of the sine, where a given length of segment buys the most directions. Sliding it sideways trades one advantage for the other, and at one length the trade is nearly even.

The rank follows the count

The rank at ten to the minus eight of the cos(κr)/r block between two equal parallel segments, the source shifted along its line by 1 segment lengths, against the Fresnel number, with the phase-space counts and the centred block's rankOffset 1: ranks 31 at 8, 46 at 16, 60 at 24, 74 at 32, 98 at 48; union 11.4, 22.8, 34.2, 45.6, 68.4; twice the band 11.4, 22.8, 34.2, 45.6, 68.4. Centred: 25, 39, 51, 64, 88.offset 1 lengthsrank slope, 24 to 481.6union slope1.4twice the band1.481624324048020406080100120Fresnel number Frank at 10⁻⁸rank, this offsetrank, centredunion of the bandstwice the bandκ = 40, twelve samples a wavelengthseparated, and narrower
Fig. 4 The rank at 10−810^{-8} against FF with the source offset by the dial’s number of lengths (red), the facing block’s rank (open), the union count (blue) and twice the band (dotted).

At one length the rank is 31, 46, 60, 74 and 98 at FF = 8, 16, 24, 32 and 48, against the facing block’s 25, 39, 51, 64 and 88: a little more, at every FF, by 6 to 10 columns — not the 20 to 30 more that a slope of 1.9 would have given by F=48F = 48. The union count is 11.4 to 68.4, and the rank sits above it by a margin that is nearly fixed in columns rather than in proportion: 21 at F=48F = 48 facing, 30 at one length. Turn the dial to two lengths and the rank falls below the facing block’s at every FF from 16: 35, 44, 51 and 66 against 39, 51, 64 and 88. A block seen from far enough to the side is cheaper than a facing one, not dearer.

In proportion the offset matters most where the blocks are smallest. At F=8F = 8 the block a length to the side needs 31 columns to the facing block’s 25, a quarter more; at F=48F = 48, 98 to 88, a ninth more. The difference in columns stays between 6 and 10 while the ranks triple, which is what a margin that depends on the geometry but hardly on FF would do, and it means that for the small, near-diagonal blocks of a hierarchical matrix the side-on geometry is relatively dearer than the slope alone suggests.

The oscillatory block's rank over the union count against the Fresnel number, at each of seven offsets of the sourceoffset 0: 2.24 at 8, 1.75 at 16, 1.52 at 24, 1.43 at 32, 1.31 at 48; offset 0.25: 2.20 at 8, 1.76 at 16, 1.55 at 24, 1.45 at 32, 1.33 at 48; offset 0.5: 2.24 at 8, 1.78 at 16, 1.60 at 24, 1.49 at 32, 1.35 at 48; offset 0.75: 2.27 at 8, 1.86 at 16, 1.65 at 24, 1.52 at 32, 1.36 at 48; offset 1: 2.72 at 8, 2.02 at 16, 1.75 at 24, 1.62 at 32, 1.43 at 48; offset 1.5: 3.33 at 8, 2.49 at 16, 2.06 at 24, 1.84 at 32, 1.62 at 48; offset 2: 4.40 at 8, 2.96 at 16, 2.48 at 24, 2.16 at 32, 1.86 at 48.8162432404812345Fresnel number Frank over union countoffset 0offset 0.25offset 0.5offset 0.75offset 1offset 1.5offset 2rank at 10⁻⁸the margin over the count falls with F
Fig. 5 The rank over the union count against FF, at each of the seven offsets.

The ratio of the rank to the union count falls with FF at every offset — from 2.2 to 1.31 facing, from 2.7 to 1.43 at one length, from 4.4 to 1.86 at two — which is the earlier essays’ finding that the count is the slope and not the rank: the rank is the count plus a margin that grows only slowly, the edge of the band rounded off at the tolerance. A rank that is a number of digits measured that margin’s growth with the tolerance on a smooth kernel; here it is 21 to 32 columns at F=48F = 48, and larger the further the source sits to the side, because a narrow band at a grazing angle has proportionally more edge.

Turning the source instead

If the rank’s slope is the area of the directions’ union, it should follow that area under any change of geometry, not only a slide. The cleanest other change is a turn: keep the source’s centre where it was, facing the target’s, and rotate the segment about it, so that its band of directions stays centred on zero and only its width changes. Measured the same way, at 30, 60 and 90 degrees, the rank at F=24F = 24 and 48 is 51 and 88 facing, 52 and 87 at 30 degrees, 44 and 72 at 60, and 18 and 26 at 90, where the source points straight at the target and subtends almost nothing. The slopes are 1.54, 1.46, 1.17 and 0.33; the union count’s slopes are 1.40, 1.30, 0.88 and 0.25. A turn changes nothing about the overlap, which stays complete at the centre of the target, and everything about the width, and the rank follows the width. The margin over the count is 0.15, 0.16, 0.29 and 0.08: larger than for the slide at 60 degrees, where the band is narrowed unevenly along the target, but the same size, a small fraction of the slope.

So two geometries that move the rank in quite different ways — a slide that separates the bands and narrows them, and a turn that only narrows them — are both read correctly by one number computed without a single singular value. A block nobody can call sparse was the essay that first separated a block’s few singular values that matter from the many it has; the union count is a way to know how many matter from the geometry before the block is formed, and the test that costs what it saves is the reminder that any test deciding a partition has to be cheaper than the compression it guides. This one is a quadrature over the target, a few thousand evaluations of a sine.

At other tolerances

The slopes above are at 10−810^{-8}, and the earlier essays found the facing slope nearly independent of the tolerance; offset blocks were not checked there, so they were checked here, from the same sketched spectra. At 10−410^{-4} the slopes from centred to two lengths are 1.46, 1.46, 1.58, 1.58, 1.50, 1.13 and 0.83; at 10−610^{-6}, 1.50, 1.58, 1.58, 1.63, 1.54, 1.21 and 0.92. The shape is the same at every tolerance — a small rise to a peak between a half and three quarters, then a fall below the facing value — and the whole curve moves up a little as the tolerance tightens, because a tighter tolerance keeps more of the band’s rounded edge. At 10−1010^{-10}, the tightest the sketch resolves, the peak reaches 1.79 at half a length, the nearest any measurement here comes to the predicted 1.89, and it is reached where the bands still partly overlap rather than where they have separated.

That last point is the one worth keeping. Whatever the tolerance, the steepest block is not the one with separated bands; it is the one with bands that have mostly separated while the source is still seen nearly head-on. The prediction looked for the doubling at the far end of the slide, and the far end is where the slide costs most.

What the slope is a count of

The measurement replaces the prediction’s dichotomy — union or sum — with a single quantity that covers both: the area of the union of the band and its reflection over the target, in units of 2π2\pi. Facing, the union is less than the sum because the two overlap; sideways, the sum is less than it was because the band narrows; and the rank’s slope follows the union through both regimes to within 0.2 at every offset measured. The steepest geometry is neither of the prediction’s two cases but the one between them, half to three quarters of a length off-centre, where the overlap is mostly gone and the obliquity has not yet set in.

For a hierarchical matrix the practical reading is about which blocks are expensive. Which pairs are allowed to be small and the admissibility rule decide which blocks are compressed by their geometry alone; the smaller cluster sets the rank found the cost following the smaller cluster when the two differ in size. Offset is a third geometric variable, and it moves the cost by a factor of less than two over the range a partition produces: a block slightly off-centre is the dearest, a block far to the side is the cheapest, and none is dearer than the facing block by more than a sixth — 101 columns at F=48F = 48 at the steepest offset against 88 facing. The kernel with nothing to compress found the oscillatory kernel’s rank growing without limit as the clusters grow at fixed wavelength; offset changes the slope of that growth, not the fact of it.

The sampling, too, deserves a word, since it is what makes the rank a property of the geometry. The size the rank does not notice found a well-separated block’s rank independent of how finely it is sampled once the samples resolve the kernel; here every block is sampled at twelve points a wavelength, so the number of rows grows with FF while the rank grows with the union count, and the ratio of the two — the compression a hierarchical matrix gets from the block — improves with FF at every offset, from about an eighth of the rows at F=8F = 8 to a thirteenth at 48.

What one pair of segments does not show

The segments are collinear-parallel, equal and straight; real clusters are surfaces with every orientation, and for them the band of directions is two-dimensional and its reflection’s overlap is a matter of solid angle. The offsets run along the segments’ own line at a fixed perpendicular separation, so the source also moves further away as it slides, and that added distance is part of the obliquity measured here rather than something separated from it. The slopes are read between F=24F = 24 and 48 only; the earlier essay found the facing slope settling from 16 on, and at two lengths the curve may still be bending at 48. And the ranks are at one tolerance, 10−810^{-8}; the earlier essays found the slope nearly independent of it, and that is assumed here, not checked.

Still open: a source turned, and the steepest offset at scale

A curved source. An arc of the same length as the source segment, bent towards the target, sees the target over a wider range of directions at each of its points than a straight segment does. The prediction with a sign is that an arc of 60 degrees facing the target has a rank slope at least a tenth above the straight segment’s from F=24F = 24 to 48, and that its union count, computed from the arc’s two ends as here, underestimates that slope by more than it does for any straight source — because a curved source’s band is no longer bounded by its endpoints’ directions alone.

The steepest offset at larger FF. The rank’s slope peaks between half and three quarters of a length. The prediction is that the peak stays in that range from F=48F = 48 to 96, that its height there converges to the union’s 1.54 plus a margin that falls with FF, and that the facing and one-length slopes converge to within 0.05 of each other — the near-even trade between overlap and obliquity becoming exact as the edge effects shrink.

Shares its objects with

Essays that name at least two of the same things, and that neither author linked.

Named objects

A flat tag is an object no other essay names yet.

Asymptotic analysisHierarchical matrixKernel matrixLow-rank approximationOff-diagonal rankSingular valuesTolerance