What's New in v30.4 — Beyond-Fisher corrections defense

I044 project

2026-07-07

Purpose of this note

Manuscript v30.4 is a wording-only revision of v30.3: no numbers, equations, figures, or validation domains changed. Three short passages were added to strengthen the defense of the empirical (Ŝ,b)(\widehat{S},b) beyond-Fisher corrections (Eqs. mean-corr/sigma-corr) against the natural referee question, “why are these corrections empirical rather than derived?” This note expands each added passage with the full supporting evidence, which is intentionally kept out of the manuscript itself (referenced there only as “to be presented elsewhere”).

The short version: we tried to derive the corrections twice and tried to show they are a universal PSF-independent law once. All three attempts failed, and each failure is informative. Taken together they convert “we do not have a derivation” into “we have evidence for why no simple derivation exists, and evidence for exactly where the empirical law is valid.”

Passage 1: the residual is beyond any local second-order expansion

What the manuscript says

The empirical status of these corrections is itself a constrained result, not merely a modeling convenience. [...] a second-order expansion of CbestC_\mathrm{best} conditioned on the amplitude score, evaluated with no fitted coefficients, fails to reproduce the five coefficients in Equations (mean-corr)–(sigma-corr): its mean contribution is approximately a constant position-rank gain rather than the observed Ŝ0.40\widehat{S}^{-0.40} decay, and its variance term does not yield the empirical 1/Ŝ1/\widehat{S} scatter deficit. This places the low-signal residual beyond a local quadratic or Bartlett-type expansion, consistent with the position-argmax mechanism isolated in the reference-fitter decomposition.

The full picture

The empirical laws being defended are, from the production 17-position ×\times 6-background reference-fitter run (8×105\sim 8\times10^5 fits): Δμ(Ŝ,b)=(aμ+cμlog10b)Ŝpμ,(aμ,cμ,pμ)=(0.59,1.02,0.40)σCratio(Ŝ,b)=1aσ+cσlog10bŜ,(aσ,cσ)=(1.49,0.39)\begin{aligned} \Delta\mu(\widehat{S},b) &= \big(a_\mu + c_\mu \log_{10} b\big)\,\widehat{S}^{-p_\mu}, \quad (a_\mu, c_\mu, p_\mu) = (0.59,\, -1.02,\, 0.40) \label{eq:target-mean}\\ \sigma_C^\mathrm{ratio}(\widehat{S},b) &= 1 - \frac{a_\sigma + c_\sigma \log_{10} b}{\widehat{S}}, \quad (a_\sigma, c_\sigma) = (1.49,\, 0.39) \label{eq:target-sigma} \end{aligned}

We attempted a first-principles derivation in two stages.

Stage A (unconditional Bartlett term). The first-order theory linearizes ΔC\Delta C in the Poisson fluctuations and conditions on the fitted score. The next order in that expansion is the quadratic (Bartlett) score-space term, Q=zHztr(H)Q = z^\top H z - \operatorname{tr}(H), whose unconditional variance is 2tr(H)2\,\operatorname{tr}(H) — a constant +2+2 (amplitude-only) or +6+6 (three-parameter) added to the variance regardless of Ŝ\widehat{S}. This is the wrong sign and the wrong shape: it only adds variance, while the empirical law in Eq. [eq:target-sigma] needs a variance deficit that is large near threshold and vanishes at high Ŝ\widehat{S}.

Stage B (score-conditioned expansion). We then derived the proper object: the quadratic score-space term projected onto the score-fixed (fixed-Ŝ\widehat{S}) subspace, using the amplitude-score projector PS=IaS(aSaS)+aSP_S = I - a_S(a_S^\top a_S)^+a_S^\top and the position-block curvature Ipos=BBI_\mathrm{pos} = B^\top B with B=PS[Sp/x/μ,Sp/y/μ]B = P_S\,[\,S\,\partial p/\partial x/\sqrt{\mu},\ S\,\partial p/\partial y/\sqrt{\mu}\,]. This gives a conditioned mean shift tr(Ipos+Ipos)+O(z3)\operatorname{tr}(I_\mathrm{pos}^+ I_\mathrm{pos}) + O(z^3) and a conditioned variance correction built from UIpos+RIpos+UU^\top I_\mathrm{pos}^+ R\, I_\mathrm{pos}^+ U, with RR the curvature of the per-pixel Poisson mean. Evaluated numerically (Gaussian PSF, σ=1.5925\sigma = 1.5925 px, Ŝ[4,80]\widehat{S}\in[4,80], b{0.01,,0.16}b\in\{0.01,\dots,0.16\}), with no coefficients fitted to the empirical law, the derived quantities were compared directly against Eqs. [eq:target-mean][eq:target-sigma]:

Stage-B derived beyond-Fisher coefficients vs. the production empirical law. All five fail their quoted (bootstrap) tolerance.
Coefficient Derived Empirical Tolerance Verdict
aμa_\mu 2.392.39 0.590.59 ±0.12\pm0.12 FAIL
cμc_\mu +0.094+0.094 1.02-1.02 ±0.10\pm0.10 FAIL
pμp_\mu 0.0360.036 0.400.40 ±0.05\pm0.05 FAIL
aσa_\sigma 1.301.30 1.491.49 ±0.04\pm0.04 FAIL
cσc_\sigma 0.790.79 0.390.39 ±0.03\pm0.03 FAIL

Independent re-derivation of the effective shapes from the raw evaluation grid confirms this is not a coefficient-tuning miss but a qualitative failure: the derived mean shift is nearly constant at +2\approx +2 across the full Ŝ=4\widehat{S}=48080 range (it does not decay at all, let alone as Ŝ0.40\widehat{S}^{-0.40}), and a constant +2+2 mean shift is actually inconsistent with the manuscript’s own validated high-Ŝ\widehat{S} closure (Z=+0.07\langle Z\rangle = +0.07 at Ŝ>20\widehat{S}>20, per the main-text reference-fitter validation table). Likewise the derived effective Aσ(Ŝ,b)Ŝ(1σCratio)A_\sigma(\widehat{S},b) \equiv \widehat{S}\,(1-\sigma_C^\mathrm{ratio}) is not constant in Ŝ\widehat{S} at all — it changes sign across the grid — so there is no 1/Ŝ1/\widehat{S} law to be found in this expansion at any order of local Taylor refinement.

Conclusion. Two structurally different local expansions (unconditional Bartlett, score-conditioned Bartlett) both fail, in different and specific ways. This is stronger evidence than a single failed attempt: it indicates the beyond-Fisher residual is not a local (interior-point Taylor) phenomenon at all. This is exactly consistent with the mechanism finding from the targeted paired-component decomposition (see the main text’s mechanism-decomposition section): the dominant low-Ŝ\widehat{S} term is centroid relocation / position argmax, i.e. the observed ΔC\Delta C is (locally) a supremum over the position search grid, not a value at a single fitted point — and no expansion around one interior point can represent an argmax over a domain.

Passage 2: the corrections are PSF-family specific

What the manuscript says

[...] a cross-PSF transferability test using Gaussian σ=1.59\sigma=1.59 pixel, broad Gaussian σ=2.79\sigma=2.79 pixel, and King rc=2.5r_c=2.5 pixel, α=1.5\alpha=1.5 toy configurations with the same 𝚎𝚌𝚞𝚝=15\mathtt{ecut}=15 mask shows that the correction coefficients are PSF-family specific: the Gaussian-toy mean law differs from the XMM-psfgen-template production law at high significance in the most precise low-Ŝ\widehat{S} bins, and neither bApsfbA_\mathrm{psf} nor bnpixb\,n_\mathrm{pix} collapses the mean coefficients across PSF families. Consequently, the low-signal correction must be calibrated per PSF-template family. Within the XMM psfgen-template family used here, the 17-position off-axis stability demonstrated below is precisely the validated operational domain.

The full picture

Having failed to derive Eqs. [eq:target-mean][eq:target-sigma], we asked a weaker question: are they at least universal across PSF shape, once expressed in a suitable dimensionless background variable? The natural candidates, motivated by the position-argmax mechanism, are beff=bApsfb_\mathrm{eff} = b\,A_\mathrm{psf} (background per effective PSF footprint, Apsf=1/pnorm2A_\mathrm{psf} = 1/\sum p_\mathrm{norm}^2) and bnpixb\,n_\mathrm{pix} (background per masked pixel).

We reran the same reference-fitter pipeline (identical fitting code, identical Ŝ\widehat{S}-binning, identical circular 𝚎𝚌𝚞𝚝=15\mathtt{ecut}=15 mask) for three PSF/mask configurations spanning a 3.4×3.4\times range in effective PSF area:

Bootstrap-fitted correction coefficients per PSF/mask configuration (250 Poisson draws/cell, 41,250 fits total).
Configuration ApsfA_\mathrm{psf} aμa_\mu cμc_\mu aσa_\sigma cσc_\sigma
Gaussian, σ=1.59\sigma=1.59 px 31.9 0.123±0.065-0.123\pm0.065 0.586±0.066-0.586\pm0.066 0.944±0.2090.944\pm0.209 0.430±0.1460.430\pm0.146
Broad Gaussian, σ=2.79\sigma=2.79 px 97.6 0.193±0.026-0.193\pm0.026 0.403±0.027-0.403\pm0.027 0.819±0.2490.819\pm0.249 0.366±0.1700.366\pm0.170
King, rc=2.5r_c=2.5 px, α=1.5\alpha=1.5 110.0 0.287±0.038-0.287\pm0.038 0.770±0.036-0.770\pm0.036 1.631±0.2361.631\pm0.236 0.647±0.1650.647\pm0.165

Two things stand out. First, the baseline Gaussian control does not reproduce the production XMM-template coefficients (0.59,1.02,0.40,1.49,0.39)(0.59, -1.02, 0.40, 1.49, 0.39) at all: aμa_\mu is off by 5.2σ5.2\sigma, cμc_\mu by 3.6σ3.6\sigma, pμp_\mu (which came out 0\approx 0 for every configuration, i.e. no power-law decay was measurable in any toy at this precision) by 8σ8\sigma, and aσa_\sigma by 2.6σ2.6\sigma; only cσc_\sigma agrees. Since v30.3’s production coefficients were measured with pixelized XMM psfgen templates (King-like wings) rather than an idealized Gaussian, this control mismatch is itself evidence that PSF shape matters, not a bug: the most statistically precise low-Ŝ\widehat{S} bins reject the production mean law by 101018σ18\,\sigma when evaluated against a Gaussian PSF at b0.08b\ge0.08.

Second, no tested rescaling unifies the three configurations. We fit the same functional forms against raw bb, beff=bApsfb_\mathrm{eff}=b A_\mathrm{psf}, and bnpixb\,n_\mathrm{pix}, and checked whether the three configurations’ coefficients collapse onto one shared value within their bootstrap errors:

Selected collapse-test results (full table in the internal record). Only cσc_\sigma is stable across PSF families under any scaling; the mean-law coefficients get worse, not better, under both proposed dimensionless rescalings.
Scaling Coefficient Shared mean Config. spread Max. zz
raw bb cμc_\mu 0.539-0.539 0.3670.367 6.336.33
beff=bApsfb_\mathrm{eff}=bA_\mathrm{psf} aμa_\mu 0.8280.828 0.6770.677 11.4711.47
bnpixb\,n_\mathrm{pix} aμa_\mu 1.3381.338 0.9540.954 8.328.32
bnpixb\,n_\mathrm{pix} aσa_\sigma 0.244-0.244 0.0650.065 0.170.17
raw bb cσc_\sigma 0.4790.479 0.2820.282 1.021.02

Conclusion. The King configuration — the one with the heaviest PSF wings — shows the largest variance deficit (aσ=1.63a_\sigma=1.63 vs. 0.940.94 for the narrow Gaussian), which is exactly the ordering a position-argmax mechanism predicts: heavier wings give the position optimizer more room to find spurious peaks. But the effect size does not collapse onto one universal curve under either dimensionless variable tried. The corrections are therefore treated as PSF-family-specific: valid within the XMM psfgen-template family (supported by the 17-position off-axis independence already in the main text), not claimed as instrument-independent.

Passage 3: the emldetect transfer is an implementation layer

What the manuscript says

Same-seed paired reference-fitter and standalone emldetect experiments show that the standalone ΔC\Delta C tracks the reference fitter almost perfectly (correlation 0.996), with a small affine offset and an implementation jitter that grows with off-axis angle; this supports treating the transfer from the reference theory to the standalone pipeline as an empirical implementation layer rather than as a change to the observable-conditioning formalism.

The full picture

Using 21,000 same-seed paired rows (reference fitter vs. standalone emldetect, b=0.04b=0.04, Strue[8,20]S_\mathrm{true}\in[8,20], PN band-4-like configuration, 14–17 detector positions), the two pipelines’ ΔC\Delta C values are related by a simple affine map plus a position-dependent jitter: ΔCeml=aΔCref+c+ε(θ),a=0.9857,c=0.632,\Delta C_\mathrm{eml} = a\,\Delta C_\mathrm{ref} + c + \varepsilon(\theta), \qquad a = 0.9857,\ \ c = 0.632, with corr(ΔCref,ΔCeml)=0.996\operatorname{corr}(\Delta C_\mathrm{ref}, \Delta C_\mathrm{eml}) = 0.996 and jitter standard deviation growing from σε1.28\sigma_\varepsilon \approx 1.28 on-axis to 2.07\approx 2.07 at θ8.8\theta\approx8.8' off-axis (a per-ring fit is statistically indistinguishable from a linear-in-θ\theta fit, σε(θ)1.32+0.046θ\sigma_\varepsilon(\theta) \approx 1.32 + 0.046\,\theta).

Propagating this transfer through the reference-fitter theory, μeml=aμ3p+c\mu_\mathrm{eml} = a\,\mu_{3p} + c and Vareml=a2Var3p+σε(θ)2\operatorname{Var}_\mathrm{eml} = a^2\operatorname{Var}_{3p} + \sigma_\varepsilon(\theta)^2, and testing on held-out detector positions (leave-one-position-out), closes almost exactly the width gap noted for standalone emldetect at the detection threshold:

Standardized residual width, held-out positions, in the manuscript’s DET_ML=6\mathrm{DET\_ML}=61010 operational band.
Ŝ\widehat{S} range (typical DET_ML\mathrm{DET\_ML}) Reference σZ\sigma_Z Raw emldetect σZ\sigma_Z With transfer σZ\sigma_Z
[8,10)[8,10)DET_ML8\mathrm{DET\_ML}\approx8) 0.97 1.235 0.996
[10,12)[10,12)DET_ML9\mathrm{DET\_ML}\approx9) 0.96 1.248 1.069

Critically, applying the (already-validated) low-signal mean correction of Eqs. [eq:target-mean] to μ3p\mu_{3p} before the affine map leaves the transfer-layer width essentially unchanged and only shifts the mean residual — confirming the beyond-Fisher mean physics and the emldetect implementation layer are cleanly separable, as the manuscript’s framing assumes.

One caveat kept out of the manuscript (it is a next-step item, not a validated result): the affine-residual scatter is not constant in Ŝ\widehat{S} — it grows from 1.6\approx1.61.81.8 near threshold to 3.0\approx3.0 at Ŝ35\widehat{S}\approx354242 — so the present θ\theta-only jitter model under-corrects well above the DET_ML=6\mathrm{DET\_ML}=61010 band. This does not affect the operational claim made in the manuscript, which is scoped to the detection threshold.

Summary

Test Result What it buys the paper
Local 2nd-order derivation (2 variants) Both fail, in complementary ways Empirical status is a constrained result, not a shortcut
Cross-PSF dimensionless collapse Fails; PSF-family dependence confirmed Sharpens validity boundary to the XMM template family
emldetect affine+jitter transfer Closes the near-threshold width gap on held-out positions Standalone-emldetect prediction without new formalism