The library

Rendered from docs/reports/2026-09-26_sponsor-questions.md; the markdown file is the record.

One-time draft review

Approved by Nathan, Sat Sep 26, ~08:25.

  • Payload: submissions/20260926-0813_M4_sweep_E_on_A_alpha0.2_our_direction.tsv, copied to ~/Downloads/HEARSAY_predictions.tsv. The two copies are byte-identical.
  • Rule: M1b v3 80% + handcrafted v5 20% (rank), with M3 used only for false-alarm suppression. Pre-declared in docs/reports/2026-09-26_fusion-sweep-predeclared.md.
  • Validation:
    • holdout minDCF 0.014
    • In-the-Wild 0.260 (brief cost) / 0.267 (sponsor-code cost)
    • test share above 0.5: 27.4%
  • Ask NSA for: minDCF, plus P_FA, P_miss and EER.
  • Pre-flipped copy: ..._FLIPPED_only_if_NSA_scores_inverted.tsv.

Decoding the returned minDCF (per the fusion consult response):

Returned minDCFAction
0.00–0.20Ship unchanged.
0.20–0.45Switch to the most FA-robust candidate.
0.45–0.90Don't flip; fall back to M1b v3 alone.
0.95–1.00NSA's code is reading our scores inverted: submit the pre-flipped file.

If NSA returns EER instead, 2–5% means our direction and 95–98% means theirs.

Sent: Sat 12:30 by Discord DM (team Cross Exam), superseding the 08:13 payload above: CrossExam_predictions.tsv = submissions/20260926-0914_M4_sweep_A3_w0.2_E_CANDIDATE_our_direction.tsv (rule A3 w0.2 + E, sha256 fb783076…, submissions/log.csv row 12:30:37).

Returned (Sat, ~15:30, relayed by Nathan): minDCF 0.0733, EER 3.534%. No P_FA, P_miss, threshold, cost weighting or direction convention was given.

  • Decoding: 0.0733 is in the 0.00–0.20 band, so the shipped rule stays; EER 3.5% (not 96.5%) confirms 1.0 = synthetic is being read as intended. No flip, no fallback.
  • Against our proxies: holdout 0.0065, In-the-Wild 0.228; the test set sits at 11× the holdout and a third of In-the-Wild, next to M1b v3 alone on the holdout (0.072).
  • Field (draft review, Sat ~16:15): one team ahead at minDCF 0.0584 / EER 2.5%; under points = (1 − ours)/(1 − best) × 60 that is a 0.95-point gap on the 60-point detection score.
  • Status: the number is the fixed baseline for any further work before the Sunday 05:00 freeze. The follow-up consult on what to build next is docs/consults/2026-09-26_post-draft-review_CONSULTATION.md.