Failure Note: The Helpful Summary That Changed the Decision

The model did not invent a spectacular fact. It compressed uncertainty, moved a qualification and changed what the committee believed mattered.

The answer

An investment committee received a 140-page diligence pack. An analyst used an approved enterprise assistant to create a two-page summary. The output was clear, balanced and cited sections of the source.

09:10 — the pack

An investment committee received a 140-page diligence pack. An analyst used an approved enterprise assistant to create a two-page summary. The output was clear, balanced and cited sections of the source.

11:30 — the decision

The committee focused on customer concentration and accepted the technology risk as manageable. A conditional approval was issued.

Three weeks later — the contradiction

During legal drafting, counsel found that a critical licence could terminate on change of control. The summary had mentioned the licence under “standard third-party dependencies,” while the source described termination risk in a footnote to an annex.

What failed

The model did not hallucinate. It ranked. Compression changed prominence, and prominence changed the decision. The analyst checked whether statements were supported, but not whether the summary preserved the source’s risk hierarchy. The committee treated an aid as the evidence layer.

The interruption control

- Define questions the summary must answer before generating it.

- Require citations to the exact passages behind consequential claims.

- Show omitted high-risk clauses, not only selected themes.

- Make a person attest that the source’s qualifications and exceptions survived compression.

- Keep the original pack accessible at the point of decision.

The compression audit

Choose the five statements in the summary most capable of changing the decision. For each, open the source and ask: what qualification, exception or opposing evidence sits within two pages? If the answer changes the force of the statement, the summary is not decision-ready.

A summary can be factually defensible and institutionally misleading. The risk lives in what became small.

Sources

  1. NIST — AI RMF Generative AI ProfileNIST

    Primary authority

  2. EU — Rules for trustworthy artificial intelligenceEU

    Industry guidance

Ross BelhommePartner, Svperior / Legal

Jonathan P. De Collibus

Jonathan co-founded Svperior in 2014 and leads its cyber practice. His work sits where adversarial pressure, technical architecture, and consequential decisions meet, with experience across clinical, financial, public-sector, and private-client systems where confidentiality, continuity, and technical correctness carry material consequences.

Cyber strategy / Adversarial assessment / Security architecture / Private systems

Need to apply this to a specific situation?

Send us the initial context. If the matter fits, we will respond directly.

Send private inquiry
Failure Note: The Helpful Summary That Changed the Decision