Data room

Nine AI reviewers were told this product had already failed. Their job was to explain why.

The idea

Millions of homeowners became equity rich almost overnight when prices surged, but they cannot reach that money without giving up a low mortgage rate or taking on a monthly payment, and many of them only need a bridge for a few years. The intent was to help those households rather than profit from their squeeze: a fair, plainly described way to turn part of that equity into regular monthly cash, settled when the home is sold.

The panel

Nine AI agents, each playing one specialist (tax, securities, title, bankruptcy, insurance, operations, an investor, a customer, and a red team), were told the product had already failed and asked to explain why. They wrote independent reports, cross-examined each other, traced thirteen failure scenarios, and built a pricing model, and the synthesis of their work was a no-go on the first design.

The outcome

The idea was shelved. A large lender, Finance of America, launched essentially the same product: a second-lien loan with no monthly payment for homeowners 55 and older, with a line-of-credit version alongside it. The one design that survived this review was the one closest to it.

This page shows how the review of Equity Flow™ worked and holds everything it produced, as written.

1
2
3
4
5
Interrupted, then recovered
  1. Parallel review18 min
  2. Cross-examination1 h 12 min
  3. Scenario trace6 min
  4. Pricing model5 min
  5. Synthesis4 min
Run 1, drawn to scale from the run log: 1 h 45 min from dispatch to verdict.

56 documents, 177,015 words. 94,503 of them are the reviewers' own reports and cross-examinations.

How the run worked

There was no orchestration code. One Claude Code session followed a written runbook, launched each reviewer as a subagent with its own prompt, and kept its place by writing to disk. Every stage read its inputs from files, never from the conversation, and appended a line to the run log when it closed.

  1. 1

    Parallel review

    18 min

    Eight reviewers were dispatched together, each with its own prompt and the product documents, and each wrote a full report to disk. The red team was held back until all eight reports existed, then given the documents and all eight reports with one extra job: find the failure the panel missed.

    All eight reports on disk

    Wave 2, 10 min: the red team reads everything

    voted killvoted fix before launch

    What the run log recorded

    Stage 1 wave 1 complete. 8/8 reports written: retail-customer (KILL), investor (KILL), tax-attorney (KILL), estate-bankruptcy (FIX w/ kill conditions), securities-consumer-finance (FIX w/ 2 embedded kills), real-estate-title (FIX, kill-equivalent in TX), product-operator (FIX), insurance-actuarial (FIX w/ 2 embedded kills) | anomalies: none — all files non-empty | dispatching red-team wave 2

    Stage 1 complete. red-team.md written (671 lines, verdict KILL, incl. WHAT THE PANEL MISSED: market-pause-as-fund-escape-hatch, post-assignment covenant weaponization) | 9/9 reports on disk | anomalies: none | proceeding to Stage 2 cross-examination

    Written to disk: Nine reviews

  2. 2

    Cross-examination

    1 h 12 min

    Each of the nine received the other eight reports and answered two questions. Which of these findings do you dispute, and why? Which fixes proposed by other reviewers create new problems in your domain? Direct conflicts between reviewers were collected for the synthesis to resolve or surface.

    RCIITASCREEBPOIART
    Retail customer
    Institutional investor
    Tax attorney
    Securities and consumer finance
    Real estate and title
    Estate and bankruptcy
    Product operator
    Insurance and actuarial
    Red team
    Each row is a reviewer. Each filled square is another reviewer's report it was handed: 72 readings in all.

    Interrupted, then recovered

    The nine parallel agents were cut off mid-stage when the account reached its monthly usage limit. Seven of the nine cross-examinations were already on disk and were verified complete. The runbook's rule for a failed stage is one retry, then continue: the two missing ones (investor, and insurance and actuarial) were re-run, and the stage closed 18 minutes after the interruption was logged. Nothing else had to be redone, because every stage reads its inputs from disk.

    What the run log recorded

    Stage 2 failure. All 9 cross-exam agents terminated early: monthly spend limit on subagent usage. No crossexam-*.md files written. Per runbook failure rule: attempting one retry (single probe agent); if probe fails, Stage 2 will be executed inline by the orchestrator from the on-disk reports and the deviation logged.

    Stage 2 complete. 9/9 crossexam files written. Anomalies: initial parallel run terminated by monthly spend limit AFTER 7/9 files were written (all verified complete, untruncated); investor and insurance-actuarial re-run successfully per one-retry rule. Notable: actuarial conceded both investor disputes (recovery at -45pct = 0.175x not 1.0x; Ch7 discharge channel omitted), Shield coverage revised down to 0.29-0.33x. Central conflict DC-1 (lien-vs-tax characterization fork) flagged by every reviewer. | Stage 3 (scenarios) executing inline by orchestrator

    Written to disk: Nine cross-examinations

  3. 3

    Scenario trace

    6 min

    The product was walked end to end through thirteen failure scenarios. For each one: who gets paid, who takes the loss, what the customer and the investor experience, and whether any contract term fails. Every outcome the specification left undefined was flagged.

    1. Home prices fall 20%
    2. Rates rise fast
    3. The customer dies
    4. Divorce
    5. Chapter 7 bankruptcy
    6. Chapter 13 bankruptcy
    7. A senior lender forecloses
    8. Early sale
    9. Sale delayed 15 years or more
    10. A natural disaster destroys the property
    11. Coordinated fraud
    12. Recession with three times the expected defaults
    13. Adverse change in tax law
    What the run log recorded

    Stage 3 complete. scenarios/SCENARIOS.md written (13 scenarios traced end-to-end, pause-paradox dual-branch applied, 27 undefined-outcome items in consolidated register) | executed inline by orchestrator | anomalies: none

    Written to disk: Scenario traces

  4. 4

    Pricing model

    5 min

    A Python model of the economics across twelve appreciation rates and eleven holding periods, held to a written list of assumptions. Anything the code needed that was not on the list had to be added to the list, not buried in the code.

    What the run log recorded

    Stage 4 complete. models/: equity_flow_model.py + ASSUMPTIONS.md (26 stated assumptions) + RESULTS.md (6 grids, 2 summaries, stress table, reconciliations; -27pct breakeven drawdown and 0.17x sand-state recovery reproduced; 43 sub-hurdle investor cells; EF worse than HELOC in 81 cells) | anomalies: 2 IRR-solver bugs fixed during run (underflow bounds, sign-change bracketing), logged here per runbook

    Written to disk: Model assumptions, Model results, Model source

  5. 5

    Synthesis

    4 min

    One ranked analysis from everything on disk. The rules: rank, do not summarize; cite every legal and tax claim to the review it came from; nothing tagged speculative may appear in the verdict as if established. This stage could not run unless stages 1 to 3 had finished.

    What the run log recorded

    Stage 5 complete. ANALYSIS.md written (13 sections; executive verdict NO-GO; findings ranked 9 dealbreakers / 13 fix-items / cosmetic list; all legal-tax claims tagged and cited to underlying reviews; SPECULATIVE items excluded from verdict) | RUN COMPLETE: Stages 1-5 all executed; Stage 2 spend-limit failure recovered per one-retry rule; Stage 4 solver bugs fixed in-run

    Written to disk: Final analysis

The panel, and where each reviewer landed

Four reviewers voted to kill. Five voted to fix before launch, four of them with a kill condition attached. Each prompt, review, and cross-examination is one click away.

  1. Retail customer

    Reads the homeowner page the way a customer would: clarity, true cost, fairness, predatory patterns.

    Kill

    The homeowner calculator left out the investor’s share, and the page showed none of the contract’s material terms.

  2. Institutional investor

    Market size, unit economics, capital needs, defensibility, structured-finance risk.

    Kill

    At trend home-price growth the deal earns about 7.2% gross. The marketed 11% needs 4.67% a year of appreciation.

  3. Tax attorney

    Federal and state tax characterization, debt versus equity, reporting burden, audit risk.

    Kill

    The tax authority the spec relied on, IRC Section 453, does not apply on its face. The likeliest reading is a shared appreciation mortgage.

  4. Securities and consumer finance

    Howey and Reves, the Investment Company Act, TILA, RESPA, ECOA, UDAAP, state licensing.

    Fix before launchtwo embedded kills

    Both marketing pages and the guarantee product were kills as written. The public investor page was itself a general solicitation.

  5. Real estate and title

    Recordability in 50 states, lien priority, title insurance, due-on-sale, homestead, foreclosure.

    Fix before launchkill-equivalent in Texas

    Void against Texas homestead as drafted, and the Florida death path fails. The claim of all 50 states was false.

  6. Estate and bankruptcy

    Death, probate, trusts, incapacity, divorce, and Chapters 7, 11 and 13.

    Fix before launchtwo kill conditions

    The promises that the interest could not be discharged or modified in bankruptcy were false under the Bankruptcy Code’s own definitions.

  7. Product operator

    Origination cost, servicing, valuation integrity, decades of dormant-position administration.

    Fix before launch

    Origination lost about $2,000 to $4,000 a deal at the stated fee, and decades of servicing were priced at zero.

  8. Insurance and actuarial

    Reserve solvency, insurance classification, statutory capital treatment, the secondary-market thesis.

    Fix before launchtwo embedded kills

    The secondary sale the fund depended on priced at 0.69x to 1.10x of deployed capital, against the 1.41x the marketed return required.

  9. Red team

    Three attackers in one pass: a fraudster, a competitor, and a journalist or regulator.

    Kill

    Found what the other eight missed: the market pause works as a distressed fund’s escape hatch, and covenants can be turned against homeowners after assignment.

How the panel graded its own claims

How often each confidence tag appears across the eighteen review and cross-examination files.

Settled law202
Likely interpretation206
State-dependent143
Ambiguous101
Speculative39

What cross-examination changed

The second round is where the panel stopped being nine separate opinions. Reviewers conceded points, sharpened others, and found that their repairs did not fit together.

The verdict: no-go

Equity Flow as specified and marketed should not be launched, and the defect is architectural rather than reparable.

The nine dealbreakers, as the synthesis ranked them

  1. The characterization fork is unresolvable as designed
  2. The tax architecture fails at its foundation
  3. Bankruptcy/probate representations are false and self-destructive
  4. Texas is closed and Florida's death path fails
  5. The fund economics do not clear the cost of capital at trend housing
  6. The liquidity thesis is circular
  7. The marketing is contradicted by the sponsor's own documents
  8. Equity Shield is unlawful and insolvent as structured
  9. The counterparty-credit structure fails homeowners

Behind those nine sit thirteen defects that could each be cured at a cost, twelve ranked risks, six questions the panel could not settle, and fifteen questions written for licensed securities, tax, and consumer-finance counsel.

The synthesis closes on the question the panel had been asked: whether the product could be legal, honest, and financeable at once. Its answer was that each property was achievable only by surrendering another. In its words, "That is a design verdict, not a compliance gap."

Read the final analysis

What the verdict changed

The product that was reviewed was withdrawn. The analysis ended with the only redesign the panel thought coherent, and that became the next concept the same day. Three more designs went back through the reviewers whose findings mattered most to each. One survived.

  1. Version 1Killed

    Equity share

    Monthly payments to the homeowner in exchange for the capital back plus 25% of future appreciation.

    Full panel, five stages.

    No-go. Nine dealbreakers, and fixes that undo each other.

    Final analysis

  2. Version 2Survived

    Deferred-interest loan

    Working name HomeDraw. A second-lien loan with a monthly draw and no payments until sale, called a loan everywhere. Built from the panel’s own redesign recommendation.

    Three reviewers: securities and consumer finance, investor, insurance and actuarial.

    Fix before launch from all three. The securities reviewer found no embedded kills. This became the basis of the product on the investor page.

    Concept: deferred-interest loanReview: securities and consumer financeReview: investorReview: insurance and actuarial

  3. Version 3Killed

    Symmetric index-settled share

    A lump sum for a slice of metro home-price exposure, with the investor sharing losses as well as gains.

    Three reviewers: investor, securities and consumer finance, tax.

    Killed by the investor and securities reviewers. A sweep of 175 parameter combinations found none that paid both sides.

    Concept: symmetric index-settled shareReview: investorReview: securities and consumer financeReview: tax

  4. Version 2.1Killed

    Open line of credit

    The loan reshaped as a draw-whenever credit line with the monthly schedule as a feature.

    One reviewer on one question: does the funding math hold?

    Killed as specified. The corrected central-case consumer rate was 13.55% against a 10.5% ceiling.

    Concept: open line of creditReview: funding and utilizationFunding model resultsFunding model source

A second full run was prepared: 55 questions drawn from an outside critique of the public site, routed to eight of the nine reviewers. It has not been dispatched. See the question list

What this is, and what it is not

All documents

The method

The written procedure the orchestrating session followed, and the nine prompts that define the reviewers.

Run 1, stage 1: the nine reviews

Each reviewer’s full report on version 1, ending in its verdict.

Run 1, stage 2: the nine cross-examinations

Each reviewer’s disputes with the other eight reports, and the fixes it says would break something in its own domain.

Run 1, stages 3 to 5: scenarios, model, verdict

Written by the orchestrating session from everything the reviewers left on disk.

Successor concepts and their reviews

The three designs that followed the no-go, each reviewed the same day by the reviewers whose findings mattered most to it.

Run 2: prepared, never dispatched

A second run on the current public site was set up and has not been run.

The current model

The one model that produces every number on the investor page, read live from this site’s source.