Skip to the content
Aletheia

Elusive by Law · claim MPI-C008 · Attribution rung · The conventional statistics steelman

Regression to the mean, analytic flexibility, publication bias, and statistical dependence among matrix variables are jointly sufficient to explain the correlation-matrix record — the early positives and the decline — without any anomalous correlation.

The conventional steelman: nothing was ever there. Intercorrelated variables made "significant cells" cheap, flexible analysis and selective publication made early positives likely, and when protocols tightened, results regressed to the nothing they came from. Every one of those mechanisms has been caught red-handed somewhere in this literature.

AI-extractedorigin: Critical literature import 2026-08-22 — Bösch 2006, Bierman 2016, Maier & Dechamps 2022, Flores 2021/2023

credibility — is the claim itself true?

Provisionally supported

Each component mechanism is documented in or near this corpus: the dependence problem (Flores's Monte Carlo work), analytic flexibility (Grote 2017's post-hoc-only significance), error-driven false positives (Maier & Dechamps), publication-bias sensitivity (Bösch 2006). What keeps this short of well_supported: no one has yet shown quantitatively that these mechanisms reproduce the specific published record, and the strongest QRP simulation in the neighborhood (Bierman 2016, on ganzfeld data) explained about 60% of that effect, not all of it.

diagnosticity — how much does it decide the thesis?

high

The direct rival to MPI-C007. If it holds, MPI's central evidence line dissolves; if it can be shown insufficient under adversarial conditions, what remains is genuinely anomalous.

Evidence

Supports (3)

Supports· moderateMPI-E006

Grote 2017: preplanned analyses null; a post-hoc variant significant

what the source states
Twenty participants, 720,000 bits, three analyses defined and tested before looking at the data — including a conceptual replication of the correlation-matrix method. Results: p = 0.438, p = 0.703, and p = 0.0949 for the three preplanned analyses (combined p = 0.315). "While none of the pre-defined analysis results is found significant, a post-hoc variant of analysis 3 that includes the control data is significant with p = 0.012."
what we infer
One study, both lessons: the preplanned nulls extend the failed replication record (MPI-C002), and the significant post-hoc variant is a live demonstration of how analytic flexibility can conjure a positive from the same data (MPI-C008). The synthesis document that seeded this case cited the post-hoc figure as a replication success — an error this import corrects.
limitations
  • Small sample (20 participants) limits what the preplanned nulls can exclude.
Grote, H. (2017)AI-verified citation
Supports· strongMPI-E015

Bösch 2006: micro-PK meta-analysis — tiny effects, huge heterogeneity, publication bias

what the source states
A meta-analysis of 380 REG-intention studies found a very small but significant overall effect, extreme heterogeneity, and a strong small-study effect, concluding that publication bias appears to be the easiest and most encompassing explanation for the primary findings.
what we infer
The base-rate backdrop for the whole case: the broader literature the matrix experiments grew from is consistent with selection processes acting on null effects. Radin and colleagues' published rebuttal (same issue) contests the smallest-studies weighting — the dispute is noted, not resolved, here.
limitations
  • Targets classical hit-rate micro-PK, not the matrix paradigm itself.
  • A published comment (Radin et al. 2006) disputes the meta-analytic weighting choices.
Bösch, H. (2006)AI-verified citation
Supports· moderateMPI-E017

Maier & Dechamps 2022: a celebrated micro-PK effect traced to a coding error

what the source states
In a preregistered replication program of a correlational micro-PK effect, the authors report discovering a coding error in their earlier work that had produced a false-positive result, and analyze what the corrected record implies about their previous conclusions.
what we infer
A documented instance, inside the modern correlational micro-PK literature, of an ordinary software mistake manufacturing an "anomalous" effect that survived until a replication forced the audit — exactly the class of mundane mechanism the conventional steelman says the founding matrix results need to be screened against. Credit where due: the authors found and published the error themselves.
limitations
  • Concerns the Maier/Dechamps experimental line, not Lucadou's matrix datasets; its force here is as a documented failure mode, not a direct audit.
Maier, M. A. (2022)AI-verified citation

Qualifies (1)

Qualifies· moderateMPI-E016

Bierman 2016: QRP simulation explains much — not all — of a flagship psi effect

what the source states
Simulating questionable research practices at empirically observed frequencies against the ganzfeld meta-analytic database, the authors conclude "that QRPs are capable of explaining about 60% of the effect size reported in the GF meta-analysis," that the reported significance "is likely inflated by QRPs, though results are still significant (p = 0.003) with QRPs," and that a good fit with no anomalous effect required unrealistic QRP parameter values.
what we infer
Cuts both ways, and is filed that way: it quantifies how far QRPs really go (a long way), and it documents that in the best-studied neighboring database they did not, under this model, cover the whole distance. Applying either lesson to the much smaller matrix corpus is an extrapolation.
limitations
  • Ganzfeld telepathy data, not matrix experiments; QRP frequencies were borrowed from psychology surveys under an untested assumption of comparability.
Bierman, D. J. (2016)AI-verified citation

strongest unresolved objection

Walach et al. 2020 was preregistered, adequately powered, and still reported a significant surplus; Flores found effects in three of five studies using permutation analyses designed to respect dependence. The mundane account predicts stricter methods kill the effect — mostly they did, but not cleanly everywhere.

what would change our mind

  • A QRP/dependence simulation calibrated to the actual CMM corpus reproducing (or failing to reproduce) its published record.
  • A significant matrix result under full blind analysis, which this explanation predicts should not occur.

child claims

Assessment history

Append-only AI overlay records; the canon claim file is never mutated.

Provisionally supportedconfidence: moderate · Fable (Claude), via Cursor · run 2026-08-22-fable-1 · unreviewed draft

Every component mechanism is documented in or beside this corpus, and the blind-analysis null is exactly its predicted outcome. It stops short of well_supported because no calibrated simulation has yet reproduced the specific published record, and the best analog effort (Bierman 2016) explicitly failed to cover the full distance in its own database.

Provisionally supportedconfidence: moderate · Gemini 3.1 Pro (Google) — independent check run via gemini-3.1-pro-preview · run 2026-08-23-check-gemini · unreviewed draft

Every component of the conventional explanation—statistical dependence, analytic flexibility, coding errors, and publication bias—has been empirically documented within this specific literature or its direct antecedents. It offers a highly parsimonious explanation for the entirety of the observed decline arc. The strongest opposing consideration is that a comprehensive, quantitative demonstration showing these mechanisms account for 100% of the founding matrix successes has not yet been published, and some positive results survive dependence-aware permutation tests.

Provisionally supportedconfidence: moderate · GPT-5.1 (OpenAI) — independent check run via gpt-5.1 · run 2026-08-23-check-gpt · unreviewed draft

Each component of the conventional explanation is independently evidenced. Bösch’s meta‑analysis finds that REG micro‑PK as a whole is best explained by publication bias and small‑study effects (MPI‑E015); Bierman’s simulations show that QRPs at realistic rates can explain a large fraction of reported psi‑like effects (MPI‑E016); Maier & Dechamps demonstrate a concrete case where a software error produced a spurious micro‑PK correlation (MPI‑E017); and Flores’ Monte‑Carlo work identifies high intercorrelations among matrix variables and shows that dependence‑aware simulations diminish the original surpluses (MPI‑E007, MPI‑E009). Grote’s 2017 study provides a direct example of post‑hoc analysis choices extracting a significant result from data where all preplanned tests are null (MPI‑E006). Together, these make it plausible that the matrix record could arise from null data subject to these influences. The strongest opposing consideration is that no single quantitative model has yet been fit to the actual matrix corpus to demonstrate sufficiency — and some preregistered or dependence‑aware positives (Walach 2020; parts of Flores’ work) remain unexplained in detail, leaving a residual ambiguity.

Provisionally supportedconfidence: moderate · Grok 4.6 (xAI) — independent check run via grok-4.6 · run 2026-08-23-check-grok · unreviewed draft

Each named mechanism is attested in or next to this corpus: dependence inflating cell counts (Flores), analytic flexibility manufacturing significance (Grote 2017’s post-hoc p = 0.012 against three preplanned nulls), a coding error producing a false micro-PK positive (Maier and Dechamps), and publication-bias sensitivity in the parent REG literature (Bösch 2006). Joint sufficiency for this specific matrix record has not been shown; Bierman’s neighboring ganzfeld simulation explained about sixty percent of that effect, not all of it, and only under realistic QRP rates. The strongest opposing consideration is that Walach 2020 was preregistered-era, adequately powered, and still reported a surplus, and Flores found effects in three of five studies using analyses designed to respect dependence — the mundane account predicts a cleaner kill than the file contains.

Provisionally supportedconfidence: moderate · Kimi K3 (Moonshot, via Venice) — independent check run via kimi-k3 · run 2026-08-23-check-kimi · unreviewed draft

Each component mechanism is documented in or immediately adjacent to this corpus: violated independence assumptions (Flores's Monte Carlo work), analytic flexibility demonstrated live in Grote 2017's post-hoc-only significance, a coding error manufacturing a celebrated micro-PK effect in the neighboring line, and publication-bias sensitivity in the parent REG literature. The strongest opposing consideration has two prongs: the sufficiency claim is quantitative and has never been demonstrated against this specific corpus — no simulation calibrated to the matrix record has reproduced it — and the best-controlled positive (Walach 2020, preregistered and powered) is exactly the kind of result this account predicts should not occur, with Flores's permutation-surviving results beside it. Bierman's QRP simulation cuts both ways: it quantifies how far mundane mechanisms really go, and in the best-studied neighboring database they covered about sixty percent, not everything. Plausible, mechanism-rich, but not yet shown sufficient.

Provisionally supportedconfidence: moderate · Opus 5 (Anthropic) — independent check run via claude-opus-5 · run 2026-08-23-check-opus · unreviewed draft

Every component mechanism is documented operating inside or adjacent to this literature: dependence inflating cell counts (Flores), analytic flexibility manufacturing p = 0.012 from null data (Grote 2017), a coding error manufacturing a micro-PK effect (Maier and Dechamps), and publication bias as the most economical account of the parent REG meta-analysis (Bösch 2006). The account also correctly predicted the outcome of the corpus's strictest test. What holds it short of well_supported is that "jointly sufficient" has never been demonstrated by a simulation calibrated to the actual matrix record. The strongest opposing consideration is the residue: a preregistered, adequately powered 2020 replication reported a surplus anyway, and Flores's permutation analyses — designed to kill exactly this artifact — left three of five studies significant.

Provisionally supportedconfidence: moderate · anthropic/claude-fable-5 (scheduled maintenance run) · run 2026-08-24-auto-nml8 · unreviewed draft

Unchanged: each component mechanism is documented in or beside this corpus (MPI-E006, MPI-E015, MPI-E017), and the blind-analysis null is its predicted outcome. It stops short of well_supported because no calibrated simulation reproduces this specific record, and MPI-E016 shows the analog effort covered only ~60% of a neighboring effect.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-55lt · unreviewed draft

Each component is documented nearby — analytic flexibility (MPI-E006), publication bias (MPI-E015), coding error (MPI-E017), dependence (MPI-E007) — and MPI-E004 is the outcome it predicts. It falls short of well_supported because no calibrated simulation reproduces this specific record and MPI-E016 shows the analogous exercise covered only ~60% of a neighboring effect.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-5g7b · unreviewed draft

Each component mechanism is documented nearby — analytic flexibility (MPI-E006), publication bias (MPI-E015), coding error (MPI-E017), dependence (MPI-E007) — and the blind-analysis null (MPI-E004) is its predicted outcome. It falls short of well_supported because no calibrated simulation reproduces this specific record, and MPI-E016 shows the analog effort covered only ~60% of a neighboring effect.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-vhx9 · unreviewed draft

Each component is documented nearby — analytic flexibility (MPI-E006), publication bias (MPI-E015), coding error (MPI-E017), dependence (MPI-E007) — and MPI-E004 is its predicted outcome. Short of well_supported because no calibrated simulation reproduces this specific record and MPI-E016 shows the analogous effort covering only ~60% of a neighboring effect.

Provisionally supportedconfidence: moderate · Gemini 3.1 Pro (Google) — independent check run via gemini-3.1-pro-preview · run 2026-08-25-check-gemini · unreviewed draft

Documented instances of analytic flexibility (MPI-E006), software errors producing false positives (MPI-E017), and statistical dependence inflating significance (MPI-E007) establish that these mundane mechanisms actively govern this literature. Simulations also show questionable practices explain the vast majority of related flagship phenomena (MPI-E016). The strongest opposing consideration is that a specific, quantitative simulation fully reproducing the exact decline and displacement record of the matrix corpus has not yet been formally calibrated and published.

Provisionally supportedconfidence: moderate · GPT-5.1 (OpenAI) — independent check run via gpt-5.1 · run 2026-08-25-check-gpt · unreviewed draft

Each component of the conventional explanation is concretely instantiated here: dependence among psychological variables and its inflationary effect on significant-cell counts are documented by Flores’s Monte Carlo and permutation analyses (MPI-E007, MPI-C009); analytic flexibility is directly illustrated by Grote’s 2017 post-hoc-only positive (MPI-E006); publication bias and small-study effects in the broader REG literature are highlighted by Bösch 2006 (MPI-E015); and a major micro-PK effect’s collapse under a coding error (Maier & Dechamps 2022) shows how false positives can arise and persist (MPI-E017). Together, these make it provisionally credible that such mechanisms suffice to explain the matrix record, though no single quantitative model has yet reproduced the entire corpus, and some larger, more conservative positives (e.g., Walach 2020) remain as a counterweight.

Provisionally supportedconfidence: moderate · Grok 4.6 (xAI) — independent check run via grok-4.6 · run 2026-08-25-check-grok · unreviewed draft

Dependence-inflated cell counts, a post-hoc rescue of a null study (Grote 2017, p = 0.012 after three preplanned misses), a coding-error false positive in a neighboring micro-PK line, and a large REG meta-analysis that favors publication bias are all in this corpus or its immediate parent literature, and they jointly predict early selected positives followed by decline under tighter methods — which is the record we have. Sufficiency for this specific matrix series has not been demonstrated by a calibrated simulation, and Bierman 2016 covered only about sixty percent of a different flagship effect, so the claim stops short of well_supported. The strongest opposing consideration is that Walach 2020 and parts of Flores survived procedures intended to block the very artifacts invoked, which the mundane account says should not happen cleanly.

Provisionally supportedconfidence: moderate · Opus 5 (Anthropic) — independent check run via claude-opus-5 · run 2026-08-25-check-opus · unreviewed draft

Each component is independently evidenced within or adjacent to this corpus: dependence inflating cell counts (Flores), analytic flexibility manufacturing significance from the same null data (Grote 2017's post-hoc p = 0.012 against three preplanned nulls), an ordinary coding error manufacturing a micro-PK effect (Maier and Dechamps), and publication bias as the most economical account of the parent REG literature (Bösch 2006). The account also made and won a forward prediction: the strictest design returned null. What blocks a stronger verdict is that "jointly sufficient" has never been demonstrated quantitatively against this specific corpus, and the closest calibration — Bierman's QRP simulation on ganzfeld — covered about 60% of that effect while requiring implausible parameters to reach 100%. The strongest opposing consideration is the residue: a preregistration-era two-lab positive and three of five permutation-based positives that this account must attribute to selection and flexibility without having shown it can.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (reconsideration — deliberately non-blind: engages the panel's dissents) · run 2026-08-25-reconsider-zaqo · unreviewed draft

Every component is documented nearby — analytic flexibility (MPI-E006), publication bias (MPI-E015), coding error (MPI-E017), dependence (MPI-E007) — and MPI-E004 is its predicted outcome. Short of well_supported because no calibrated simulation reproduces this specific record and MPI-E016 shows the analog effort covered only ~60% of a neighboring effect. Gemini's and GPT's caution here is conceded and already priced in.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-26-auto-5996 · unreviewed draft

Each component is documented nearby — analytic flexibility (MPI-E006), publication bias (MPI-E015), coding error (MPI-E017), dependence (MPI-E007) — and MPI-E004 is its predicted outcome. Short of well_supported because no calibrated simulation reproduces this specific record and MPI-E016 shows the analogous effort covered only ~60% of a neighboring effect.

Provisionally supportedconfidence: moderate · none — mechanical migration (scripts/migrations/2026-09-08-editions.ts) · run 2026-09-08-migration-mpi · unreviewed draft

Each component mechanism is documented in or near this corpus: the dependence problem (Flores's Monte Carlo work), analytic flexibility (Grote 2017's post-hoc-only significance), error-driven false positives (Maier & Dechamps), publication-bias sensitivity (Bösch 2006). What keeps this short of well_supported: no one has yet shown quantitatively that these mechanisms reproduce the specific published record, and the strongest QRP simulation in the neighborhood (Bierman 2016, on ganzfeld data) explained about 60% of that effect, not all of it.