Skip to the content
Aletheia

Elusive by Law · claim MPI-C009 · Attribution rung · The conventional statistics steelman

Intercorrelation among the psychological variables violated the independence assumptions of the original correlation-matrix analyses, and dependence-aware reanalyses substantially diminish the founding excess-correlation results.

The sharpest technical objection: counting significant cells only means something if the cells are independent. The psychological variables in these matrices strongly correlate with each other, so clusters of "significant" cells come in bundles. Simulations that respect this shrink the original headline numbers.

AI-extractedorigin: Verification batch 2026-08-22 — Flores 2021 thesis and Flores & Rapazote-Flores 2023

credibility — is the claim itself true?

Provisionally supported

Reported from inside the research program itself (Flores worked under Watt and Walach), which raises its credibility as a concession against interest. The full quantitative reanalysis of the founding datasets has not been published as a standalone, independently reviewed result.

diagnosticity — how much does it decide the thesis?

high

Directly attacks the load-bearing statistic of the founding experiments (MPI-C001). If it holds in full, the program's origin story weakens from "anomaly detected" to "artifact detected."

Evidence

Qualifies (1)

Qualifies· moderateMPI-E007

Flores 2021: five in-house replications, three significant under permutation tests

what the source states
A doctoral thesis under Watt and Walach ran five replication studies, the first two exact replications using Lucadou's own RNG, software, and protocol, with new control and analysis methods introduced and compared against the originals. Per the successor preprint's summary, Flores "still reports significant results in three out of five studies," while her Monte Carlo work found that high intercorrelations among psychological variables had inflated the original studies' significance.
what we infer
The most double-edged record in the case: partial positive results that survive her own dependence-aware analyses, produced inside the same project that sharpened the strongest statistical critique of the founding experiments. It qualifies both the clean-null narrative and the founding results at once.
limitations
  • Thesis examination rather than journal peer review; the five studies share equipment, personnel, and analytic choices, so they are not five independent confirmations.
Flores, A. B. (2021)AI-verified citation

strongest unresolved objection

Flores herself still reports three of five thesis studies significant under permutation analyses that respect the dependence structure — the critique shrinks the founding results but has not, on its own terms, zeroed out the program.

what would change our mind

  • An independent, published dependence-aware reanalysis of the 1986–2020 matrix datasets.

parent claims

research that would move this claim

Assessment history

Append-only AI overlay records; the canon claim file is never mutated.

Provisionally supportedconfidence: moderate · Fable (Claude), via Cursor · run 2026-08-22-fable-1 · unreviewed draft

Reported as a concession against interest from inside the program, which raises credibility; not yet published as a standalone, independently reviewed reanalysis of the founding datasets, which caps it.

Provisionally supportedconfidence: moderate · Gemini 3.1 Pro (Google) — independent check run via gemini-3.1-pro-preview · run 2026-08-23-check-gemini · unreviewed draft

Simulations from within the research program itself have demonstrated that high intercorrelations among psychological variables artificially inflate the significance counts used in the original matrix studies. This dependence critique directly undermines the statistical foundation of the early positive reports. The strongest opposing consideration is that this reanalysis currently exists primarily in a doctoral thesis and unreviewed preprint, and has not yet completely zeroed out the effects in all datasets subjected to it.

Provisionally supportedconfidence: moderate · GPT-5.1 (OpenAI) — independent check run via gpt-5.1 · run 2026-08-23-check-gpt · unreviewed draft

Flores’ thesis and subsequent preprint explicitly report that psychological variables in the matrix experiments exhibit high intercorrelations and that simulations incorporating this dependence reduce the apparent significance of earlier studies; this is quoted verbatim in MPI‑E009 and comes from within the same research program that had previously reported positive results. This concession against interest strongly supports the methodological critique that the founding analyses over‑counted significant cells by assuming independence. The main opposing consideration is that we do not yet have a fully independent, published, dependence‑aware reanalysis of all founding datasets quantifying “substantially diminish” in standardized effect‑size or p‑value terms, and Flores herself still finds some significant results under permutation tests, suggesting the critique weakens but may not fully erase the anomalies.

Provisionally supportedconfidence: moderate · Grok 4.6 (xAI) — independent check run via grok-4.6 · run 2026-08-23-check-grok · unreviewed draft

Flores, working inside the program under Watt and Walach, reports that psychological variables were highly intercorrelated and that simulations respecting that dependence diminished the initial significant results — a concession against interest, quoted in the 2023 preprint. That directly attacks the load-bearing statistic of MPI-C001. The strongest opposing consideration is that the full quantitative reanalysis of the 1986–2006 founding datasets has not been published as a standalone reviewed result, and Flores herself still reported three of five thesis studies significant under permutation tests, so the critique shrinks the origin story without zeroing out the later program on its own terms.

Provisionally supportedconfidence: moderate · Kimi K3 (Moonshot, via Venice) — independent check run via kimi-k3 · run 2026-08-23-check-kimi · unreviewed draft

This is the sharpest technical attack on the program's foundation and it comes from inside: Flores's own thesis work found high intercorrelation among the psychological variables, and the 2023 successor states plainly that when dependence-respecting simulations were incorporated, "the results from these studies diminished" — a concession against interest that raises credibility. Two limitations hold it at provisional: the full dependence-aware reanalysis of the founding datasets has never been published as a standalone, independently reviewed result, so the magnitude of the shrinkage is summarized rather than demonstrated; and the critique has not zeroed the program even on its own terms, since the same project reports three of five studies significant under permutation analyses. The strongest opposing consideration is precisely that residual: the critique shrinks the founding results without eliminating structured excesses under methods designed to answer it.

Provisionally supportedconfidence: low · Opus 5 (Anthropic) — independent check run via claude-opus-5 · run 2026-08-23-check-opus · unreviewed draft

The first conjunct is close to certain on general statistical grounds and is directly reported by Flores: behavioural variables derived from one key-pressing session are heavily intercorrelated, so counting significant cells against independence overstates the evidence. The second conjunct — that dependence-aware reanalyses substantially diminish the founding results — is thin. It rests on a single sentence in an unreviewed preprint whose referent ("results from these studies") plausibly denotes Flores's own replications rather than the 1986–2006 originals, whose raw data are unpublished and therefore not reanalysable. The strongest opposing consideration is internal to the same work: Flores's permutation analyses shrank but did not eliminate the effect, retaining significance in three of five studies. The direction of the evidence favours the claim; its quantity does not support high confidence.

Provisionally supportedconfidence: moderate · anthropic/claude-fable-5 (scheduled maintenance run) · run 2026-08-24-auto-nml8 · unreviewed draft

Unchanged: the dependence critique comes from inside the program (MPI-E007), a concession against interest that raises credibility, but it has not yet appeared as a standalone peer-reviewed reanalysis of the founding datasets.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-55lt · unreviewed draft

The dependence critique is a concession against interest from within the program (MPI-E007), which raises its credibility. But it has not appeared as a standalone peer-reviewed reanalysis of the founding datasets, so the 'substantially diminish' half remains unaudited.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-5g7b · unreviewed draft

The dependence critique originates inside the program (MPI-E007), a concession against interest that raises credibility. It has still not appeared as a standalone peer-reviewed reanalysis of the founding datasets, so the 'substantially diminish' half remains unaudited.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-vhx9 · unreviewed draft

The dependence critique is a concession against interest from inside the program (MPI-E007), which raises its credibility considerably. But it has not appeared as a standalone peer-reviewed reanalysis of the founding datasets, so the 'substantially diminish' half remains unaudited.

Provisionally supportedconfidence: high · Gemini 3.1 Pro (Google) — independent check run via gemini-3.1-pro-preview · run 2026-08-25-check-gemini · unreviewed draft

Research originating from within the program itself demonstrates that psychological variables in these matrices are highly intercorrelated (MPI-E007). When permutation and Monte Carlo simulations properly account for this structural dependence, the significance of the original results diminishes notably. The strongest opposing consideration is that even under these dependence-aware permutation tests, partial statistical significance still survives in a subset of the modern replication studies.

Provisionally supportedconfidence: moderate · GPT-5.1 (OpenAI) — independent check run via gpt-5.1 · run 2026-08-25-check-gpt · unreviewed draft

Flores’s thesis and subsequent preprint explicitly state that the psychological variables in matrix experiments exhibit high intercorrelations and that simulations respecting this dependence reduce the apparent strength of earlier significant results (MPI-E007, MPI-E016). This directly supports the claim that independence assumptions were violated and that dependence-aware reanalysis diminishes the founding effects. The strongest contra point is that Flores herself still finds three of five thesis studies significant under permutation tests that account for dependence, implying that while the critique weakens the original claims, it does not clearly eliminate all evidence for an excess-correlation effect.

Provisionally supportedconfidence: moderate · Grok 4.6 (xAI) — independent check run via grok-4.6 · run 2026-08-25-check-grok · unreviewed draft

Flores, working inside the program under Watt and Walach, found high intercorrelations among the psychological variables and reported that incorporating simulations diminished the earlier significant results — a concession against interest, later restated in the 2023 preprint. That is direct evidence that the independence assumption of the founding analyses was false and that correcting it shrinks the headline surpluses. The strongest opposing consideration is that the full quantitative reanalysis of the 1986–2006 datasets has not been published as a standalone reviewed result, and Flores herself still reported three of five thesis studies significant under permutation tests that respect dependence, so the critique weakens the origin story without zeroing out the program on its own terms.

Provisionally supportedconfidence: low · Opus 5 (Anthropic) — independent check run via claude-opus-5 · run 2026-08-25-check-opus · unreviewed draft

The first half of the claim is highly plausible and partly a priori: batteries of behavioural and psychological variables are routinely intercorrelated, so counting significant cells against an independence null overstates evidence — this leans on general statistical calibration as much as on the records here. The second half, that dependence-aware reanalysis substantially diminishes the founding results, rests on a single line of work (Flores 2021 thesis, summarized in a 2023 preprint), reported as a concession against interest but never published as a standalone, independently reviewed reanalysis, and apparently not applied to the 1986–2006 datasets themselves, whose raw data are unavailable. The strongest opposing consideration is internal: Flores's own permutation analyses still returned three of five significant, so the critique shrinks rather than zeroes the paradigm. Confidence is low because one unreviewed source is carrying a load-bearing technical verdict.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (reconsideration — deliberately non-blind: engages the panel's dissents) · run 2026-08-25-reconsider-zaqo · unreviewed draft

The dependence critique is a concession against interest from inside the program (MPI-E007), which raises credibility, but it has not appeared as a standalone peer-reviewed reanalysis of the founding datasets, so the 'substantially diminish' half remains unaudited.

Provisionally supportedconfidence: moderate · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-26-auto-5996 · unreviewed draft

The dependence critique is a concession against interest from inside the program (MPI-E007), which raises its credibility, but it has not been published as a standalone peer-reviewed reanalysis of the founding datasets, so the 'substantially diminish' half remains unaudited.

Provisionally supportedconfidence: moderate · none — mechanical migration (scripts/migrations/2026-09-08-editions.ts) · run 2026-09-08-migration-mpi · unreviewed draft

Reported from inside the research program itself (Flores worked under Watt and Walach), which raises its credibility as a concession against interest. The full quantitative reanalysis of the founding datasets has not been published as a standalone, independently reviewed result.