Skip to the content
Aletheia

Elusive by Law · claim MPI-C002 · Observation rung · The replication record

Preregistered and blind-analysis replications of the correlation-matrix experiment have predominantly failed to reproduce the excess-correlation effect.

When the matrix experiment was rerun under the strictest modern rules — analysis plans frozen in advance, in one case the entire analysis software written and tested before anyone looked at the data — the effect mostly disappeared.

AI-extractedorigin: Verification batch 2026-08-22 — Grote 2021, Walach et al. 2021, Maier & Dechamps 2022

credibility — is the claim itself true?

Well supported

The strongest-designed tests are unambiguous: Grote's 200-participant blind analysis fell "well within the expected random distribution," and the proponents' own two consensus-protocol replications were null. The partial exceptions (Walach 2020; three of Flores's five studies) predate or sidestep the strictest controls.

diagnosticity — how much does it decide the thesis?

low

This is the case's central twist: a null replication record undermines the anomaly reading and simultaneously matches MPI's own decline prediction. By itself, this observation cannot separate the hypotheses — which is why the falsifiability crux (MPI-C010) exists.

Evidence

Supports (3)

Supports· strongMPI-E003

Nailing Jelly: two preregistered consensus-protocol replications fail

what the source states
Following a consensus protocol deposited on OSF before commencement, two independent replications of the 2020 experiment were run with the same equipment: 64 participants (post-hoc power 0.88) and 40 participants (power 0.69), analyzed by a nonparametric randomization test with 10,000 iterations. "Neither of the two experiments was significant." The authors conclude "that the matrix experiment in and of itself is not a replicable paradigm in PSI research."
what we infer
The proponents' own team, on the model's own chosen benchmark, under a protocol they froze in advance — the cleanest confirmation that the excess-correlation effect does not replicate on demand. Note the interpretive move that follows in the same abstract: the failure is read as "likely part of the systematic nature of such effects," which is the falsifiability crux (MPI-C010) in action.
limitations
  • Power for the second replication was low (0.69); the first was adequately powered.
  • Standard power analysis is itself contested under a model that denies stable effects — the authors provide theirs only post hoc.
Walach, H. (2021)AI-verified citation
Supports· strongMPI-E004

Grote 2021: full blind analysis of 200 participants finds nothing

what the source states
An independent conceptual replication built from scratch tested 200 participants under a blind-analysis protocol in which the complete analysis software was written and tested before the data were analyzed; the unblinding was performed live at the 2019 Parapsychological Association convention. "The main result was found to be not statistically significant and fell well within the expected random distribution of possible results." Two secondary/post-hoc analyses each yielded p = 0.06.
what we infer
The methodologically strictest test in the corpus, by an experimenter independent of Lucadou's group, on the model's nominated paradigm: null. Under the conventional account this is the expected result; under MPI it is absorbed as decline — which is why this record weighs more against MPI-C007 than any single positive weighs for it.
limitations
  • The two p = 0.06 secondary results are reported by the author as suggestive anecdota, not confirmations.
Grote, H. (2021)AI-verified citation
Supports· moderateMPI-E006

Grote 2017: preplanned analyses null; a post-hoc variant significant

what the source states
Twenty participants, 720,000 bits, three analyses defined and tested before looking at the data — including a conceptual replication of the correlation-matrix method. Results: p = 0.438, p = 0.703, and p = 0.0949 for the three preplanned analyses (combined p = 0.315). "While none of the pre-defined analysis results is found significant, a post-hoc variant of analysis 3 that includes the control data is significant with p = 0.012."
what we infer
One study, both lessons: the preplanned nulls extend the failed replication record (MPI-C002), and the significant post-hoc variant is a live demonstration of how analytic flexibility can conjure a positive from the same data (MPI-C008). The synthesis document that seeded this case cited the post-hoc figure as a replication success — an error this import corrects.
limitations
  • Small sample (20 participants) limits what the preplanned nulls can exclude.
Grote, H. (2017)AI-verified citation

strongest unresolved objection

"Predominantly" is doing work: Walach et al. 2020 was itself a preregistration-era replication that reported a significant effect, and Flores reported three of five significant under permutation analyses — the record is messier than a clean null.

what would change our mind

  • Further adversarial blind-analysis replications, in either direction.
  • A significant result under a Grote-style full blind-analysis protocol would remove the 'strictest tests are null' pattern.

research that would move this claim

Assessment history

Append-only AI overlay records; the canon claim file is never mutated.

Well supportedconfidence: high · Fable (Claude), via Cursor · run 2026-08-22-fable-1 · unreviewed draft

Grote's blind analysis and both consensus-protocol replications are unambiguous nulls, reported by the proponents themselves in the second case. The partial exceptions are honestly recorded and do not overturn the pattern that the strictest designs found nothing.

Well supportedconfidence: high · Gemini 3.1 Pro (Google) — independent check run via gemini-3.1-pro-preview · run 2026-08-23-check-gemini · unreviewed draft

The methodologically strictest modern replications—including the proponents' own preregistered consensus protocols and an independent full blind analysis by Grote—have unambiguously failed to reproduce the matrix effect. While a few earlier or partial tests reported mixed or positive results, the overarching pattern is that when analytic flexibility is completely removed, the effect vanishes. The strongest opposing consideration is that a few in-house studies and an unreviewed online preprint still claim partial significance, preventing a completely uniform null record.

Well supportedconfidence: high · GPT-5.1 (OpenAI) — independent check run via gpt-5.1 · run 2026-08-23-check-gpt · unreviewed draft

Multiple independent lines of evidence show that the strictest replications have been null. Walach et al.’s two consensus‑protocol replications, with preregistered methods and nonparametric randomization tests, both failed to find significant excesses and concluded that the matrix paradigm is not replicable (MPI‑E003). Grote’s 200‑participant blind‑analysis study, in which the entire analysis pipeline was frozen before unblinding, likewise found results squarely in the range of chance (MPI‑E004). These tests specifically target the original matrix effect with modern safeguards against bias. The main opposing consideration is that Walach 2020, a preregistration‑era replication, did report a significant surplus, and Flores’ thesis reports three of five significant studies; thus “predominantly failed” does allow non‑negligible exceptions and the record is not uniformly null.

Well supportedconfidence: high · Grok 4.6 (xAI) — independent check run via grok-4.6 · run 2026-08-23-check-grok · unreviewed draft

The two strongest-designed tests in the file are null: Grote’s 200-participant blind analysis fell well inside the chance distribution, and Walach et al. 2021 reported that neither consensus-protocol replication was significant, concluding the paradigm is not replicable. Grote 2017 adds three preplanned nulls. “Predominantly” is therefore the right adverb. The strongest opposing consideration is that Walach et al. 2020 was itself a modern, simulation-evaluated positive, and Flores reported three of five thesis studies significant under permutation tests, so the record is not a clean sweep of failures.

Well supportedconfidence: moderate · Kimi K3 (Moonshot, via Venice) — independent check run via kimi-k3 · run 2026-08-23-check-kimi · unreviewed draft

The strictest tests in the corpus are unambiguous: Grote's 200-participant full blind analysis fell well within the chance distribution, and the proponents' own two OSF-deposited consensus-protocol replications were both null, with Grote 2017's three preplanned analyses adding to the pattern. The word "predominantly" is accurate and necessary. The strongest opposing consideration is that the record is not a clean null: Walach 2020 was itself a preregistration-era, adequately powered replication reporting significance, and Flores reports three of five studies significant under conservative permutation analyses. Those exceptions are real but weaker than they look — the 2020 effect was deflated as "fragile" by its own authors under improved analyses, and Flores's five studies share equipment, personnel, and analytic choices, so they are not independent confirmations.

Well supportedconfidence: high · Opus 5 (Anthropic) — independent check run via claude-opus-5 · run 2026-08-23-check-opus · unreviewed draft

Four strict outcomes point one way: Grote 2017's three preplanned analyses (combined p = 0.315), Grote 2021's full blind analysis falling well within the chance distribution at n = 200, and both consensus-protocol replications in Walach et al. 2021, whose authors concluded the paradigm "is not a replicable paradigm in PSI research." The strongest opposing consideration is that "predominantly" is not "uniformly": Walach et al. 2020 was a preregistration-era, adequately-powered replication that reported a surplus, and Flores reported three of five significant under permutation tests. Even granting those, the ordering is clear — the tighter the analytic lockdown, the weaker the result — and the second 2021 replication's low power (0.69) does not disturb the pattern set by the first (0.88) and by Grote's blind test.

Well supportedconfidence: high · anthropic/claude-fable-5 (scheduled maintenance run) · run 2026-08-24-auto-nml8 · unreviewed draft

Unchanged: Grote's blind analysis (MPI-E004) and both consensus-protocol replications (MPI-E003) are clean nulls under the strictest available designs, reported by proponents themselves in the latter case. No new record contests this.

Well supportedconfidence: high · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-55lt · unreviewed draft

MPI-E004's full blind analysis and both consensus-protocol replications in MPI-E003 are clean nulls under the strictest designs in the corpus, with MPI-E006's preplanned nulls extending the pattern. Nothing in the record contests the observation.

Well supportedconfidence: high · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-5g7b · unreviewed draft

Grote's full blind analysis (MPI-E004) and both consensus-protocol replications (MPI-E003) are clean nulls under the strictest designs available, the latter reported by the proponents themselves. MPI-E006's preplanned nulls extend the pattern; no record contests it.

Well supportedconfidence: high · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-25-auto-vhx9 · unreviewed draft

MPI-E004's blind analysis of 200 participants and both consensus-protocol replications in MPI-E003 are clean nulls under the strictest designs available, with MPI-E006's preplanned nulls extending the pattern. No record in the corpus contests the generalization.

Well supportedconfidence: high · Gemini 3.1 Pro (Google) — independent check run via gemini-3.1-pro-preview · run 2026-08-25-check-gemini · unreviewed draft

Evidence firmly establishes this null trend under strict conditions. The most rigorous blind-analysis test (MPI-E004) and the proponents' own consensus-protocol replications (MPI-E003) both yielded explicitly null results. The strongest opposing consideration is that a large two-lab preregistered replication (MPI-E002) and some permutation-based analyses (MPI-E007) still reported partial successes, indicating the record is slightly messier than a pure uniform failure.

Well supportedconfidence: high · GPT-5.1 (OpenAI) — independent check run via gpt-5.1 · run 2026-08-25-check-gpt · unreviewed draft

Grote’s 200-participant blind analysis and Walach et al.’s two consensus-protocol replications are all preregistered or preregistration-era studies that used fixed analysis plans and, in Grote’s case, locked software before unblinding; all three failed to find significant excess correlations (MPI-E003, MPI-E004). These are the methodologically strongest tests of the paradigm and directly support the statement that such replications have predominantly failed. The main counter-consideration is that not all preregistration-era work was null — Walach 2020 and parts of Flores’s thesis reported positives — but these either lacked full blind analysis or were less independently controlled, so they qualify “predominantly” without overturning it.

Well supportedconfidence: high · Grok 4.6 (xAI) — independent check run via grok-4.6 · run 2026-08-25-check-grok · unreviewed draft

The two cleanest modern tests failed: Walach et al. 2021 froze a consensus protocol on OSF and obtained nulls in both replications, concluding the paradigm is not replicable; Grote 2021 wrote and locked the entire analysis before unblinding 200 participants and landed well inside the chance distribution. Grote 2017's three preplanned analyses were likewise null. "Predominantly" survives the messiness: Walach 2020 predates those tighter controls and was later called fragile by its authors, and Flores's three-of-five thesis results were not full blind-analysis, preregistered replications. The strongest opposing consideration is that the record is not a clean sweep of nulls once every modern-era positive is counted.

Well supportedconfidence: high · Opus 5 (Anthropic) — independent check run via claude-opus-5 · run 2026-08-25-check-opus · unreviewed draft

Among the tests that actually froze analysis in advance, the record is close to uniform: Grote's three preplanned analyses were null (p = 0.438, 0.703, 0.0949), his full blind-analysis study of 200 participants fell "well within the expected random distribution," and the proponents' own two consensus-protocol replications, deposited on OSF before collection, were both null and led their authors to call the paradigm non-replicable. The strongest opposing consideration is the scope of "predominantly": Walach 2020 was a modern, hardware-rebuilt, simulation-evaluated replication that reported a surplus, and Flores reported three of five positives — but 2020's significance broke down under the authors' own improved analyses, and the Flores studies were neither blind-analysed nor independently preregistered as described here. Low power in the second Walach 2021 replication (0.69) slightly softens the claim without changing its direction.

Well supportedconfidence: high · anthropic/claude-opus-5 (reconsideration — deliberately non-blind: engages the panel's dissents) · run 2026-08-25-reconsider-zaqo · unreviewed draft

Grote's full blind analysis (MPI-E004) and both consensus-protocol replications (MPI-E003), the latter reported by proponents, are clean nulls under the strictest designs in the corpus; MPI-E006's preplanned nulls extend the pattern. No record contests it.

Well supportedconfidence: high · anthropic/claude-opus-5 (scheduled maintenance run) · run 2026-08-26-auto-5996 · unreviewed draft

Grote's full blind analysis (MPI-E004) and both consensus-protocol replications reported by proponents (MPI-E003) are clean nulls under the strictest designs available; MPI-E006's preplanned nulls extend the pattern. No record in the corpus contests it.

Well supportedconfidence: high · none — mechanical migration (scripts/migrations/2026-09-08-editions.ts) · run 2026-09-08-migration-mpi · unreviewed draft

The strongest-designed tests are unambiguous: Grote's 200-participant blind analysis fell "well within the expected random distribution," and the proponents' own two consensus-protocol replications were null. The partial exceptions (Walach 2020; three of Flores's five studies) predate or sidestep the strictest controls.