Skeptical Critiques & Debates

Skeptics of parapsychology raise three kinds of challenges: flaws in how studies are run (sensory leakage, file-drawer problem, optional stopping), problems with statistics (small effect sizes, multiple comparisons), and philosophical objections (parsimony, the “extraordinary claims” standard). Key skeptical voices include Ray Hyman, James Alcock, and Richard Wiseman; Susan Blackmore is sometimes also cited, though her experimental record (a single ganzfeld study within a 26-month dissertation period) is more limited than secondary sources often suggest — see the “Blackmore Database and Berger’s Audit” section below. The debate has been productive: many improvements in modern psi research came directly from skeptical pressure.

Key findings

  • Skeptical critiques focus on three areas: study design flaws, statistical problems, and philosophical objections.
  • Ray Hyman’s 1985 review of ganzfeld studies identified serious flaws in randomization, sound isolation, and reporting.
  • Hyman and parapsychologist Charles Honorton then worked together. They agreed on shared standards for future research.
  • Milton and Wiseman’s 1999 review found no reliable psi effect when stricter statistical controls were used.
  • Berger (1989) [8] documented that Blackmore’s “ten years of negative research” actually comprised 29 psi experiments conducted in a 26-month dissertation period (1976–1978), of which one was a ganzfeld study; her own 1987 first-person account [7] confirms the paradigm breakdown.
  • Modern psi experiments are better designed partly because skeptics pushed for higher standards.

Overview

Skeptical critiques of parapsychology cover a wide range. They touch on how studies are designed, how data are analyzed, and what assumptions researchers bring to the table.

The leading skeptics are not simply dismissive. Ray Hyman, James Alcock, Richard Wiseman, and Susan Blackmore have each looked closely at specific experiments. They have pointed to real sources of error: information leaking through normal senses, results that never get published, and flawed randomization. These critiques have had a real effect. Many of the controls used in today’s psi research were added because skeptics demanded them. In some cases, skeptics and parapsychologists worked together to set shared standards.

Core Claims and Frameworks

Skeptical arguments fall into three groups: methodological, statistical, and philosophical.

Methodological concerns ask whether the studies were run properly. The main worries are:

  • Sensory leakage: Information reaches the participant through normal channels (sound, sight, smell) rather than through any paranormal means.
  • The file-drawer problem: Studies that find nothing tend to stay unpublished. Only positive results get into journals. This makes the evidence look stronger than it is.
  • Optional stopping: A researcher keeps collecting data until the numbers look good, then stops. This inflates the chance of a false positive.
  • Weak blinding or randomization: If the person running the study knows which target was chosen, they might give subtle cues to the participant without meaning to.

Statistical concerns ask whether the numbers are being read correctly. Skeptics point out that small effect sizes can look impressive but may reflect bias rather than a real phenomenon. They also note that running many statistical tests at once raises the odds of finding a “significant” result by pure chance. And they argue that psi is so unlikely given what we know about physics that even a positive result should be treated with great caution.

Philosophical concerns ask whether psi is even a reasonable hypothesis. The principle of parsimony says we should prefer the simplest explanation that fits the data. Psi requires entirely new physical mechanisms. Skeptics argue that the bar for accepting such a claim must be very high.

Not all skeptics agree on emphasis or tone. Some focus tightly on flaws in specific studies. Others take a broader stance about what counts as good science. What they share is a demand for rigorous evidence before accepting any psi claim.

Evidence Base: Key Skeptical Critiques

The Hyman Ganzfeld Critique. In 1985, Ray Hyman published a detailed critical review of ganzfeld experiments.[1] The ganzfeld method was the most widely used protocol in psi research at the time. In a typical ganzfeld study, a “receiver” sits in a relaxed state while a “sender” in another room concentrates on a randomly chosen image. The receiver then tries to identify which image was sent, choosing from a small set of options. Hyman found multiple problems. Target sequences were not always randomized properly. Sound could leak between rooms. And researchers tended to report positive results while leaving negative ones unpublished. He argued these flaws were enough to explain the above-chance hit rates without invoking psi.

The Hyman-Honorton Joint Communique. Instead of simply trading attacks, Hyman and parapsychologist Charles Honorton worked together. In 1986 they published a joint statement in the Journal of Parapsychology.[2] Neither side declared victory. Instead, they agreed on what future ganzfeld studies would need: automated randomization, proper acoustic isolation, and pre-registered analysis plans (meaning researchers had to say in advance what they would measure and how). This showed that serious disagreement does not have to block productive collaboration.

Methodological Concerns from Alcock and Wiseman. James Alcock has spent years documenting how flaws in study design can inflate apparent results across parapsychology as a whole.[3] He has shown how file-drawer effects, optional stopping, and experimenter bias can each push results in a positive direction. Richard Wiseman has done detailed technical work on specific experiments. For example, he investigated whether sound could leak from the sender to the experimenter in automated ganzfeld systems, and whether an experimenter’s expectations could subtly influence participants.[4]

Meta-Analytic Challenges. In 1999, Milton and Wiseman combined results from many ganzfeld studies into a single statistical review.[5] When they applied proper statistical controls, they found no reliable evidence for psi. They also noticed that effect sizes varied a lot from lab to lab. Better-designed studies tended to show smaller effects. That pattern fits what you would expect if publication bias and selective reporting were driving the results, not a genuine psi signal.

Expectancy Effects. In 1997, Wiseman and Schlitz ran a study together on remote staring: the idea that people can sense when someone is looking at them from a distance.[6] They found that the experimenter’s own beliefs about psi seemed to affect the results. When Schlitz (a psi proponent) ran the sessions, results were positive. When Wiseman (a skeptic) ran them, results were not. This showed that even subtle, unintended cues from the experimenter can shape outcomes. It made the case for double-blind protocols even stronger.

The Blackmore Database and Berger’s Audit. In 1987, Blackmore published an essay in Skeptical Inquirer titled “The Elusive Open Mind: Ten Years of Negative Research in Parapsychology”[7]—a first-person account framing her parapsychological research as a decade of null results. Berger (1989) [8] published a critical examination in the Journal of the American Society for Psychical Research that documented the actual experimental record. Per Blackmore’s own dissertation reporting and Berger’s audit, the experimental work consisted of 29 psi experiments conducted between October 1976 and December 1978 (approximately 26 months) — 21 of which were published as separate experiments in five peer-refereed parapsychology journal papers. Blackmore’s 1987 first-person account confirms the paradigm breakdown: ESP/memory correlations (Blackmore 1980a), ESP testing with preschool children (Blackmore 1980b), target-material variations (Blackmore 1981a), error-pattern analyses (Blackmore 1981b), a single formal ganzfeld study with ten trained subjects and ten controls, and Tarot card readings (Blackmore 1983). Berger’s audit identified discrepancies between Blackmore’s unpublished dissertation and her published reports; “flaws” invoked to dismiss significant results while ignored when studies produced non-significant results; and two instances in which study chronology was reordered. Per the 29 experiments documented in Blackmore (1987) [7] and Berger (1989) [8], seven produced statistically significant results — a figure Blackmore’s 1987 framing of “the only noteworthy thing about all of the results was the number that were not significant” does not engage. Berger concluded that “no conclusions should be drawn from this database.” Post-1978, Blackmore’s research turned to out-of-body experiences, which she classifies in the same 1987 essay as non-paranormal. The “ten years of ganzfeld” framing that has circulated in secondary sources is not supported by either the cited literature or Blackmore’s own first-person account.

Deeper Dive: What is the file-drawer problem and why does it matter?

Imagine 20 labs each run the same psi experiment. By pure chance, about one of them will get a result that looks statistically significant (p < 0.05 means: if there were no real effect, a result this strong would happen by chance only about 5 times in 100 tries). That one lab publishes. The other 19 find nothing and put their data in a drawer. Anyone reading the literature sees one positive study and thinks there is evidence for psi. But the full picture is 1 positive out of 20, which is exactly what chance predicts.

This is the file-drawer problem. It does not require anyone to cheat. It is a structural feature of how science publishing works. Alcock and others have argued it is a major driver of apparent psi effects in the literature.[3] One partial fix is pre-registration: researchers publicly commit to their hypothesis and analysis plan before collecting data. That way, null results are harder to hide.

Deeper Dive: What is optional stopping?

Optional stopping means a researcher keeps collecting data and checks the results repeatedly as they go. When the numbers happen to look good, they stop and report. This is a problem because random data fluctuates. If you check often enough, you will almost always hit a moment when the numbers look significant, even if there is no real effect. Alcock has documented this as one of the ways apparent psi effects can be inflated without deliberate fraud.[3] Pre-registered protocols fix this by requiring researchers to set their sample size in advance.

Counterarguments and Debate

Critique 1: Skeptics apply a double standard to psi research.

Skeptic source: This is a parapsychologist counter-claim about skeptic positions; the skeptic positions cited in this section’s rebuttals are Hyman 1985 [R001] / Alcock 1987 [R003] / Milton & Wiseman 1999 [R005].

Response: Some parapsychologists argue that psi studies are held to stricter standards than mainstream psychology or neuroscience. They point out that many social psychology findings have also failed to replicate, yet those fields are not dismissed wholesale. Skeptics respond that the bar is higher for psi because the claim requires entirely new physics. The more a claim conflicts with well-established science, the stronger the evidence needs to be before it is accepted.

Analysis. Hyman 1985 [1] and Alcock 1987 [3] argue that claims requiring new physical mechanisms warrant evidentiary standards higher than those applied to claims fitting existing physics. An in-corpus parapsychologist reply paper engaging this threshold argument by name is not represented among the cited references on this page.

Critique 2: Null results just mean psi is fragile, not that it does not exist.

Skeptic source: This is a parapsychologist counter-claim about skeptic positions; the skeptic positions cited in this section’s rebuttals are Hyman 1985 [R001] / Alcock 1987 [R003] / Milton & Wiseman 1999 [R005].

Response: Parapsychologists sometimes argue that psi is sensitive to context, mood, or the relationship between experimenter and participant. Failed replications, they say, may reflect poor conditions rather than absence of the effect. Skeptics counter that this argument can explain away any negative result. A hypothesis that cannot be falsified is not scientific. If psi only appears under conditions that cannot be specified in advance, it is very hard to test rigorously.

Analysis. Alcock 1987 [3] characterizes hypotheses that retreat to context-sensitivity after failed replication as unfalsifiable in the Popperian sense. A pre-specified context-set under which psi is predicted to appear is not documented among the cited references on this page.

Critique 3: Skeptical meta-analyses cherry-pick studies.

Skeptic source: This is a parapsychologist counter-claim about skeptic positions; the skeptic positions cited in this section’s rebuttals are Hyman 1985 [R001] / Alcock 1987 [R003] / Milton & Wiseman 1999 [R005].

Response: Some psi proponents argue that Milton and Wiseman’s 1999 review[5] excluded studies that would have supported a positive conclusion. Skeptics reply that the inclusion criteria were set in advance and applied consistently. The heterogeneity of effect sizes across labs, they argue, is itself a red flag: a real effect should show up reliably across well-run studies, not just in some labs and not others.

Analysis. Milton and Wiseman 1999 [5] reported their inclusion criteria in advance and applied them uniformly to the studies in their sample. The variance in effect sizes across labs that they document is engaged by subsequent cited papers; an alternative meta-analytic resampling of the same studies under different inclusion criteria is not represented among the cited references on this page.

Current Discourse and Productive Outcomes

Modern psi experiments routinely use automated randomization, acoustic isolation, pre-registered protocols, and independent outcome assessment. Hyman 1985 [1], Alcock 1987 [3], Wiseman et al. 1996 [4], and Milton & Wiseman 1999 [5] each name specific procedural gaps that subsequent protocols addressed.

The Hyman-Honorton communique is the clearest example of how serious disagreement can still produce useful results.[2] Two people who disagreed sharply about whether psi exists agreed on what a well-run study would look like. That is a real scientific achievement.

Skeptical engagement with parapsychology is still active. Skeptics keep examining new claims and new methods. Parapsychologists keep trying to address the objections. The exchange is sometimes heated. But it has been more useful than either side simply ignoring the other.

The Hyman-Honorton communiqué [2] specifies what cited authors on both sides agreed would constitute methodologically adequate evidence: automated randomization, proper acoustic isolation, and pre-registered analysis plans. The standards published in 1986 and modeled in subsequent protocols are more specific than the standards described in the corpus that predates the communiqué.

References
  1. Hyman, R. (1985). The ganzfeld psi experiment: A critical appraisal. The Journal of Parapsychology, 49(1), 3–49. https://archive.org/details/sim_journal-of-parapsychology_1985-03_49_1 ↩︎
  2. Hyman, R., & Honorton, C. (1986). A joint communiqué: The psi ganzfeld controversy. Journal of Parapsychology, 50, 351–364. ↩︎
  3. Alcock, J. E. (1987). Parapsychology: Science of the anomalous or search for the soul?. Behavioral and Brain Sciences, 10, 553–643. https://doi.org/10.1017/s0140525x00054467 ↩︎
  4. Wiseman, R., Smith, M., & Kornbrot, D. (1996). Exploring possible sender-to-experimenter acoustic leakage in the PRL autoganzfeld experiments. Journal of Parapsychology, 60, 97–128. ↩︎
  5. Milton, J., & Wiseman, R. (1999). Does psi exist? Lack of replication of an anomalous process of information transfer. Psychological Bulletin, 125, 387–391. https://doi.org/10.1037/0033-2909.125.4.387 ↩︎
  6. Wiseman, R., & Schlitz, M. (1997). Experimenter effects and the remote detection of staring. Journal of Parapsychology, 61(3), 197–208. ↩︎
  7. Blackmore, S. J. (1987). The elusive open mind: Ten years of negative research in parapsychology. Skeptical Inquirer, 11(3), 244–255. https://www.susanblackmore.uk/articles/the-elusive-open-mind-ten-years-of-negative-research-in-parapsychology/ ↩︎
  8. Berger, R. E. (1989). A critical examination of the Blackmore psi experiments. Journal of the American Society for Psychical Research, 83(2), 123–144. ↩︎