Dean I. Radin, PhD Sources:
Sequential Analysis Methods for Psi Detection Enhancement
One persistent challenge in psi research is that genuine effects, if they exist, appear as very small statistical signals embedded in noisy data, a Type-II vulnerability where underpowered studies routinely fail to detect real phenomena. Radin has developed and applied sequential analysis techniques designed to reveal predicted structural patterns in large datasets that conventional trial-by-trial analyses miss entirely, most notably demonstrating that a 19-year online experiment yielding a null overall hit rate nonetheless contained a highly significant sequential signature.
Deeper dives — Radin:
Key findings
- A 19-year online forced-choice experiment (114 million trials, ~200,000 participants) produced a null overall hit rate but revealed a highly significant sequential pattern in the data: the probability of a correct guess following a previous correct guess (p₁) deviated from chance expectation at z = 11.28, p = 1.7 × 10⁻²⁹.1
- Sequential analysis methods applied to RNG data in the early 1990s provided evidence that person-specific “signatures” could be detected in mind-matter interaction data using neural network classifiers.2
- A 1990 replication and extension study demonstrated that sequential analysis could statistically enhance the detectability of psi effects beyond what standard trial-by-trial analysis reveals.3
- Smartphone-based psi testing at scale (thousands of participants across three iOS tasks) found that psi performance was often in the direction opposite to conscious intention, a “psi-missing” pattern, and that gender and psi belief were related to performance outcomes.4
- Meta-analytic reviews of forced-choice precognition experiments spanning 75 years found cumulative odds against chance of approximately 10²⁴, with the sequential structure of data contributing to detection sensitivity.5
Overview
The core methodological problem Radin has addressed throughout his career is that psi effects, if genuine, are small, typically effect sizes in the range of r = 0.01 to 0.05, and highly variable across individuals, sessions, and environmental conditions. Standard forced-choice protocols that treat each trial as independent and sum hits against chance expectation are poorly suited to detecting effects that may manifest not as uniform elevation of hit rates but as structured patterns across sequences of trials. A Type-II vulnerability is therefore endemic to this literature: studies powered to detect d = 0.50 will routinely miss effects at d = 0.05, leading to null results that are mistaken for disconfirmation.5 Radin’s sequential analysis program addresses this by asking not just “is the hit rate above chance?” but “does the sequence of hits and misses carry non-random structure that a psi hypothesis would predict?”1
Type-II Vulnerability in Psi Research
Radin’s 2011 review of 75 years of forced-choice precognition experiments noted that the four major classes of studies (forced-choice, free-response, psychophysiological, and implicit decision) each produced cumulative odds against chance far exceeding conventional significance thresholds, approximately 10²⁴, 10²⁰, 10¹⁷, and 10⁷ respectively, yet individual studies frequently failed to reach significance.5 This pattern is precisely what a small true effect with high variance would produce: meta-analytic aggregation reveals the signal that individual underpowered studies cannot. Sequential analysis is one methodological response to this problem, designed to extract structural information from data that standard hit-rate analysis discards.
Sequential Analysis: Foundations and Rationale
Radin’s interest in sequential structure in psi data dates to the late 1980s, when he and colleagues began applying methods from information theory and sequential statistics to RNG experiment outputs. The foundational insight is that if a participant’s mental state influences a random process, the influence may not manifest as a constant upward bias on every trial but rather as a tendency for certain trial-to-trial transitions to occur more or less often than chance, a sequential dependency invisible to simple hit-rate counting.3
Sequential Analysis Replication and Extension (1990)
Radin’s 1990 paper in the European Journal of Parapsychology reported a replication and extension of sequential analysis applied to psi experiment data, demonstrating that the method could statistically enhance the detectability of effects beyond what standard analysis revealed.3 The specific artifact addressed was the assumption of trial independence: if trials are not independent, because a participant’s mental state persists across trials, then treating them as independent discards information. The sequential method explicitly models transition probabilities between trial outcomes, testing whether the observed transition matrix departs from the independence baseline. The strength of ruling-out for the independence assumption was partially addressed: the method demonstrates non-independence but cannot fully distinguish psi-mediated from ordinary psychological sources of sequential dependency (e.g., response strategies, fatigue).
The broader theoretical context for sequential analysis in psi research involves what Radin has called the “trickster” quality of psi data, the observation that effects tend to appear in unexpected forms and disappear when directly sought.1 Sequential analysis is one strategy for catching effects that evade direct detection by looking for predicted structural regularities rather than simple mean shifts. The proposed mechanism, that psi operates on the sequential structure of random processes rather than their mean, remains the researcher’s preferred interpretation and is contested; alternative interpretations include response bias, optional stopping in the original studies, and selective reporting of sequential patterns post-hoc.
Information-Theoretic Models of Psi and RNG Data
Early work by Radin, May, and colleagues explored informational models of psi applied to RNG experiments, asking whether the structure of psi effects was better described by information-theoretic measures than by simple effect sizes.67 A 1988 experiment with a single subject tested whether precognition predicted actual or probable futures, finding evidence for precognition (p = .04) and support for the probable-futures hypothesis (p = .001), with a negative relationship between Shannon information in the target set and psi information transmitted (p = .03, two-tailed).8 These results informed the sequential analysis program by suggesting that psi effects carry information-theoretic signatures that standard hit-rate analysis may not capture.
The 19-Year Online Experiment
The most striking application of sequential analysis in Radin’s published work is the reanalysis of a massive online forced-choice dataset accumulated from August 2000 to December 2018. Two online psi experiments based on a five-target forced-choice protocol together collected 114 million trials from an estimated 200,000 participants worldwide. The overall hit rate was consistent with a null effect, the kind of result that would ordinarily be filed as a failed replication. However, a planned secondary analysis designed to detect a predicted sequential pattern produced a result that Radin describes as “statistically unambiguous.”1
Sequential Structure in 114 Million Trials
The specific sequential metric tested was p₁: the probability that a trial is correct given that the immediately preceding trial was also correct. With a five-target forced-choice protocol, the chance-expected rate for the sequential metric p₁ — the probability of a correct guess immediately following a correct guess — is p₀ = 0.32, and the observed p₁ across the combined dataset was 0.320502 ± 0.000044, yielding z = 11.28, p = 1.7 × 10⁻²⁹.1 Control tests were conducted to address the artifact of optional stopping and multiple comparisons: the sequential metric was specified in advance as the primary secondary analysis, and control analyses of non-psi sequential patterns in the data were used to assess whether the effect was specific to the psi-relevant transition or a general property of the dataset. The ruling-out of optional stopping was partially addressed by the fixed-N design (data collection ended by calendar date, not by result). The ruling-out of multiple comparisons was partially addressed by the pre-specification of the sequential metric, though the exploratory nature of the secondary analysis means this remains an unresolved concern. The researcher’s preferred interpretation is that the sequential structure reflects a genuine psi effect that manifests as trial-to-trial dependency rather than mean elevation. Alternative interpretations include systematic response strategies by participants that create sequential dependencies through ordinary psychological mechanisms.
The result is notable precisely because the conventional analysis, the one that would appear in any standard replication attempt, showed nothing. The sequential signal was invisible to the standard method and only emerged when the analysis was designed to look for it. This illustrates both the potential power of sequential analysis and its principal methodological vulnerability: a result that requires a specialized secondary analysis to detect is more susceptible to the criticism that the analysis was chosen post-hoc to find a significant result in otherwise null data.1
Competing Non-Psi Explanations for Sequential Effects
The primary non-psi explanation for sequential dependencies in forced-choice psi data is response strategy: participants may develop habitual patterns of target selection that create trial-to-trial correlations through ordinary psychological mechanisms such as the gambler’s fallacy (avoiding repetition) or its inverse (perseveration). Radin addressed this artifact in the 19-year dataset by analyzing the direction of the sequential effect: if participants were avoiding repetition, p₁ should be below chance; if perseverating, above chance. The observed p₁ was above chance, consistent with perseveration or with a psi effect, but the two cannot be fully distinguished without independent measurement of participants’ response strategies.1 A second non-psi explanation is that the online protocol allowed participants to develop feedback-based learning strategies over many trials, creating sequential dependencies through reinforcement learning rather than psi. The fixed-N design and automated protocol mitigated but did not eliminate this possibility, as participants could accumulate feedback across sessions.
Neural Network Analyses and Person-Specific Signatures
A parallel strand of Radin’s sequential analysis program uses artificial neural networks to search for person-specific patterns, “signatures”, in RNG data from mind-matter interaction experiments. The hypothesis is that if mental intention influences random processes, the influence may be idiosyncratic: different participants may perturb the data in characteristically different ways, and a neural network trained on one participant’s data should be able to identify that participant’s data in a blind test.2
Neural Network Signature Detection in RNG Data
Radin’s 1993 paper in the Journal of Scientific Exploration reported neural network analyses of consciousness-related patterns in random sequences, using new data and new network configurations to replicate a previously reported study.29 Eight analyses confirmed the presence of person-specific signatures. The artifact most directly addressed was the possibility that the neural network was detecting differences in participants’ response strategies or timing rather than differences in the RNG output itself: the network was trained and tested on the RNG data sequences, not on behavioral data. The ruling-out was partial: the network could detect person-specific patterns, but whether those patterns reflected psi-mediated influence on the RNG or ordinary individual differences in how participants interacted with the experimental interface (e.g., timing of button presses affecting which random bits were sampled) was not fully resolved. The researcher’s preferred interpretation is that the signatures reflect genuine mind-matter interaction; the alternative interpretation is that they reflect sampling artifacts from individual differences in response timing.
The neural network approach extends sequential analysis by moving beyond simple transition probabilities to higher-order sequential structure, patterns across longer runs of trials that a two-state Markov model would miss. This makes the method more sensitive but also more susceptible to overfitting, a concern that Radin acknowledged by using separate training and test datasets in the signature analyses.10
Smartphone-Based Psi Testing at Scale
The most recent large-scale application of sequential and demographic analysis in Radin’s program is a smartphone-based study conducted with collaborator Julia Mossbridge, using three iOS tasks available from 2017 to 2020 that collected data from thousands of participants on micro-psychokinesis and precognition tasks.4 The study used what the authors called a “SEARCH” approach, Systematically Exploring Associations between Characteristics and Results in Humans, to identify demographic and personality moderators of psi performance.
Demographic Moderators and Psi-Missing in Smartphone Data
Mossbridge and Radin (2021) analyzed data from thousands of participants across three iOS tasks.4 The primary finding was that psi performance was often in the direction opposite to participants’ conscious intentions, a pattern the authors called “expectation-opposing” (previously termed “psi-missing” in the literature). Gender and psi belief were found to be related to performance outcomes. The artifact of sampling bias was partially addressed by the large sample size and the diversity of the opportunity sample drawn from app store users, but the self-selected nature of participants who download a psi-testing app introduces selection bias that was not fully controlled. The artifact of multiple comparisons across 149 demographic and personality variables was addressed by reporting effect sizes and confidence intervals alongside p-values, but the exploratory nature of the analysis means that some significant findings may reflect Type-I error. The researcher’s preferred interpretation is that the psi-missing pattern reflects a genuine phenomenon in which conscious intention interferes with an underlying psi process; alternative interpretations include response bias and regression to the mean in participants who initially performed above chance.
The smartphone platform represents a methodological advance for sequential analysis because it enables data collection at a scale, millions of trials across thousands of participants, that makes sequential effects detectable even at very small effect sizes. The tradeoff is reduced experimental control compared to laboratory studies: participants complete tasks in uncontrolled environments, and the experimenter cannot monitor for sensory leakage, distraction, or strategic responding. Radin has noted this tradeoff explicitly, framing smartphone studies as hypothesis-generating rather than hypothesis-confirming.4 A preregistered adversarial collaboration study using the sequential analysis methods developed in the 19-year experiment, with independent replication of the p₁ metric in a new large-scale dataset, would be the most direct test of whether the sequential effect is robust or an artifact of post-hoc analysis selection.
Modern Context
The methodological debate around sequential analysis in psi research sits within a broader mainstream discussion about how to detect small true effects in large noisy datasets without inflating Type-I error. The challenge of distinguishing genuine sequential structure from post-hoc pattern-finding is not unique to parapsychology: it arises in genomics, financial time-series analysis, and behavioral economics. The specific concern that sequential analysis methods can be tuned to find significant patterns in any sufficiently large dataset, a form of the multiple comparisons problem applied to analysis-method selection, is a recognized issue in mainstream statistics that applies with particular force to exploratory secondary analyses of the kind reported in the 19-year experiment.1 The meta-analytic literature on forced-choice precognition, which Radin has reviewed extensively, faces the same publication-bias and file-drawer concerns that apply to any small-effect literature, and the sequential analysis approach does not resolve those concerns, it adds a new analytical layer on top of them.5
Skeptical Critiques and Discussion
Critique 1: Decision Augmentation Theory as an Alternative to Psi in Sequential Data
Skeptic source: May, Paulinyi, and Vassy (2005) argued that anomalous anticipatory effects in physiological data, including the electrodermal presentiment findings that share methodological features with sequential analysis approaches, are better explained by Decision Augmentation Theory (DAT), which proposes that participants unconsciously use precognitive information to select when to initiate trials, creating apparent sequential dependencies without any direct influence on the random process itself.11 Under DAT, the sequential structure detected in RNG data would reflect participants’ unconscious timing of their responses rather than any perturbation of the random output, a non-psi mechanism that would produce exactly the kind of trial-to-trial correlations that sequential analysis detects as significant.
Response: Radin published a direct response to May et al.’s DAT critique, arguing that the experimental designs used in his sequential analysis work included controls specifically intended to distinguish DAT-type timing effects from direct RNG influence: in automated protocols where trial initiation is computer-controlled rather than participant-initiated, DAT cannot account for sequential dependencies because participants have no opportunity to select trial timing.12 The 19-year online experiment used a computer-controlled trial sequence, partially addressing the DAT timing-selection artifact, though the online environment introduced other uncontrolled variables.1
Analysis. DAT and direct-influence models make different predictions about the relationship between trial-initiation timing and sequential effects, but the existing data do not cleanly distinguish them. Both the DAT critique and Radin’s rebuttal rest on partially controlled experiments; no adversarially designed preregistered study has yet tested the two models against each other in the sequential analysis paradigm.
Critique 2: Post-Hoc Analysis Selection and the Multiple Comparisons Problem
Skeptic source: A recurring methodological concern in the psi literature, raised by critics of the broader RNG and forced-choice paradigms, is that sequential analysis methods introduce a new layer of multiple comparisons: the analyst can choose among many possible sequential metrics (p₁, p₂, run-length distributions, entropy measures, autocorrelation functions) and report only the one that reaches significance. This concern applies directly to the 19-year experiment, where the overall hit rate was null and significance emerged only in a specific secondary analysis.13 The same concern was raised in the context of the Bösch, Steinkamp, and Boller (2006) meta-analysis of psychokinesis, where Radin and colleagues debated whether heterogeneity in effect sizes reflected selective reporting or a genuine sample-size dependency.
Response: Radin has addressed the multiple comparisons concern by arguing that the sequential metric used in the 19-year experiment (p₁, the probability of a hit following a hit) was specified in advance as a planned secondary analysis, not selected post-hoc from among many tested metrics.1 In the context of the RNG meta-analysis debate, Radin, Nelson, Dobyns, and Houtkooper argued that the assumption of effect-size independence from sample size, which underlies the selective-reporting interpretation, is incorrect for these experiments, because the physical constraints of the paradigm predict exactly the observed sample-size dependency.13
Analysis. The pre-specification claim for the sequential metric partially addresses the multiple comparisons concern but cannot be independently verified without a preregistered replication.
References
- Radin, D. I. (2019). Tricking the Trickster: Evidence for Predicted Sequential Structure in a 19-Year Online Psi Experiment. Journal of Scientific Exploration, 33(4), 549–568. https://journalofscientificexploration.org/index.php/jse/article/view/1429 R001 [Radin 2019] ↩︎
- Wallisch, Pascal, Dean I. Radin, Lusignan, Michael, Benayoun, Marc, Baker, Tanya I., Dickey, Adam S., Hatsopoulos, Nicholas G. (2009). Neural Network Part II. Matlab for Neuroscientists, 319–337. https://doi.org/10.1016/b978-0-12-374551-4.00029-4 R002 [Wallisch 2009] ↩︎
- Radin, D. I. (1990). Statistically enhancing psi effects with sequential analysis: A replication and extension. EJP, 8, 98–111. R003 [Radin 1990] ↩︎
- Mossbridge, J., & Radin, D. I. (2021). Psi Performance as a Function of Demographic and Personality Factors in Smartphone-Based Tests. Journal of Anomalous Experience and Cognition, 1(1-2), 78–113. https://journals.lub.lu.se/jaex/article/view/23419 R004 [Mossbridge 2021] ↩︎
- Radin, D. I., & Sheehan, D. P. (2011). Predicting the Unpredictable: 75 Years of Experimental Evidence. AIP Conference Proceedings, 1408, 204–217. https://doi.org/10.1063/1.3663725 R005 [Radin 2011] ↩︎
- May, E. C., Radin, D. I., Hubbard, G. S., Humphrey, B. S., & Utts, J. (1985). Psi experiments with random number generators: An informational model. Proceedings of Presented Papers Vol 1: The Parapsychological. R006 [May 1985] ↩︎
- Radin, D. I., May, E. C., & Thomson, M. J. (1985). Psi experiments with random number generators: Meta-analysis Part 1. Proceedings of the Parapsychological Association, 28. R007 [Radin 1985] ↩︎
- Radin, D. I. (1988). Effects of a priori probability on psi perception: Does precognition predict actual or probable futures? Journal of Parapsychology, 52, 187–212. https://www.dropbox.com/s/2z14wb6mpacf899/1998%20a%20priori%20prob.pdf?dl=1 R008 [Radin 1988] ↩︎
- Radin, D. I. (1993). Neural Network Analyses of Consciousness-Related Patterns in Random Sequences. Journal of Scientific Exploration, 7(4), 355–374. R009 [Radin 1993] ↩︎
- Radin, D. I. (1989). Searching for “signatures” in anomalous human-machine interaction data: A neural network approach. Journal of Scientific Exploration, 3(2), 185–200. https://www.scientificexploration.org/journal-library R010 [Radin 1989] ↩︎
- May, E. C., Paulinyi, T., & Vassy, Z. (2005). Anomalous Anticipatory Skin Conductance Response to Acoustic Stimuli: Experimental Results and Speculation About a Mechanism. The Journal of Alternative and Complementary Medicine, 11(4), 695–702. https://doi.org/10.1089/acm.2005.11.695 R011 [May 2005] ↩︎
- Radin, D. I. (2005). May et al.’s “Anomalous Anticipatory Skin Conductance Response to Acoustic Stimuli”. The Journal of Alternative and Complementary Medicine, 11(4), 587–588. https://doi.org/10.1089/acm.2005.11.587 R012 [Radin 2005] ↩︎
- Radin, D. I., Nelson, R., Dobyns, Y., & Houtkooper, J. M. (2006). Reexamining psychokinesis: Comment on Bösch, Steinkamp, and Boller (2006). Psychological Bulletin, 132(4), 529–532. https://doi.org/10.1037/0033-2909.132.4.529 R013 [Radin 2006] ↩︎
Deeper dives — Radin: