Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect.
Nine experiments claim to show that future events can retroactively influence present behavior — participants allegedly detected the location of erotic pictures before the location was determined, responded faster to priming words shown after their response, and recalled words better when they happened to be selected for later practice. The evidence is fatally compromised: uncorrected multiple comparisons across dozens of tests, one-tailed significance thresholds that inflate the success rate, an unvalidated two-item scale used to rescue null results via subgroup analysis, and a design that cannot distinguish tiny statistical fluctuations from genuine reversed causality. Large-scale independent replication attempts found no evidence for the claimed effects.
What this paper claims
Future events can retroactively influence present behavior. The paper tests this claim across nine experiments on over 1,000 Cornell undergraduates. Participants detected where an erotic image would appear before the computer chose its location. They responded faster to words shown after their judgment. They preferred images they would later be habituated to. And they recalled words better when those words happened to be selected for post-test practice.
What evidence it offers
Nine laboratory experiments, each a "time-reversed" version of a well-established psychological effect. Standard priming makes you respond faster to a word when preceded by a related cue; here the cue comes after the response. Standard habituation makes a repeated stimulus less arousing; here the repetitions come after the preference judgment. The experiments produce hit rates, reaction times, and recall scores analyzed with standard statistical tests. The question is whether the execution is rigorous enough to support a claim that would overturn fundamental principles about the direction of time.
What's good
The time-reversal strategy is genuinely clever. By taking established psychological effects and swapping the temporal order of cause and effect, each experiment produces results immediately interpretable — if the causal claim is granted. The virtual control experiments, where random number generators replaced human participants and produced null results, are a thoughtful safeguard against one specific artifact class. The file-drawer disclosure is unusually forthcoming for any field, let alone parapsychology: the author names individual-difference variables that failed, a correlate that did not survive the full dataset, and a small experiment with null results. And the paper's presentation is transparent enough that its problems are diagnosable — the analytic flexibility, subgroup rescues, and protocol changes are all visible in the text.
What's wrong with it
The statistical evidence cannot be distinguished from noise.
The most damaging issue is uncorrected multiple comparisons combined with analytic flexibility. Nine experiments test numerous hypotheses — main effects, subgroup effects by stimulus seeking, sex differences, interactions with stimulus type — across different dependent variables, outlier criteria, and data transformations, with no correction for multiplicity. Every test uses one-tailed significance thresholds. Several headline results would be marginal or nonsignificant under two-tailed testing. This is the mechanism by which chance fluctuations in moderate samples get assembled into what looks like a consistent body of evidence.
The unvalidated stimulus-seeking scale compounds this. A two-item measure with no published reliability data divides samples into subgroups, and in multiple experiments the headline result depends on this split. In the retroactive boredom experiment, the full sample produced a null result, and the paper's claimed success rests entirely on the stimulus-seeking subgroup. A two-item scale producing effect sizes of 0.43 to 0.71 in small subgroups is a signature of post-hoc subsetting.
The construct validity problem is independent and equally serious. The measurements are tiny deviations from chance — 53% versus 50%, 15 milliseconds in reaction time. The claim is reversed causality. The design cannot bridge that gap. The argument that combining different random number generators rules out alternative psi interpretations commits a category error: it eliminates alternative paranormal explanations while ignoring the far more probable alternative that no paranormal process is involved.
What would change our mind
- Large pre-registered replications with two-tailed tests and no subgroup analyses finding the same effects → confidence up substantially. This was attempted; the results were null (Ritchie, Wiseman, and French 2012; Galak et al. 2012).
- Independent replication of the stimulus-seeking moderation using a validated, multi-item sensation-seeking measure → would distinguish a real moderator from a post-hoc artifact.
- A proposed physical mechanism for reversed causality that generates testable predictions beyond "slightly above chance on a forced-choice task" → would move the claim from unfalsifiable to scientifically tractable.
- Discovery of a specific procedural artifact (e.g., in stimulus sequencing or randomization) that reproduces the observed pattern → would convert the current suspicion of flexibility-driven false positives into a demonstrated mechanism.
- A formal p-curve or z-curve analysis showing the p-value distribution across all tests is inconsistent with a real effect → confidence down.
Scoring Explanation
The experimental procedures are drawn from mainstream psychology and are individually competent.
The experiments were not run under fixed protocols. Randomization methods, stimulus sets, and numbers of exposures changed between and within experiments based on interim results. In one experiment, the final 50 of 150 sessions used a different procedure for sequencing pictures, chosen based on results from the first 100. Participants were told they were in an ESP experiment, which could influence motivated responding in tasks involving conscious choices.
An unvalidated two-item "stimulus seeking" scale — constructed by the author with no published psychometric data — repeatedly rescues otherwise marginal or null results by reporting effects only in the high-scoring subgroup. None of the nine experiments were pre-registered. The procedures are competent enough for ordinary psychological research but too permissive for the extraordinary claims being made.
The individual tests — one-sample t-tests, binomial tests, phi coefficients — are appropriate, and using multiple analytic approaches (parametric and nonparametric, different outlier cutoffs, empirical baselines) for the same data addresses one specific concern about randomization artifacts.
These positives are overwhelmed by fundamental problems. The paper contains no correction for multiple comparisons despite testing dozens of hypotheses across nine experiments, multiple outcome measures, subgroup splits, and exploratory individual-difference analyses. Given the number of tests (conservatively several dozen), multiple "significant" results at the .05 level would be expected by chance alone.
One-tailed testing inflates the apparent success rate. Several headline results have p-values between .01 and .04 one-tailed, meaning they would be marginal or nonsignificant two-tailed. This clustering of p-values just below the .05 threshold is consistent with analytic flexibility — choices about test direction, subgroup, and outcome measure — nudging marginal results across the significance line.
No confidence intervals are reported. For a hit rate of 53.1% in 100 participants with 12 erotic trials each, the confidence interval would comfortably include 50%. The subgroup effect sizes — reaching 0.71 for high stimulus seekers in one experiment, based on a two-item scale with no established reliability — are implausibly large for the measurement quality of the moderator and are classic signatures of post-hoc subsetting in small samples.
The reported evidence is statistically indistinguishable from what flexible analysis of small effects in moderate samples would produce if no real effect existed.
The disparity between what the study measures versus what it claims is enormous. The measurements are tiny deviations from chance — a 53.1% hit rate where 50% is expected, a 15-millisecond reaction time difference. The claim is that causation runs backward in time. The space of mundane explanations (response biases, demand characteristics, stimulus-sequencing artifacts, researcher degrees of freedom, ordinary fluctuation) is vast, and the design cannot rule them out.
The paper's argument-by-elimination — that using both algorithmic and hardware-based random number generators rules out clairvoyance and psychokinesis, leaving precognition as the "only nonartifactual interpretation" — commits a category error. It works only if you have already accepted that some form of psychic ability produced the results and are choosing among variants. The most relevant alternative — that the results reflect methodological and statistical noise — is not in the elimination set.
The two cited external replications both required post-hoc subsetting to find any effect: one found it only in spider-phobic participants viewing spider images, the other only in participants who also showed the standard (non-reversed) version of the effect. Neither is a clean replication.
The design cannot distinguish small artifacts from genuine reversed causality.
The paper presents precognition experiments as "time-reversed" versions of well-established effects — priming, habituation, recall facilitation — implying that if you accept the standard versions, you should extend comparable credibility to the reversed versions. But the standard versions have known causal mechanisms operating in the normal direction of time. Reversing the temporal order requires an entirely different causal story, one that violates established physical principles. The framing treats this as a minor procedural detail when it is the entire substance of the claim.
The paper has a falsifiability problem. When the full sample produces a null result (as in the retroactive boredom experiment), significant effects appear in a subgroup of high "stimulus seekers." When the subgroup effect disappears (as in the final recall experiment), a stronger manipulation allegedly "restricted the range" enough to suppress the moderator's predictive power. Positive results confirm the stimulus-seeking prediction; negative results are attributed to methodological features that overwhelm it.
The paper preemptively discounts replication failures by arguing that psychologists overestimate how often significant results will replicate, citing Tversky and Kahneman. This is an accurate statistical point repurposed as a rhetorical shield. For a claim that requires overthrowing basic physics, demanding a higher evidential bar is proportional to the implausibility of the claim, not a double standard.
The paper acknowledges concerns about randomization and file-drawer effects but does not seriously engage with the possibility that its results arise from cumulative analytic flexibility — one-tailed tests, uncorrected multiple comparisons, post-hoc subgroup analyses, evolving protocols — across nine experiments conducted over several years.
None of the nine experiments were pre-registered. The paper describes extensive pilot testing and procedural evolution that makes planned analyses indistinguishable from post-hoc adjustments. Raw data are not publicly available. Analysis code is not provided. Materials are available only on request, not in a public archive. No conflict of interest statement appears, despite the author's decades-long career investment in parapsychology. No funding sources are disclosed. No ethics board approval is mentioned, despite research involving sexually explicit and emotionally disturbing imagery.
On the positive side, the file-drawer disclosure is unusually forthcoming: the author names individual-difference variables that failed, a correlate that did not survive the full dataset, and a small experiment that produced null results. Sample sizes are justified by explicit power analysis. These are rare in parapsychology and uncommon in mainstream psychology at the time.
But the disclosed exploration itself reveals the scope of analytic flexibility the design permitted — exactly the degrees of freedom that pre-registration exists to constrain.
The citation of mainstream psychology — priming, habituation, mere exposure, response-time methodology — is accurate and appropriate.
The citation of the parapsychology literature is one-sided. The paper leans heavily on a single meta-analysis of forced-choice precognition experiments (Honorton and Ferrari 1989) without mentioning skeptical methodological critiques by Hyman (1985, 1994). A meta-analysis by Milton and Wiseman (1999) that failed to find a significant ganzfeld telepathy effect — directly challenging the evidential base the paper invokes — was available a decade before submission and is not cited. Bayesian critiques of psi evidence, directly relevant to the paper's own discussion of Bayesian priors, are absent.
The two cited external replications are framed as confirmatory when one was null overall and both depended on subgroup analyses. A single failed replication is buried in a footnote and minimized as "a small pilot study" using a "different practice procedure." The physics discussion draws exclusively on voices from within the parapsychology community, and a Feynman quote about accepting well-confirmed quantum phenomena despite their counterintuitive nature is repurposed to argue for lowering evidential standards for unconfirmed claims.
The author has no financial conflicts but had spent decades building a research program in parapsychology, including an earlier high-profile publication arguing for psychic information transfer (Bem and Honorton 1994). The paper's primary outside advisor, Dean Radin, leads research at an organization whose mission depends on the reality of the phenomena being tested.
Several design choices are consistent with this career stake: one-tailed tests throughout, no pre-registration, a custom two-item moderator scale used to rescue marginal results, iteratively refined procedures, and no independent data analysis. The conclusions uniformly favor the existence of precognition, and the framing is explicitly advocatory — the author describes "simplicity and familiarity" as "tools of persuasion" and closes by urging readers to "raise their posterior probabilities."
Subsequent large-scale replication attempts by independent teams — including a registered replication (Ritchie, Wiseman, and French 2012) and a meta-analysis accounting for publication bias (Galak et al. 2012) — found no evidence for the claimed effects, consistent with the interpretation that the original results were products of researcher degrees of freedom.
Key Claims
People can perceive or be influenced by events that haven't happened yet
The paper's evidence consists of very small deviations from chance — for example, participants guessed the location of a hidden picture correctly 53.1% of the time instead of 50% — across nine experiments using permissive statistical choices. Every test used a one-tailed threshold, which halves the bar for counting a result as meaningful; several key results would not have qualified under standard two-tailed testing. The experiments were also run without pre-registration, with procedures adjusted between and even within experiments based on interim results, and with no correction for the dozens of statistical tests conducted. Independent teams that attempted to replicate these experiments after publication overwhelmingly found no effects.
Eight of nine experiments produced significant results, showing consistent evidence for precognition
The 'eight of nine' count is misleading. One experiment did not reach significance for the full sample and was rescued only by analyzing a subgroup — people who scored high on an unvalidated two-item questionnaire. Several other results were marginal even under the paper's permissive one-tailed threshold. No correction was applied for the many tests run across nine experiments, multiple outcome measures, and repeated subgroup analyses. When independent researchers later attempted large-scale replications, the effects largely disappeared.
Certain personality types — specifically people who seek out stimulation — are more likely to show precognitive ability
This finding rests on a two-item questionnaire ('I am easily bored' and 'I often enjoy seeing movies I've seen before') that Bem constructed himself and that has no published evidence of reliability or validity. In several experiments, the overall result was weak or absent, and the reported finding depended entirely on the subgroup that scored high on this scale. The subgroup effect sizes were implausibly large for such a crude measure — a pattern consistent with the well-known tendency of post-hoc subgroup splits in small samples to produce inflated estimates that fail to replicate.
References (57)
- Anderson, Bjork, Bjork (1994). Remembering can cause forgetting: Retrieval dynamics in long-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition
- Barbour (2001). The end of time: The next revolution in physics. Choice Reviews Online
- Bargh, Ferguson (2000). Beyond behaviorism: On the automaticity of higher mental processes. Psychological Bulletin
- Bem (2003). Precognitive habituation: Replicable evidence for a process of anomalous cognition
- Bem, Honorton (1994). Does psi exist? Replicable evidence for an anomalous process of information transfer. Psychological Bulletin
- Bierman, Scholte (2002). Anomalous anticipatory brain activation preceding exposure of emotional and neutral pictures
- Bornstein (1989). Exposure and affect: Overview and meta-analysis of research, 1968–1987. Psychological Bulletin
- Bornstein, Kale, Cornell (1990). Boredom as a limiting condition on the mere exposure effect. Journal of Personality and Social Psychology
- Bousfield (1953). The occurrence of clustering in the recall of randomly arranged associates. Journal of General Psychology
- Broderick (2007). Outside the gates of science: Why it's time for the paranormal to come in from the cold
- Broughton (1991). Parapsychology: The controversial science
- Canli et al. (2002). Sex differences in the neural basis of emotional memories. Proceedings of the National Academy of Sciences, USA
- Cardeña, Marcusson-Clavertz, Wasmuth (2009). Hypnotizability and dissociation as predictors of performance in a precognition task: A pilot study. Journal of Parapsychology
- Carpenter (2004). First sight: Part one, a model of psi and the mind. Journal of Parapsychology
- Carpenter (2005). First sight: Part two, elaboration of a model of psi and the mind. Journal of Parapsychology
- Carroll (2006). Alice's adventures in Wonderland and through the looking glass
- Cofer (1965). On some factors in the organizational characteristics of free recall. American Psychologist
- Cohen (1988). Statistical power analysis for the behavioral sciences
- Costa, McCrae (1992). Revised NEO Personality Inventory (NEO PI–R) and NEO Five-Factor Inventory (NEO-FFI): Professional manual. PsycTESTS Dataset
- Cushing, McMullin (1989). Philosophical consequences of quantum theory: Reflections on Bell's theorem
- de Boer, Bierman (2006). The roots of paranormal belief: Divergent associations or real paranormal experiences
- Deutschlander, Phillips, Borland (1999). The case for light-dependent magnetic orientation in animals. Journal of Experimental Biology
- Dijksterhuis, Smith (2002). Affective habituation: Subliminal exposure to extreme stimuli decreases their extremity. Emotion
- Eysenck (1966). Personality and extra-sensory perception. Journal of the Society for Psychical Research
- Farley, Farley (1967). Extroversion and stimulus-seeking motivation. Journal of Consulting and Clinical Psychology
- Fazio (2001). On the automatic activation of associated evaluations: An overview. Cognition & Emotion
- Feynman (1994). The character of physical law
- Herbert (1987). Quantum reality: Beyond the new physics
- Hermans et al. (2003). Affective priming with subliminally presented pictures. Canadian Journal of Experimental Psychology
- Honorton, Ferrari (1989). "Future telling": A meta-analysis of forced-choice precognition experiments, 1935–1987. Journal of Parapsychology
- Honorton, Ferrari, Bem (1992). Extraversion and ESP performance: Meta-analysis and a new confirmation
- Klauer, Musch (2003). Affective priming: Findings and theories. The Psychology of Evaluation
- Klauer, Teige-Mocigemba, Spruyt (2009). Contrast effects in spontaneous evaluations: A psychophysical account. Journal of Personality and Social Psychology
- Kunst-Wilson, Zajonc (1980). Affective discrimination of stimuli that cannot be recognized. Science
- Lang, Greenwald (1993). International Affective Picture System standardization procedure and results for affective judgments
- L'Ecuyer (2001). Software for uniform random number generation: Distinguishing the good and the bad. Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304)
- Marsaglia (1995). The Marsaglia random number CDROM including the diehard battery of tests of randomness
- Marsaglia (1997). A random number generator for c
- Parker, Sjödén (2010). Do some of us habituate to future emotional events?. Journal of Parapsychology
- Radin (1997). Unconscious perception of future emotions: An experiment in presentiment. Journal of Scientific Exploration
- Radin (2006). Entangled minds: Extrasensory experiences in a quantum reality
- Ratcliff (1993). Methods for dealing with reaction time outliers. Psychological Bulletin
- Rosenthal (1966). Experimenter effects in behavioral research. American Sociological Review
- Rosenthal (1990). Replication in behavioral research. Journal of Social Behavior and Personality
- Savva, Child, Smith (2004). The precognitive habituation effect: An adaptation using spider stimuli
- Schlitz et al. (2005). Of two minds: Skeptic-proponent collaboration within parapsychology
- Schmeidler (1988). Parapsychology and psychology: Matches and mismatches. Choice Reviews Online
- Sheehan (2006). Frontiers of time: Retrocausation—Experiment and theory
- Siegel, Castellan (1988). Nonparametric statistics for the behavioral sciences
- Spottiswoode, May (2003). Skin conductance prestimulus response: Analyses, artifacts and a pilot study. Journal of Scientific Exploration
- Tversky, Kahneman (1971). Belief in the law of small numbers. Psychological Bulletin
- Wagner, Monnet (1979). Attitudes of college professors toward extra-sensory perception. Zetetic Scholar
- Wilcox (2005). Introduction to robust estimation and hypothesis testing
- Wiseman, Schlitz (1997). Experimenter effects and the remote detection of staring. Journal of Parapsychology
- Wiseman, Schlitz (1999). Replication of experimenter effect and the remote detection of staring
- Zajonc (1968). Attitudinal effects of mere exposure. Journal of Personality and Social Psychology
- Zuckerman (1974). The sensation seeking motive. Psychophysiology