(Top)SummaryScorecardWhat this paper claimsWhat evidence it offersWhat's goodWhat's wrong with itWhat would change our mindScoring ExplanationKey ClaimsReferencesCited By

The Rising Relative Risk of Mortality for Singles: Meta-Analysis and Meta-Regression

David J. Roelfs, Eran Shor, Rachel Kalish, Tamar Yogev (2011) · American Journal of Epidemiology

10.1093/aje/kwr111


Summary:

Pooling 641 estimates from 95 studies, this meta-analysis finds that never-married adults die at roughly 24–30% higher rates than married adults, and that figure is probably about right. But the paper's headline claims — that the gap is rising over time, that women have caught up with men, and that it is largest in East Asia — come from a regression model whose results the raw decade-by-decade and regional numbers do not show, and they rest on very thin data at the points that matter. Trust the modest overall gap; do not update on the trends.

What this paper claims

Never-married people die at higher rates than married people, and this excess risk has grown over recent decades — faster for women than men, so the two sexes are now roughly equal. The gap is said to shrink with age and to be largest in China, Japan, and Taiwan.

What evidence it offers

This is a meta-analysis. The authors gathered 641 published comparisons of death rates between never-married and married people from 95 studies spanning a century and seven world regions, averaged them, then ran a regression asking which features of a study — when and where its data were collected, how old the participants were, how carefully it adjusted for other factors — predict a larger or smaller gap.

The averaging step holds. Whether one takes all adjusted estimates (30% excess) or only those the authors rated highest quality (24% excess), the pooled number barely moves, and it survives dropping estimates that required statistical conversion. This is an association, not proof that marriage protects health — healthier people may simply be more likely to marry — and the authors say so.

The regression step produces the paper's title and distinctive claims, and it cannot bear the weight. When adjusted estimates are grouped by the decade their data were collected, the gap runs 1.38, 1.22, 1.41, 1.33 — no trend, as the authors concede. Studies from before 1960 are almost all unadjusted census comparisons; studies after 1980 are mostly adjusted cohort follow-ups. Era and study design are nearly the same variable, and no regression can separate them. The "women have caught up" claim rests on finding no detectable gender difference at the most recent time point, where the data are six estimates from one study. The East Asia figure rests on at most five studies, half its estimates from one unadjusted source. The paper's tests of how much studies disagree with each other report almost no disagreement, yet the same regression claims to explain more than half of it. Both cannot be true, so every confidence range in the paper is of unknown reliability.

The modest overall gap is the finding worth keeping; the rest is not established.

What's good

The authors ran the analysis with and without the estimates that required conversion or imputation and found the headline barely moved; they led with the lower high-quality figure of 24% rather than the 30% overall figure; and they published the full stratified tables, including the decade-by-decade numbers that do not support their title. The limitations section is more honest than the abstract. For people over 60, the results closely match Manzoli 2007, independent confirmation that the pooling was done competently.

What's wrong with it

The same problem recurs from every angle: the paper's distinctive claims are outputs of a regression whose inputs cannot be separated. Old studies are unadjusted census tabulations; new ones are adjusted cohort studies. Asking a model to hold adjustment constant while varying era, when adjustment and era travel together in the data, produces a coefficient with no clear meaning — and the raw decade figures show no trend.

The model's own diagnostics also conflict. The paper reports that studies agree with each other almost perfectly across a century and seven regions, then reports a regression explaining more than half of their disagreement. One of these must be wrong, and the confidence ranges attached to every finding depend on which.

The claims that draw the most attention rest on the least data. Gender convergence "in recent years" is inferred from six estimates in one study. East Asia's 59% excess comes from at most five studies. The 128% excess for singles in their thirties comes from four estimates in three studies. The quality gradient holds cleanly only in the stratum where "low quality" is one study, and the raters were not blinded.

Finally, the paper's reassurances do not do what they claim. The publication-bias defence tests whether the effect exists rather than whether it is inflated; the selection-versus-protection argument reuses one null comparison as evidence for protection and then again as evidence that confounding is negligible; and the one prior meta-analysis it builds on found that correcting publication bias halved the effect — a finding this paper does not mention.

What would change our mind

  • Would raise confidence in the trend: a single large register — Nordic countries have them — analysed the same way across decades with marital status updated over time, showing the gap for never-married people widening. This would remove the design-era confound entirely.
  • Would raise confidence in gender convergence: the same register showing the female gap rising faster than the male gap, or the paper's own model re-run with the estimates per decade and per gender reported.
  • Would lower confidence further: re-analysis of the pooled data with the estimated standard errors excluded and clustering by study handled explicitly, showing the heterogeneity tests and the regression fit reconciled — or showing that the trend coefficient disappears when publication year is dropped.
  • Would raise confidence in the East Asia finding: a meta-analysis restricted to adjusted cohort studies from China, Japan, Taiwan, and Korea with at least ten independent sources.
  • Would lower confidence in the pooled number: a trim-and-fill or selection-model correction for publication bias of the kind Manzoli 2007 ran, showing a comparable halving of the excess.
  • Would raise confidence in the quality gradient: independent, blinded re-rating of the 95 studies by people who have not seen the effect sizes, with agreement statistics reported.

Scoring Explanation

Study design

The pooled design establishes that the published literature consistently finds higher mortality among never-married people, reported by level of adjustment and led by the more conservative high-quality figure. Two authors screened and extracted independently, a random re-coding of 25 papers found no errors, and non-English work was translated. Beyond the pooled number, the design cannot support the historical, regional, and quality comparisons asked of it. The literature search was built in 2005 for a broader question about social isolation, not marital status, and its terms are withheld. The authors pooled cross-sectional census comparisons with cohort follow-ups without reporting how many of each there are. The 641 estimates come from only 95 studies — about seven per study — with several cells dominated by one source. The correction for this overlap is described only in an appendix not available with the paper. Most seriously, older estimates are overwhelmingly unadjusted and newer ones overwhelmingly adjusted, so the "rising over time" finding is inseparable from a change in how studies were done. The people extracting the numbers also assigned the quality rating, with no statement on whether they saw the results first and no measure of rater agreement.

Statistical analysis

The random-effects pooling and meta-regression are appropriate in principle, and hazard ratios with confidence intervals are reported throughout. Heterogeneity Q-test P values for the main strata are 0.95–0.99 — 50 studies across a century and seven regions showing less spread than sampling error alone would produce — yet the meta-regression on the same data reports R² = 0.58 with roughly twenty significant moderators. These are incompatible. The most plausible explanation is that the variance adjustment for overlapping person-years and the regression-imputed standard errors (263 of 641 estimates) inflated within-study variances, collapsing the model toward fixed-effects weighting dominated by census-scale samples. Every reported confidence interval inherits this uncertainty. The regression also produces a sign flip: raw strata show age-adjusted estimates below unadjusted ones (1.37 vs 1.51), but the model reports them 9% higher — instability in exactly the dimensions the novel claims depend on. Publication age and study age were entered together and only the latter is significant, so the coefficient may measure publication lag rather than calendar time. The paper does not address this. The gender × study-age interaction that the paper calls its most interesting finding has a confidence interval touching the null (1.00–1.03) in the parsimonious model. Peters' test finds bias in one direction while the sample-size coefficient points the other way. The Rosenthal fail-safe N values (845,374 and similar) are artifacts of pooling half a billion people and say nothing about the size of any overestimate. Key subgroup cells are nearly empty: the age 30–39 adjusted figure is 4 estimates from 3 studies; the 2000s decade is 6 estimates from 1 study; the low-quality adjusted stratum is 2 estimates from 1 study. The only figure illustrating the trend cites a table that does not exist in the paper.

Construct validity

The pooled comparison measures what it claims: how the death rate of people coded never-married compares with people coded married across the published literature. Where the measurement is loose — cohabiters included in the married group in some studies, marital status fixed at study start so later marriers stay "single" — the errors understate the gap, which strengthens the headline. The problems begin when between-study differences are read as facts about populations. "Single" means very different things across the pool: a never-married 25-year-old in 1990s Sweden will mostly marry later and is barely selected; a never-married 45-year-old in 1980s Japan belongs to a rare, heavily health-selected group. The paper codes both identically, then attributes the larger East Asian gap to social sanctions — but in countries where very few people stay unmarried, those who do are a more unusual and likely more health-selected group, which alone would produce a larger gap without any cultural mechanism. "Rising over time" compares old studies with new ones, and old and new studies differ in design, adjustment, and data source all at once. "Lower-quality studies report bigger effects" rests on a quality rating that may have been influenced by the size of the effect being rated. The pattern holds only in one stratum where the low-quality cell is a single study; among unadjusted studies, high-rated studies report larger gaps than average-rated ones. The paper presents itself as the first to cover non-elderly singles, but 85% of adjusted estimates concern people 60 and older. The age gradient is the strongest secondary finding, because much of the age variation comes from within studies. But the paper names two competing explanations (ratio compression at high death rates, and the changing meaning of "never-married" across the life course) and tests neither.

Reasoning quality

The paper's title, abstract, and closing paragraph state the rising trend flatly; the results section says it "is difficult to discern" and the decade figures do not show it. The trend exists only as one coefficient in a model with about twenty predictors. A nearly identical variable — years since publication rather than since data collection — shows no trend in the same model, which the paper does not explain. The claim that men and women are "now approximately equal" infers equality from the failure to detect a difference at a time point supported by one study. The discussion is candid about latent selection (heavy drinking, personality); the conclusion carries the protection reading forward anyway, on the strength of one null comparison between studies that did and did not control for baseline health. A formal test confirms publication bias. The paper then dismisses it with a calculation that tests whether the effect exists rather than whether it is overstated, and a comparison of quality tiers that says nothing about unpublished studies. The East Asia result is given a cultural mechanism no variable in the model measures. The limitations section warns against regional conclusions from small samples but applies the warning only to other regions. The closing sentence says ratios are "particularly high in younger cohorts," conflating age with birth cohort. The paper does present its raw stratified tables in full — which is how a reader can see the decade figures contradict the title — and the limitations section is more candid than the conclusions.

Transparency

There is no protocol or registration, and the analysis is one of at least three carved after the fact from a database built in 2005 for a different question. The extracted dataset is not available, search strings are "available upon request," and no analysis code is shared. The list of included studies, the conversion of odds ratios and death-rate ratios into hazard ratios, the regression used to impute missing standard errors for 263 estimates, the variance adjustment for overlapping samples, the quality-score factor analysis, the trend plots, and the funnel plot all live in a web appendix that was not part of the evaluated text. These are the steps where the analysis could go wrong, and none can be checked. No funding source is named. Conflicts of interest are declared as none. The limitations section raises four real weaknesses — publication bias, uneven adjustment, the difficulty of rating quality, and over-representation of rich countries — and then argues each one away. It does not mention the tension between near-zero heterogeneity and a high-explanatory-power regression, the absence of a trend in the raw decade figures, the figure citing a nonexistent table, or the unblinded quality rating.

Citation integrity

The core numbers come from the 95 pooled studies, so they do not depend on any cited work. The reference list does framing and interpretation, and it is uneven. Manzoli 2007, the prior meta-analysis on the elderly, is described accurately. But its most relevant finding — that correcting for publication bias roughly halved the married advantage — is omitted, even though the present paper argues its own publication bias is minor. The selection-versus-protection section cites several off-topic sources for its claim that most studies favor protection: a study of religious involvement among African Americans, a paper on psychological well-being rather than death, an edited sociology volume also cited elsewhere for the opposite hypothesis, and a reference with the wrong year. The explanation for women's rising risk leans on three essays from a feminist anthology (Funiciello 2003, Norsigian 2003, Braun-Levine 2003) presented as evidence for declining public assistance and health benefits. These are opinion pieces, nearly all American and about single mothers, while the pooled data span Scandinavia, Europe, and East Asia. A trade book by a marriage-movement advocate (Waite and Gallagher 2000) supports the claim that married people take fewer risks. The methodological citations are standard and correctly used, and the paper does cite one conflicting finding (Liu and Umberson 2008).

Independence

No funder, industry, or advocacy affiliation is identifiable. All four authors are academic sociologists, conflicts are declared as none, and nobody profits from a finding about marital status and mortality. Several choices cut against the authors' own interest in a dramatic result: they built the database for a broader question, limiting opportunities to select favorable studies, and they led with the lower quality-restricted figure rather than the overall one. The one pressure is the ordinary academic need for a novel headline: this is one of at least three papers from the same database, each needing its own distinctive result. That pressure shows in a title that says "rising" over a flat raw trend, but that is a question of evidence, not conflict.

Key Claims

Supported

Never-married people die at higher rates than married people — roughly 24 to 30 percent higher

Pooling 641 estimates from 95 studies consistently shows this gap, and it barely moves when the shakier converted estimates are dropped, though it describes an association rather than proof that marriage itself protects health, and most of the underlying evidence concerns people over 60.

Not supported

The mortality penalty for being single has been rising over time

Grouped by decade, the adjusted figures go 1.38, 1.22, 1.41, 1.33 — no trend, as the authors concede — and the rise appears only in a regression that cannot separate calendar time from the shift from crude census comparisons in early decades to adjusted cohort studies in later ones.

Not supported

The penalty has grown faster for women, so single men and women now face about the same excess risk

The faster-for-women finding rests on one coefficient whose uncertainty range touches zero, and 'now equal' is inferred from failing to detect a gender difference at the most recent time point, where the data are six estimates from a single study.

Supported

Young singles face the largest excess risk, and the penalty shrinks with age

The gap narrows with age in every slice of the data, but the headline figure of more than double the death rate at ages 30–39 comes from just four estimates in three studies, and the paper never tests whether ratios simply compress at older ages when everyone's death rate is high.

References (74)

  • Durkheim (1951). Suicide. Free Press
  • Berkson (1962). Mortality and marital status. Reflections on the derivation of etiology from statistics. Am J Public Health Nations Health
  • Gove (1973). Sex, marital status, and mortality. AJS
  • March (1912). Some researches concerning the factors of mortality. J R Stat Soc
  • Ortmeyer (1974). Variation in mortality, morbidity, and health care by marital status. Harvard University Press
  • Parkes, Benjamin, Fitzgerald (1969). Broken heart: a statistical study of increased mortality among widowers. Br Med J
  • Peritz, Bialik, Groen (1967). Mortality by marital status in the Jewish population of Israel. J Chronic Dis
  • Sheps (1961). Marriage and mortality. Am J Public Health Nations Health
  • Shurtleff (1955). Mortality and marital status. Public Health Rep
  • Espinosa, Evans (2008). Heightened mortality after the death of a spouse: marriage protection or marriage selection?. J Health Econ
  • Goldman (1993). Marriage selection and mortality patterns: inferences and fallacies. Demography
  • Murray (2000). Marital protection and marital selection: evidence from a historical-prospective sample of American men. Demography
  • Stutzer, Frey (2006). Does marriage make people happy, or do happy people get married. J Socio Econ
  • Waldron, Hughes, Brooks (1996). Marriage protection and marriage selection—prospective evidence for reciprocal effects of marital status and health. Soc Sci Med
  • Coombs (1991). Marital status and personal well-being: a literature review. Fam Relat
  • Waite, Gallagher (2000). The Case for Marriage: Why Married People are Happier, Healthier, and Better Off Financially. Doubleday
  • Amato, Booth (1991). Consequences of parental divorce and marital unhappiness for adult well-being. Soc Forces
  • Kiecolt-Glaser, Malarkey, Chee (1993). Negative behavior during marital conflict is associated with immunological down-regulation. Psychosom Med
  • Orth-Gomér, Wamala, Horsten (2000). Marital stress worsens prognosis in women with coronary heart disease: the Stockholm Female Coronary Risk Study. JAMA
  • Brockmann, Klein (2004). Love and death in Germany: the marital biography and its effect on mortality. J Marriage Fam
  • Lund, Holstein, Osler (2004). Marital history from age 15 to 40 years and subsequent 10-year mortality: a longitudinal study of Danish males born in 1953. Int J Epidemiol
  • Tucker, Friedman, Wingard (1996). Marital history at midlife as a predictor of longevity: alternative explanations to the protective effect of marriage. Health Psychol
  • Koskinen (1999). Mortality differences by marital status—a growing public health problem. Sosiaalilaaketieteellinen Aikakauskirja
  • Eggebeen (2005). Cohabitation and exchanges of support. Soc Forces
  • Pinsof (2002). The death of "till death us do part": the transformation of pair-bonding in the 20th century. Fam Process
  • Brown (2000). The effect of union type on psychological well-being: depression among cohabitors versus marrieds. J Health Soc Behav
  • Wu, Penning, Pollard (2003). In sickness and in health: does cohabitation count?. J Fam Issues
  • Amato, Booth, Johnson (2007). Alone Together: How Marriage in America Is Changing. Harvard University Press
  • Blossfeld, Huinink (1991). Human capital investments or norms of role transition? How women's schooling and career affect the process of family formation. Am J Sociol
  • Goldstein, Kenney (2001). Marriage delayed or marriage forgone? New cohort forecasts of first marriage for U.S. women. Am Sociol Rev
  • Cherlin (1992). Marriage, Divorce, Remarriage. Harvard University Press
  • Ferguson (2000). Challenging traditional marriage: never married Chinese American and Japanese American women. Gend Soc
  • Offer (2006). The Challenge of Affluence: Self Control and Well-being in the United States and Britain Since 1950. Oxford University Press
  • Manzoli, Villari, M Pirone (2007). Marital status and mortality in the elderly: a systematic review and meta-analysis. Soc Sci Med
  • Proulx, Helms, Buehler (2007). Marital quality and personal well-being: a meta-analysis. J Marriage Fam
  • Shor, Roelfs, Curreli (2012). Widowhood and mortality: a meta-analysis and meta-regression. Demography
  • Thompson Reuters (2009). Journal Citation Reports. Thompson Reuters
  • Huedo-Medina, Sánchez-Meca, Marín-Martínez (2006). Assessing heterogeneity in meta-analysis: Q statistic or I2 index?. Psychol Methods
  • Lipsey, Wilson (2001). Practical Meta-Analysis. Sage Publications
  • Rosenthal (1979). The "file drawer problem" and tolerance for null results. Psychol Bull
  • Moreno, Sutton, Ades (2009). Assessment of regression-based methods to adjust for publication bias through a Comprehensive Simulation Study. BMC Med Res Methodol
  • Peters, Sutton, Jones (2006). Comparison of two methods to detect publication bias in meta-analysis. JAMA
  • Liu, Umberson (2008). The times they are a changin': marital status and health differentials from 1972 to 2003. J Health Soc Behav
  • Thornton (1989). Changing attitudes towards family issues in the US. J Marriage Fam
  • Tucker (2000). Marital values and expectations in context: results from a 21-city survey. Aldine de Gruyter
  • Byrne, Carr (2005). Caught in the cultural lag: the stigma of singlehood. Psychol Inq
  • Stein (1981). Single Life: Unmarried Adults in Social Context. St. Martin's Press
  • Trimberger (2005). The New Single Woman. Beacon
  • Mandel, Semyonov (2005). Family policies, wage structures, and gender gaps: sources of earnings inequality in 20 countries. Am Sociol Rev
  • McCall (2000). Gender and the new inequality: explaining the college/non-college wage gap. Am Sociol Rev
  • Bock (2000). Doing the right thing: single mother by choice and the struggle for legitimacy. Gend Soc
  • Western, Bloome, Percheski (2008). Inequality among American families with children, 1975 to 2005. Am Sociol Rev
  • Christopher, England, Smeeding (2002). The gender gap in poverty in modern nations: single motherhood, the market, and the state. Sociol Perspect
  • McLanahan, Booth (1989). Mother-only families: problems, prospect, and politics. J Marriage Fam
  • Duncan, Brooks-Gunn (2000). Family poverty, welfare reform, and child development. Child Dev
  • Funiciello (2003). Poverty wears a female face. Washington Square Press
  • Lichter, Crowley (2002). Poverty in America: beyond welfare reform. Popul Bull
  • Norsigian, The Boston Women's Health Book Collective (2003). Women's health activism overview. Washington Square Press
  • Williams, Sassler, Nicholson (2008). For better or for worse? The consequences of marriage and cohabitation for single mothers. Soc Forces
  • Braun-Levine (2003). Parenting: a new social contract. Washington Square Press
  • DeNavas-Walt, Proctor, Smith (2009). Income, poverty, and health insurance coverage in the United States: 2008. US Census Bureau Current Population Report
  • Cornell (1984). Why are there no spinsters in Japan?. J Fam Hist
  • Pelzel (1970). Japanese kinship: a comparison. Stanford University Press
  • Fu, Goldman (1996). Incorporating health into models of marriage choice: demographic and sociological perspectives. J Marriage Fam
  • Wilson, Oswald (2005). How does marriage affect physical and psychological health? A survey of the longitudinal evidence. IZA Discussion Paper No. 1619
  • Ellison, Hummer, Cormier (2000). Religious involvement and mortality risk among African American adults. Res Aging
  • Kim, McKenry (2002). The relationship between marriage and psychological well-being. J Fam Issues
  • Kobrin, Hendershot (1997). Do family ties reduce mortality? Evidence from the United States, 1966–1968. J Marriage Fam
  • Lillard, Waite (1995). Til death do us part—marital disruption and mortality. Am J Soc
  • Gardner, Oswald (2004). How is mortality affected by money, marriage, and stress?. J Health Econ
  • Grundy, Kravdal (2008). Reproductive history and mortality in late middle age among Norwegian men and women. Am J Epidemiol
  • Berman, Parker (2002). Meta-analysis: neither quick nor easy. BMC Med Res Methodol
  • Egger, Smith (1998). Bias in location and selection of studies. BMJ
  • Terrin, Schmid, Lau (2003). Adjusting for publication bias in the presence of heterogeneity. Stat Med

Cited by — in tracked papers (1)