(Top)SummaryScorecardWhat this paper claimsWhat evidence it offersWhat's goodWhat's wrong with itWhat would change our mindScoring ExplanationKey ClaimsReferencesCited By

Effects of single-sex secondary schools on student achievement and attitudes.

Valerie E. Lee, Anthony S. Bryk (1986) · Journal of Educational Psychology

10.1037/0022-0663.78.5.381


Summary:

Claims that single-sex Catholic high schools produce better academic outcomes than coeducational ones, especially for girls. The strongest findings are for girls' schools, but 87% of those schools were run by religious orders versus 8% of coeducational schools — a confound the paper itself calls inseparable — so the results cannot distinguish gender separation from a different style of institutional management.

What this paper claims

Students at single-sex Catholic high schools outperform their coeducational counterparts on achievement tests, academic attitudes, educational aspirations, and several other measures, with benefits especially strong for girls. The paper proposes that removing cross-sex social pressures is the likely explanation.

What evidence it offers

This is an observational study of 1,807 students in 75 Catholic high schools (45 single-sex, 30 coeducational) drawn from a national survey. Students were tested as sophomores in 1980 and again as seniors in 1982. The authors ran regressions adjusting for student background, curriculum track, and school demographic composition. The paper's data show that 87% of girls' schools were governed by religious orders compared with 8% of coeducational schools, and the authors state this confound is "impossible" to separate. There are no pre-high-school test scores in the dataset, so no way to know whether students at single-sex schools were already higher-performing before they arrived.

What's good

The study uses well-validated standardized achievement tests from a national probability sample, a substantial upgrade over the small, non-random, attitude-focused studies that preceded it. The authors are transparent about the confounds they cannot resolve, including the near-total overlap between girls' school status and religious-order governance. The sophomore-to-senior gain analyses for girls — particularly in science achievement — are the most defensible results because they partially control for pre-existing differences by conditioning on sophomore status.

What's wrong with it

The religious-order governance confound is the central problem. The paper's strongest findings are for girls, and 87% of girls' schools but only 8% of coeducational schools were governed by religious orders. The paper states this confound is inseparable, then attributes the findings to gender composition. This means the headline conclusion rests on an untestable assumption that governance doesn't matter.

The absence of pre-high-school achievement data compounds the problem. Without knowing where students started, neither analysis can isolate school effects from intake differences. The selection model's near-zero explanatory power means the study captured almost nothing about why families chose one school type over another.

These two issues — unresolvable confounding and missing baselines — converge with the statistical choices (one-tailed tests, no multiple-comparison correction, no multilevel modeling, no formal test of the gender difference) to create a study where the descriptive pattern is real but the causal interpretation is unsupported.

What would change our mind

  • Confidence up: A study of single-sex versus coeducational schools with the same governance type, with pre-high-school achievement data and multilevel modeling. If single-sex effects survived with governance held constant, the causal claim would be much stronger.
  • Confidence up: A randomized or quasi-experimental study where students were assigned to single-sex or coeducational settings within the same school or school system, eliminating school-level confounds entirely.
  • Confidence down: Evidence that religious-order-governed coeducational schools produce outcomes comparable to religious-order single-sex schools, suggesting governance rather than gender composition is the active ingredient.
  • Confidence down: Replication attempts using datasets with pre-high-school baselines that find the single-sex association disappears after controlling for prior achievement.

Scoring Explanation

Study design

Restricting to Catholic schools reduces background variation, and the standardized achievement tests from a national survey are a real strength. But for girls' schools — where nearly every headline finding originates — single-sex status and religious-order governance are almost perfectly confounded. Religious orders bring distinctive academic cultures, hiring practices, and institutional missions that could independently produce every observed result. The paper ran a governance check for boys' schools and found no change in effects, but this check was impossible for girls' schools because the two variables overlap almost completely.

Single-sex and coeducational schools also differ on school size, student-to-faculty ratios, faculty gender composition, per-pupil expenditure, and curricular diversity. Only four school-level variables entered the regression, and the 75-school sample precluded adding more. No pre-high-school achievement measure is available, so the most important predictor of later achievement is missing from every model. The selection equations that predict school-type attendance explain only 3% of variance for girls and 7% for boys, which means the model captures almost nothing about the selection process — not that selection bias is small.

Statistical analysis

The paper uses ordinary least squares regression with a fixed design-effect correction of 1.5 to approximate students nested within schools. A multilevel model would have been more appropriate and would likely produce larger standard errors for school-level variables, potentially changing which results cross thresholds. All 74-odd tests are one-tailed with no correction for multiple comparisons. The overall count of results crossing the threshold exceeds what chance would produce, so the pattern is real in some form, but individual marginal results cannot be distinguished from noise.

The claim that effects are "stronger for girls than boys" was never formally tested — no pooled model with a gender interaction was run. Comparing whether one group's coefficient crosses a threshold and the other's does not is not evidence that they differ. The asymmetric exclusion of vocational schools (five girls' schools, three coeducational, zero boys' schools) selectively trims lower-performing girls' schools, biasing the comparison in favor of the single-sex group. Attrition rates by school type are unreported.

Construct validity

The single-sex dummy variable in the regression absorbs every unmeasured school characteristic that differs between school types — governance, size, faculty composition, curricular diversity, per-pupil expenditure, and school policies. The evidence supports "something about these particular single-sex schools is associated with better outcomes." It cannot support "single-sex organization produces better outcomes."

The proposed mechanism — that separating academic and social environments removes distractions — has no measurement in the study. No variable captures social pressure, peer distraction, or academic-social separation. The data are equally consistent with every alternative explanation the paper lists (and several it doesn't), yet the mechanism is presented in the abstract and conclusion as though it were an empirical finding.

Reasoning quality

The paper acknowledges its most important limitations — the religious-order confound, the missing achievement baseline, the imperfect selection controls — but its conclusions do not honor them. It states that governance and single-sex status are inseparable for girls, then attributes girls' school effects to gender composition in the abstract. It frames each analysis format's weakness as favoring the hypothesis: cross-sectional results may overestimate, but change analyses underestimate, so positive results from either count. When boys' schools show no achievement gains from sophomore to senior year, this is attributed to gains having already occurred by sophomore year rather than treated as evidence against a boys' school effect. The reasoning consistently resolves ambiguity in favor of the preferred conclusion.

Transparency

The paper is forthcoming about several important limitations. The religious-order confound is stated plainly. The missing achievement baseline is acknowledged. The selection equations' low explanatory power is reported. Data come from a publicly available national survey. Funding is clearly disclosed. Where transparency falls short is between what the limitations section concedes and what the abstract and conclusions claim. The paper's caveats, if taken seriously, would substantially weaken its headline conclusions — but those conclusions are stated without qualification.

Citation integrity

The literature review is shaped to favor the paper's conclusions. Dale's three-volume study of British schools — the largest body of prior secondary-level research, which found a modest advantage for boys in coeducational schools — is dismissed by questioning the researcher's objectivity ("zealous advocates of coeducation") rather than engaging with the data. Coleman's 1961 study of teenage social dynamics serves as the theoretical anchor without acknowledging that the social context had changed substantially by 1986. A contested psychological construct (Horner's "fear of success") is cited without noting the criticism it had attracted. The decision to use one-tailed tests is justified by prior literature the paper describes as inadequately controlled.

Independence

The primary funder was the Radcliffe Research Support Program through Radcliffe College's Murray Research Center. Radcliffe was one of the Seven Sisters women's colleges whose graduates the paper's literature review cites as evidence for single-sex education's benefits. The paper's strongest conclusion — that single-sex schooling particularly benefits girls — aligns with the institutional interest of its funder during a period when women's colleges faced conversion pressure. Several discretionary design choices (one-tailed tests, no multiple-comparison correction, asymmetric school exclusion) consistently favor more and larger positive findings for girls' schools. The underlying data source is independent and publicly available, and the conflicts are modest compared to pharmaceutical or industry-funded research, but the alignment is notable.

Key Claims

Not supported

Students in single-sex Catholic high schools achieve better academic outcomes than students in coeducational Catholic high schools

The study finds a positive association between single-sex schooling and achievement, but for girls — where the results are strongest — 87% of single-sex schools were run by religious orders versus 8% of coeducational schools, and the paper states these two factors 'could not be separated.' The study also lacks any measure of students' academic ability before high school, so it cannot tell whether the single-sex schools attracted stronger students or made them stronger.

Not supported

The academic benefits of single-sex schooling are especially strong for girls

More results for girls crossed the paper's chosen threshold than for boys, but the authors never ran a direct test of whether the girl and boy results actually differed from each other. The confounds are also worse for girls: the near-total overlap between girls' schools and religious-order governance, plus the removal of five lower-performing girls' schools from the sample (and zero boys' schools), means what looks like a stronger benefit for girls may reflect stronger confounding instead.

Not supported

Single-sex schools help students by separating academic life from cross-sex social pressure

The paper proposes this mechanism in its abstract and conclusion, but it collected no data on social pressure, peer distraction, or any other step in this causal chain. The study measured test scores and attitudes at two time points — it contains no information about why the association exists, and its own data list several alternative explanations it cannot rule out, including religious-order governance, smaller school size, and same-sex faculty role models.

References (38)

  • Alexander, Pallas (1983). Private schools and public policy: New evidence on cognitive achievement in public and private schools. Sociology of Education
  • Anderson et al. (1980). Statistical methods for comparative studies: Techniques for bias reduction. Wiley
  • Astin (1977). Four critical years: Effects of college on beliefs, attitudes, and knowledge. Jossey-Bass
  • Astin (1977). On the failure of educational policy. Change
  • Block (1984). Gender differences and implications for educational policy. Jossey-Bass
  • Bryk (1981). Disciplined inquiry or policy argument?. Harvard Educational Review
  • Bryk et al. (1984). Effective Catholic schools: An exploration. National Catholic Education Association
  • Coleman (1961). The adolescent society. Free Press of Glencoe
  • Coleman, Hoffer, Kilgore (1982). High school achievement: Public, Catholic, and private schools compared. Basic Books
  • Dale (1969). Mixed or single-sex school? Volume I: A research study about pupil-teacher relationships. Routledge & Kegan Paul
  • Dale (1971). Mixed or single-sex school? Volume II: Some social aspects. Routledge & Kegan Paul
  • Dale (1974). Mixed or single-sex school? Volume III: Attainment, attitudes and overview. Routledge & Kegan Paul
  • Dale, Miller (1972). The academic progress of university students from co-educational and single-sex schools. British Journal of Educational Psychology
  • Feather (1974). Coeducation, values, and satisfaction with school. Journal of Educational Psychology
  • Finn (1980). Sex differences in educational outcomes: A cross-national study. Sex Roles
  • Furniss, Graham (1974). Women in higher education. American Council on Education
  • Goldberger, Cain (1982). The causal analysis of cognitive outcomes in the Coleman, Hoffer and Kilgore report. Sociology of Education
  • Goodlad (1984). A place called school. McGraw-Hill
  • Graham (1970). Women in academe. Science
  • Graham (1974). Women in higher education: A biographical inquiry. Columbia University, Barnard College
  • Hoffer, Greeley, Coleman (1985). Achievement growth in public schools. Sociology of Education
  • Horner (1972). Toward an understanding of achievement-related conflicts in women. Journal of Social Issues
  • Hyde (1971). The case of coeducation. Independent School Bulletin
  • Jencks (1985). How much do high school students learn?. Sociology of Education
  • Jennrich, Sampson (1983). P3V: General mixed model analysis of variance. University of California Press
  • Jones, Shallcross, Dennis (1972). Coeducation and adolescent values. Journal of Educational Psychology
  • Light, Pillemer (1984). Summing up. Harvard University Press
  • Lockheed (1976). The modification of female leadership behavior in the presence of males. Educational Testing Service
  • Murnane (1981). Evidence, analysis, and unanswered questions. Harvard Educational Review
  • National Center for Education Statistics (1983). High School and Beyond 1980 sophomore cohort: First follow-up (1982). Data file user's manual. ICPSR Data Holdings
  • Oates, Williamson (1978). Women's colleges and women achievers. Journal of Women in Culture and Society
  • Riordan (1985). Public and Catholic schooling: The effects of gender context policy. American Journal of Education
  • Schneider, Coutts (1982). The high school environment: A comparison of coeducational and single-sex schools. Journal of Educational Psychology
  • Tidball (1980). Women's colleges and women achievers revisited. Signs: Journal of Women in Culture and Society
  • Tidball, Kistiakowsky (1976). Baccalaureate origins of American scientists and scholars. Science
  • Trickett et al. (1982). The independent school experience: Aspects of the normative environments of single-sex and coed secondary schools. Journal of Educational Psychology
  • Willms (1985). Catholic-school effects on academic achievement: New evidence from the High School and Beyond follow-up study. Sociology of Education
  • Winchel, Fenner, Shaver (1974). Impact of coeducation on 'fear of success' imagery expressed by male and female high school students. Journal of Educational Psychology

Cited by — in tracked papers (4)