(Top)SummaryScorecardWhat this paper claimsWhat evidence it offersWhat's goodWhat's wrong with itWhat would change our mindScoring ExplanationKey ClaimsReferencesCited By

Gender, single-sex schooling and maths achievement

Aedín Doris, Donal O’Neill, Olive Sweetman (2013) · Economics of Education Review

10.1016/j.econedurev.2013.04.001


Summary:

This paper finds a gender gap in maths favouring boys among Irish nine-year-olds, concentrated at the top of the score distribution, and reports no evidence that single-sex schooling reduces it. The descriptive finding is solid, but the causal claims about single-sex schooling rest on a questionable assumption of random assignment and the study lacks the power to detect modest effects — the headline claim that the gap is actually larger in single-sex schools is not statistically distinguishable from zero.

What this paper claims

Boys outperform girls in maths at the top of the score distribution among Irish nine-year-olds, and attending a single-sex school does not reduce this gap. If anything, the authors argue, the gender gap is larger in single-sex schools.

What evidence it offers

This is an observational study of about 7,100 children from the Growing Up in Ireland national survey, not an experiment. Children were not randomly assigned to school types. The authors argue that Ireland's institutional setting — where roughly a quarter of primary school children attend single-sex schools that exist for historical reasons, follow the same curriculum, and draw from the same communities as coeducational schools — makes assignment close enough to random to support causal claims. They run several robustness checks against selection bias: controlling for birthweight, instrumental-variables models, and a sensitivity analysis estimating how large hidden selection would need to be to overturn the result.

The most important limitation: the study's data show that single-sex schools are overwhelmingly urban (62–67% versus 34–35% for coeducational schools), a 30-percentage-point difference that a single binary control variable may not absorb. The paper's headline finding — that the gender gap is 9.4 percentage points in single-sex schools versus 5.9 in coeducational schools — is never formally tested for statistical difference, and the difference between those two numbers cannot be distinguished from zero given the reported standard errors. The study also never reports whether it had enough data to detect a modest benefit of single-sex schooling; effects below about 6 percentage points would be invisible.

What's good

The institutional setting is the paper's strongest asset. In most countries, single-sex schools are rare, selective, and private, making it nearly impossible to separate school-type effects from selection. Ireland's large public single-sex school sector, created by historical accident rather than pedagogical design, is a genuinely better natural laboratory than anything available in the US or UK. The Altonji-Elder-Taber sensitivity analysis — showing that hidden selection would need to be more than double the estimated value to overturn the result — represents serious engagement with the identification problem. The literature review is unusually balanced for a paper with a clear directional finding.

What's wrong with it

The paper's causal claims outrun its evidence. The "effectively random" assignment argument is contradicted by a 30-percentage-point urban difference in the study's data. The headline claim — that the gender gap is larger in single-sex schools — is not statistically distinguishable from zero but is stated as a finding in the abstract. The null conclusion — that single-sex schooling doesn't reduce the gap — is presented without acknowledging that the study could not have detected effects below about 6 percentage points. These are not three separate minor issues; they converge on a single pattern of overclaiming relative to what the design and data support.

What would change our mind

  • Confidence up: A study with random assignment of children to single-sex versus coeducational primary schools, or a regression-discontinuity design exploiting a sharp enrollment threshold, finding the same null result.
  • Confidence up: Evidence that Irish single-sex and coeducational schools actually differ in classroom dynamics, teaching practices, or competition structures — if they don't differ, the null finding is unsurprising and uninformative about the broader hypothesis.
  • Confidence down: A replication using finer geographic controls (continuous urbanicity, neighbourhood fixed effects) that shows the single-sex boys' advantage disappears — this would suggest the result was driven by urban confounding rather than school type.
  • Confidence down: A study with a larger single-sex sample or a more powerful design finding a modest (2–3 percentage point) benefit of single-sex schooling for girls — this would fall within the range of effects the current study could not detect.

Scoring Explanation

Study design

The study uses a nationally representative sample from a well-designed longitudinal survey, with maths scores from a standardised test administered by fieldworkers rather than classroom teachers. Ireland's large public single-sex school sector is a genuinely useful setting for this question, better than the US or UK where single-sex schools are rare and selective.

The problem is the distance between the design and the causal claims. The paper argues school-type assignment is "effectively random," but the evidence for this comes from a separate survey of 443 parents (not the study sample) and from summary statistics that show large observable differences — most notably the 30-percentage-point urban concentration difference. The paper controls for urbanicity with a binary variable, but that is a coarse adjustment for what is likely the single largest source of confounding. The instrumental-variables analysis uses urban location as an instrument, which requires assuming it has no direct effect on maths scores — a stronger assumption than the paper acknowledges. The study also never examines whether Irish single-sex and coeducational schools actually differ in teaching practices or classroom dynamics, so the null finding could mean either that single-sex schooling doesn't help or that these schools don't differ in the ways that would matter.

Statistical analysis

The probit models are correctly specified, marginal effects are clearly reported, and the paper applies appropriate sampling weights and clustering adjustments. The robustness checks — bivariate probit, birthweight controls, sensitivity analysis — are genuine and well-executed, with internally consistent numbers across all tables.

Three problems reduce confidence. First, the paper never formally tests whether the gender gap in single-sex schools (9.4 percentage points) differs from the gap in coeducational schools (5.9 points). Given the standard errors, the 3.5-point difference cannot be distinguished from zero, yet the abstract presents it as a finding. Second, the study reports no power analysis. With about 1,000 students per gender in single-sex schools, the study could detect only effects of roughly 6–7 percentage points or larger — a real but modest benefit of 2–3 points would be invisible. For a paper whose central conclusion is the absence of an effect, this is a material omission. Third, the overidentification test used to validate the instruments has notoriously low power with only two instruments and one endogenous variable; passing it provides limited reassurance.

Construct validity

The descriptive claim — that a gender gap in maths exists at the top of the distribution — is well supported. Over seven thousand children took the same standardised test, and the seven-percentage-point gap in top-quartile rates is detected with precision.

The causal claims about single-sex schooling are stretched in two directions. The identification strategy overstates how random school assignment is: the 30-percentage-point urban difference between school types is not captured by the phrase "effectively random," even after controls. And the treatment itself is never verified — the paper tests whether the label "single-sex" matters, not whether the educational experience actually differs. The directional claim that the gap is larger in single-sex schools has a further problem: the difference is within sampling noise, and the compositional differences between school types (higher rates of father absence and school-level disadvantage among girls in single-sex schools) offer a plausible non-causal explanation.

Reasoning quality

The paper's reasoning is generally careful within each section, but four issues accumulate. The abstract presents the direction of the gap difference as a finding when the body text shows it is not statistically distinguishable from zero. The "effectively random" framing overstates what the evidence — a 443-parent survey from a different study and summary statistics showing large urban differences — supports. The null finding is stated more broadly than the study's detection limits warrant: "no evidence that single-sex schooling reduces the gap" reads as a strong conclusion when the study could not have detected a modest effect. And the paper never checks whether single-sex schools in Ireland actually differ in the ways the literature says would matter.

Transparency

The analytical methods are carefully documented and the robustness checks are clearly presented. The main dataset (Growing Up in Ireland) is available through a data archive with application. But the paper provides no analysis code or replication files, no conflict-of-interest or funding disclosures, and no power analysis. There is no labelled limitations section. The most material omission is the power limitation: for a study whose headline conclusion is the absence of an effect, not discussing detection limits leaves the reader unable to calibrate the null.

Citation integrity

The literature review is balanced, presenting studies on both sides of the single-sex schooling debate — including randomised studies that found positive effects for girls (Eisenkopf et al. 2012, Park et al. 2012), which work against the paper's conclusion. Verified citations are accurately represented. The framing correctly labels Fryer and Levitt's (2010) single-sex hypothesis as "tentative."

The weakness is in the citations supporting the identification strategy. The two key sources — Fox and Buchanan (2008, unpublished, based on nine schools) and O'Mahony (2008, a survey for the Irish Bishops' Conference, not peer-reviewed) — were not designed to answer the selection question the paper uses them to address. The quasi-randomness claim rests on thinner published evidence than the robustness checks suggest.

Independence

No funding source, industry affiliation, or structural conflict is identifiable. The three authors are at a public Irish university using a government-funded national survey. The finding — that single-sex schooling does not help girls in maths — runs against the policy enthusiasm for single-sex education that was active in several countries at the time of publication.

Key Claims

Supported

Boys outperform girls in maths at the top of the score distribution among Irish nine-year-olds

In a nationally representative sample of over 7,000 children, 29% of boys scored in the top quarter on a standardized maths test compared to 22% of girls — a gap driven almost entirely by the high end of the distribution.

Supported

Single-sex schooling does not reduce the gender gap in maths

The study found no detectable benefit of single-sex schooling for girls' maths scores across multiple statistical approaches, but it was only large enough to detect effects of roughly six percentage points or more — a real but modest benefit would have been invisible in this data.

Not supported

The gender gap in maths is actually larger in single-sex schools than in coeducational schools

The estimated gap was 9.4 percentage points in single-sex schools versus 5.9 in coeducational schools, but the paper never tested whether that 3.5-point difference was distinguishable from chance — and given the reported margins of error, it was not.

References (76)

  • Altonji, Elder, Taber (2005). An evaluation of instrumental variable strategies for estimating the effects of catholic schooling. Journal of Human Resource
  • Altonji, Elder, Taber (2005). Selection on observed and unobserved variables: Assessing the effectiveness of catholic schools. Journal of Political Economy
  • Angrist (1991). Instrumental variables estimation of average treatment effects in econometrics and epidemiology. National Bureau of Economic Research
  • Bedard, Cho (2010). Early gender test score gaps across OECD countries. Economics of Education Review
  • Bernie, Lall (2008). Building Bridges between Home and School Mathematics: A Review of the Ocean Mathematics Project. Institute of Education, University of London
  • Bharadwaj et al. (2012). The gender gap in mathematics: Evidence from low and middle income countries. NBER Working Paper #18464
  • Billger (2009). On reconstructing school segregation: The efficacy and equity of single-sex schooling. Economics of Education Review
  • Black, Devereux, Salvanes (2007). From the cradle to the labor market? The effect of birth weight on adult outcomes. The Quarterly Journal of Economics
  • Booth, Cardona-Sosa, Nolen (2013). Do single-sex classes affect exam scores? An experiment in a coeducational university. Australian National University discussion paper, DP. No. 679
  • Booth, Nolen (2012). Choosing to compete: How different are boys and girls?. Journal of Behavior & Organization
  • Bryk, Lee, Holland (1993). Catholic schools and the common good. Harvard University Press
  • Buonanno, Pozzoli (2009). Early labour market returns to college subjects. Labour, Review of Labour Economics and Industrial Organisation
  • Carrell, Page, West (2010). Sex and science: How professor gender perpetuates the gender gap. The Quarterly Journal of Economics
  • Cho (2012). The effect of teacher–Student gender matching: Evidence from OECD Countries. Economics of Education Review
  • Close, Shiel (2009). Gender and PISA mathematics: Irish results in context. European Educational Research Journal
  • Cotton, McIntyre, Price (2010). The gender gap cracks under pressure: A detailed look at male and female performance differences during competitions. NBER Working Paper 16436
  • Currie, Hyson (1999). Is the impact of health shocks cushioned by socioeconomic status? The case of low birthweight. American Economic Review
  • Dee (2007). Teachers and the gender gaps in student achievement. The Journal of Human Resources
  • Department for Education and Skills (2007). 2020 Vision. Report of the Teaching and Learning in 2020 Review Group
  • Dickerson, McIntosh, Valente (2012). Do the maths: An analysis of the gender gap in mathematics in Africa. IZA discussion paper 7174
  • Eisenkopf et al. (2012). Academic performance and single-sex schooling: Evidence from a natural experiment in Switzerland. University of Konstanz working paper
  • Ellison, Swanson (2010). The gender gap in secondary school mathematics at high achievement levels: Evidence from the American mathematics competitions. Journal of Economic Perspectives
  • Else-Quest, Hyde, Linn (2010). Cross-national patterns of gender differences in mathematics: A meta-analysis. Psychological Bulletin
  • Evans, Schwab (1995). Finishing high school and starting college: Do catholic schools make a difference?. Quarterly Journal of Economics
  • Fox, Buchanan (2008). School choice in the Republic of Ireland: An unqualified commitment to parental choice. Mimeo, University of Hawai'i Charter School Resource Center
  • Fryer, Levitt (2010). An empirical analysis of the gender gap in mathematics. American Economic Journal: Applied Economics
  • Gneezy, Leonard, List (2009). Gender differences in competition: Evidence from a matrilineal and a patriarchal society. Econometrica
  • Gneezy, Niederle, Rustichini (2003). Performance in competitive environments: Gender differences. The Quarterly Journal of Economics
  • Grogger, Eide (1995). Changes in college skills and the rise in the college wage premium. The Journal of Human Resources
  • Growing Up in Ireland (2010). The lives of 9-year-olds
  • Growing Up in Ireland (2010). Sample design and response in wave 1 of the nine-year cohort of Growing up in Ireland
  • Guiso et al. (2008). Culture, gender and math. Science
  • Günther et al. (2010). Women can't jump? An experiment on competitive attitudes and stereotype threat. Journal of Economic Behaviour and Organization
  • Halpern et al. (2007). The science of sex differences in science and mathematics. Psychological Science in the Public Interest
  • Halpern et al. (2011). The pseudoscience of single-sex schooling. Science
  • Hedges, Nowell (1995). Sex differences in mental test scores, variability, and numbers of high-scoring individuals. Science
  • Hoxby (2000). Peer effects in the classroom: Learning from gender and race variation. NBER working paper 7867
  • Huguet, Régner (2007). Stereotype threat among school girls in quasi-ordinary classroom circumstances. Journal of Educational Psychology
  • Husain, Milimet (2009). The mythical 'boy crisis'?. Economics of Education Review
  • Jackson (2012). Single-sex schools, student achievement and course selection: Evidence from rule-based student assignments in Trinidad and Tobago. Journal of Public Economics
  • Koedel, Tyhurst (2012). Math skills and labour market outcomes: Evidence from a resume-based field experiment. Economics of Education Review
  • Lavy, Schlosser (2011). Mechanism and impact of gender peer effects at school. American Economic Journal: Applied Economics
  • Lindberg et al. (2010). New trends in gender and mathematics performance: A meta-analysis. Psychological Bulletin
  • LoGerfo, Nichols, Chaplin (2006). Gender gaps in math and reading gains during elementary and high school by race and ethnicity. Urban Institute
  • Lord (1952). A theory of tests. Psychometric Monograph No. 7, Psychometric Society
  • Lord (1980). Applications of item response theory to practical testing problems. Lawrence Erlbaum
  • Mael et al. (2005). Single-sex versus coeducational schooling: A systematic review. US Department of Education Office of Planning Evaluation and Policy Department Policy and Program Studies Service
  • Mael et al. (2004). Theoretical arguments for and against single-sex schools: A critical analysis of the explanations. American Institutes for Research
  • Machin, McNally (2005). Gender and student achievement in English schools. Oxford Review of Economic Policy
  • McCoy, Smyth, Burke (2012). The Primary classroom: Insights from the growing up in Ireland survey. Economic and Social Research Institute working paper
  • McGovern (2013). Still unequal at birth: Birth weights, socioeconomic status and outcomes at age 9. Economic and Social Review
  • Murray et al. (2011). Growing up in Ireland: National longitudinal study of children: Design, instrumentation and procedures for the child cohort. Office of the Minister for Children and Youth Affairs
  • Niederle, Vesterlund (2010). Explaining the gender gap in math test scores: The role of competition. Journal of Economic Perspectives
  • OECD (2010). The High Cost of Low Educational Performance. PISA
  • OECD (2010). PISA 2009 results: What students know and can do, student performance in reading mathematics and science. OECD
  • OECD (2011). Does where a student live affect his or her reading performance? PISA 2009 at a glance. OECD Publishing
  • O'Mahony (2008). Factors determining school choice: Report on a survey of the attitudes of parents of children attending catholic primary schools in Ireland. Council for Research & Development, Irish Bishops' Conference
  • Örs, Palomino, Peyrache (2008). Performance gender-gap: Does competition matter?. CEPR discussion paper 6891
  • Paglin, Rufolo (1990). Heterogeneous human capital, occupational choice, and male–female earnings differences. Journal of Labor Economics
  • Park, Behrman, Choi (2012). Do single-sex schools enhance students' STEM (Science, Technology Engineering and Mathematics) Outcomes?. PIER working paper 12-038
  • Pekkarinen (2012). Gender differences in education. Nordic Economic Policy Review
  • Pope, Sydnor (2010). Geographical variations in the gender differences in test scores. Journal of Economic Perspectives
  • Rasch (1960). Probabilistic models for some intelligence and attainment tests. Paedagogiske Institute
  • Riordan (1985). Public and catholic schooling: The effects of gender context policy. American Journal of Education
  • Roberson Hayes, Pahlke, Bigler (2011). The efficacy of single-sex education: Testing for selection and peer quality effects. Sex Roles: A Journal of Research
  • Robinson, Lubienski (2011). The development of gender achievement gaps in mathematics and reading during elementary and middle school: Examining direct cognitive assessments and teacher ratings. American Educational Research Journal
  • Sax (2005). Why gender matters. Doubleday
  • Schrøter Joensen, Skyt Nielsen (2010). Is there a causal effect of high school math on labor market outcomes. The Journal of Human Resources
  • Schneeweis, Zweimuller (2012). Girls, girls, girls: Gender composition and female school choice. Economics of Education Review
  • Smithers, Robinson (2006). The paradox of single-sex schooling and co-educational schooling. Carmichael Press
  • Smyth (2010). Single-sex education: What does research tell us?. Revue Française de Pédagogie
  • Stecher, Klein (1996). Performance assessments in science: Hands-on tasks and scoring guide. RAND Corporation
  • Sullivan, Joshi, Leonard (2010). Single-sex schooling and academic attainment at school and throughout the lifecourse. American Education Research Journal
  • Todd, Wolpin (2003). On the specification and estimation of the production function for cognitive achievement. The Economic Journal
  • Todd, Wolpin (2007). The production of cognitive achievement in children: Home, school and racial test score gaps. Journal of Human Capital
  • Winters et al. (2013). The effect of same-gender teacher assignment on student achievement in the elementary and secondary grades: Evidence from panel data. Economics of Education Review

Cited by — in tracked papers (1)