(Top)SummaryScorecardWhat this paper claimsWhat evidence it offersWhat's goodWhat's wrong with itWhat would change our mindScoring ExplanationKey ClaimsReferencesCited By

Academic Performance and Single-Sex Schooling: Evidence from a Natural Experiment in Switzerland

Gerald Eisenkopf, Zohal Hessami, Urs Fischbacher, Heinrich Ursprung (2011)

10.2139/ssrn.1938858


Summary:

This study claims that randomly assigning girls to all-female classes at a Swiss high school raised their math grades by about 10% of the usable range, especially with male teachers, and that the effect works through improved self-confidence. The core design idea — within-school assignment eliminating self-selection — is genuinely valuable, but because the only outcome is teacher-assigned grades with no standardized benchmark, the study cannot distinguish whether girls learned more math or were simply graded differently in single-sex classrooms, and the teacher-gender finding is almost certainly an artifact of having only eight math teachers.

What this paper claims

Girls randomly assigned to all-female classes at a Swiss high school earned higher math grades — roughly 0.17 to 0.25 points on a 1-to-6 scale — than girls in mixed classes. The effect was larger with male teachers. A survey found girls in single-sex classes reported slightly more positive views of their math ability. The authors conclude that single-sex education improves girls' math performance, partly by changing their self-confidence.

What evidence it offers

This is a quasi-experiment at a single school where the administration says it assigned incoming girls to single-sex or coeducational classes without any criteria — effectively random assignment. The design is better than the usual comparisons across different schools, because all students share the same curriculum, exam standards, and many of the same teachers. But the outcome is report card grades assigned by teachers who know which classes are single-sex, and the school's canton runs no standardized exams. There is no external benchmark to verify that a given grade means the same thing in both settings. The study cannot tell apart "girls learned more math" from "teachers graded differently in all-girls classrooms." The teacher-gender finding (male teachers produce bigger gains in single-sex classes) is estimated from only eight math teachers — three women and five men — making it impossible to separate gender from individual identity.

What's good

The within-school design is a genuine contribution. Most single-sex education research compares different schools, making self-selection impossible to rule out. Here, girls in both class types share the same school, curriculum, exam standards, and often the same teachers. The balance check on entry-exam math scores shows no pre-existing difference. The paper tests multiple subjects and reports the null result in German honestly. The survey items are reproduced, the speculative nature of the competition-based interpretation is openly acknowledged, and the paper frames its policy implications as uncertain.

What's wrong with it

The study measures teacher-assigned grades at a school with no standardized exams and cannot distinguish whether girls in single-sex classes learned more math or were simply graded differently. The paper treats this as a non-issue, arguing that teachers would not apply different standards — but its discussion of teacher-student dynamics describes exactly how grading behavior could shift unconsciously.

The teacher-gender interaction (male teachers produce bigger gains in single-sex classes) is estimated from only eight math teachers. The implausibly large test statistic in the single-sex subsample confirms that this result is picking up individual teachers, not a gender pattern.

The proposed psychological mechanism — that single-sex education works by building self-confidence — is undermined from both ends: the self-concept survey measure does not reach standard thresholds, and the mediating-variable test shows the grade effect survives controlling for psychology, meaning self-confidence is not explaining the grade difference.

What would change our mind

  • Confidence up: A replication using standardized test scores (or blind-graded exams) rather than teacher-assigned grades, showing the same math advantage for single-sex classes.
  • Confidence up: Replication at schools with more treated clusters and more teachers, allowing teacher gender to be separated from individual teacher quality.
  • Confidence down: A study at the same or similar schools showing that teachers grade differently in single-sex versus coeducational settings when student knowledge is held constant (e.g., via double-blind grading of identical exam scripts).
  • Confidence up: Pre-registered replication with a power analysis, especially one designed to test the German null — confirming (or refuting) subject specificity with adequate sensitivity.
  • Confidence down: Evidence that the Cohort 7 shift (from one to three single-sex classes) reflected an administrative decision correlated with student characteristics, which would invalidate the randomization claim.

Scoring Explanation

Study design

The within-school design eliminates the self-selection problem that weakens most single-sex education research. But the randomization is asserted by school administrators, not documented through any protocol. The structural pattern across cohorts is unexplained: seven of eight cohorts had exactly one single-sex class out of four or five, then Cohort 7 suddenly had three, and Cohort 8 had none. Only nine of 39 classes are single-sex — too few treated clusters for reliable inference. The most consequential problem is that teacher-assigned grades with no standardized alternative cannot separate learning gains from grading behavior, and the paper's discussion of teacher-class "symbiotic relationships" describes exactly how grading could shift without teachers intending it. The survey adds only weak evidence: the more comprehensive psychological measure (math self-concept) did not reach standard thresholds, and the one that did (self-assessment) was marginal.

Statistical analysis

The regression framework — student-level random effects, cohort indicators, standard errors clustered at the class level — is appropriate in structure. But with only nine treated clusters, cluster-robust standard errors produce intervals that are too narrow, so every reported significance level is likely overstated. No power analysis is reported, which matters most for the German null result: German grades have a standard deviation of about 0.4 versus 0.7 for math, reducing the study's ability to detect effects, yet the paper treats "no effect in German" as a positive finding about subject specificity. The most striking red flag is the t-statistic of −12.375 for the female-teacher effect within single-sex classes (Model 7). An effect that precisely estimated from 898 observations across at most nine classes taught by eight teachers is not identifying "teacher gender" — it is capturing one or two specific individuals. The psychological-channel test also runs counter to the paper's claims: adding the self-concept and self-assessment measures as controls leaves the single-sex coefficient intact, which is evidence against mediation, not for it.

Construct validity

The paper claims single-sex education improves math proficiency but measures teacher-assigned grades at a school with no standardized exams. A teacher who develops a different dynamic with an all-girls class could shift grades without consciously changing standards, and no external benchmark exists to check. The grading-on-a-curve robustness test rules out one specific alternative (boys capturing top grades under a forced distribution) but not the broader problem. The teacher-gender finding is labeled a gender effect, but with three female math teachers total, the coefficient is a weighted average of those three individuals' grading patterns — teacher identity and teacher gender are nearly the same variable. The proposed psychological channel is contradicted by the paper's mediating-variable test: the single-sex grade effect survives adding the psychological measures as controls, meaning those measures are not explaining the grade difference. The abstract's claim that single-sex schooling "strengthens female students' self-confidence" overstates the survey data, where the self-concept measure did not reach standard thresholds.

Reasoning quality

Three reasoning problems recur throughout. First, the paper frames its finding as improved math proficiency, but all it can show is higher teacher-assigned grades — and it never seriously considers that grading behavior could differ across class types, even while discussing teacher-class dynamics as a mechanism for the teacher-gender interaction. Second, the teacher-gender finding is presented as evidence about male versus female teachers when the data cannot distinguish gender from individual teacher quality. Third, the psychological-channel claim is contradicted by the paper's test — if self-confidence were driving the grade effect, controlling for it should reduce the single-sex coefficient, but it doesn't — yet the paper still treats this channel as "an important driver." The German null result is used as confirmatory evidence of subject specificity without assessing whether the study could have detected an effect in German if one existed.

Transparency

The paper discloses its funding source and reproduces the survey items. No data, code, pre-registration, or ethics approval is reported. For a 2011 economics working paper, some of these absences were standard practice. The more consequential omission is in the limitations discussion: the paper acknowledges it cannot cleanly identify the psychological-channel causation and that its competition-based interpretation is speculative, but does not acknowledge that teacher-assigned grades cannot distinguish learning from grading behavior.

Citation integrity

Individual citations are accurately represented. The paper is candid about which interpretations are speculative and presents contrary evidence on competitor-gender effects (Gneezy and Rustichini 2004; Gneezy, Niederle, and Rustichini 2003). The literature review omits the substantial body of null and negative findings on single-sex education, presenting the field as understudied rather than actively debated. The contradiction between this paper's finding (male teachers help girls more) and Carrell, Page, and West 2010 (female professors help female students more) is noted in a footnote but not treated as the significant tension it is for the interpretive framework.

Independence

This is publicly funded university research with no commercial conflicts. Two authors are affiliated with an institute in the same town as the school, and the school administration provided data and facilitated the survey — a cooperative relationship that creates mild structural pressure but not a material conflict. The study includes design features that could have produced unfavorable results (testing German alongside math, checking balance on entry exams).

Key Claims

Supported

Randomly assigning girls to all-girls classes improves their math performance

Girls in single-sex classes did get higher math grades — about a quarter-point on a six-point scale — and the school says assignment was random, which balance checks on entry-exam scores support. But the outcome is teacher-assigned grades at a school with no standardized exams, so the study cannot tell apart 'girls learned more math' from 'teachers graded differently in all-girls classrooms.' The finding also rests on just nine single-sex classes out of 39 total, which is few enough that the reported precision is likely overstated.

Not supported

The benefit is stronger when a male teacher teaches the all-girls class

Only eight math teachers taught these classes — three women and five men. The reported effect of teacher gender within single-sex classes is implausibly precise for such a small pool, almost certainly reflecting the performance of one or two individual teachers rather than anything about male versus female teachers in general. The data cannot separate teacher gender from teacher identity.

Not supported

Single-sex classes work by boosting girls' math self-confidence

The paper's survey found no clear difference in math self-concept between girls in single-sex and coeducational classes; only a narrower self-assessment measure showed a weak difference. When the authors tested whether these psychological measures explained the grade advantage, the grade advantage survived intact — meaning the proposed confidence channel was not driving the result. The survey was also given while students were already receiving the grades in question, so higher grades could have caused the higher self-assessments rather than the reverse.

References (53)

  • Ai, Norton (2003). Interaction terms in logit and probit models. Economics Letters
  • Arnott, Rowse (1987). Peer group effects and educational attainment. Journal of Public Economics
  • Beilock et al. (2010). Female teachers' math anxiety affects girls' math achievement. Proceedings of the National Academy of Sciences
  • Booth, Nolen (2009). Choosing to compete: How different are girls and boys?. CEPR Discussion Paper No. 7214
  • Booth, Nolen (2009). Gender differences in risk behaviour: Does nurture matter?. IZA Discussion Paper No. 4026
  • Borghans, Meijers, ter Weel (2008). The role of noncognitive skills in explaining cognitive test scores. Economic Inquiry
  • Carrell, Page, West (2010). Sex and science: How professor gender perpetuates the gender gap. Quarterly Journal of Economics
  • Compte, Postlewaite (2004). Confidence-enhanced performance. American Economic Review
  • Cooray, Potrafke (2011). Gender inequality in education: Political institutions or culture and religion?. European Journal of Political Economy
  • Dee (2004). Are there civic returns to education?. Journal of Public Economics
  • Dee (2005). A teacher like me: Does race, ethnicity, or gender matter?. American Economic Review
  • Eisenkopf (2010). Peer effects, motivation, and learning. Economics of Education Review
  • Else-Quest, Hyde, Linn (2010). Cross-national patterns of gender differences in mathematics: A meta-analysis. Psychological Bulletin
  • Ferla, Valcke, Cai (2009). Academic self-efficacy and academic self-concept: Reconsidering structural relationships. Learning and Individual Differences
  • Foster (2006). It's not your peers and it's not your friends. Some progress towards understanding the educational peer effect mechanism. Journal of Public Economics
  • Fryer Jr., Levitt (2010). An empirical analysis of the gender gap in mathematics. American Economic Journal: Applied Economics
  • Gneezy, Leonard, List (2009). Gender differences in competition: Evidence from a matrilineal and a patriarchal society. Econometrica
  • Gneezy, Niederle, Rustichini (2003). Performance in competitive environments: Gender differences. Quarterly Journal of Economics
  • Gneezy, Rustichini (2004). Gender and competition at a young age. American Economic Review Papers and Proceedings
  • Goldin, Katz (2010). Putting the co in education: Timing, reasons, and consequences of college coeducation from 1835 to the present. NBER Working Paper No. 16281
  • Guiso et al. (2008). Culture, gender, and math. Science
  • Gupta, Poulsen, Villeval (2005). Male and female competitive behavior-experimental evidence. IZA Discussion Paper No. 1833
  • Holmlund, Sund (2008). Is the gender gap in school performance affected by the sex of the teacher?. Labour Economics
  • Howsen, Trawick (2007). Teachers, race and student achievement revisited. Applied Economics Letters
  • Jepsen (2005). Teacher characteristics and student achievement: Evidence from teacher surveys. Journal of Urban Economics
  • Kessels, Hannover (2008). When being a girl matters less: Accessibility of gender-related self-knowledge in single-sex and coeducational classes and its impact on students' physics-related self-concept of ability. British Journal of Educational Psychology
  • Köller, Baumert, Schnabel (2001). Does interest matter? The relationship between academic interest and achievement in mathematics. Journal for Research in Mathematics Education
  • Köller et al. (2000). Kurswahlen von Mädchen und Jungen im Fach Mathematik: Zur Rolle von fachspezifischem Selbstkonzept und Interesse. Zeitschrift für Pädagogische Psychologie
  • Lavy (2008). Do gender stereotypes reduce girls' or boys' human capital outcomes? Evidence from a natural experiment. Journal of Public Economics
  • Lavy, Schlosser (2011). Mechanisms and impacts of gender peer effects at school. American Economic Journal: Applied Economics
  • Lee, Bryk (1986). Effects of single-sex secondary schools on student achievement and attitudes. Journal of Educational Psychology
  • Lee, Lockheed (1990). The effects of single-sex schooling on achievement and attitudes in Nigeria. Comparative Education Review
  • Lefgren (2004). Educational peer effects and the Chicago public schools. Journal of Urban Economics
  • Link, Mulligan (1991). Classmates' effects on black student achievement in public school classrooms. Economics of Education Review
  • Manski (1993). Identification of endogenous social effects: The reflection problem. Review of Economic Studies
  • Manski (2000). Economic analysis of social interactions. Journal of Economic Perspectives
  • McEwan (2003). Peer effects on student achievement: Evidence from Chile. Economics of Education Review
  • Neidell, Waldfogel (2010). Cognitive and noncognitive peer effects in early education. Review of Economics and Statistics
  • Niederle, Vesterlund (2007). Do women shy away from competition? Do men compete too much?. Quarterly Journal of Economics
  • Niederle, Vesterlund (2010). Explaining the gender gap in math test scores: The role of competition. Journal of Economic Perspectives
  • Rivkin, Hanushek, Kain (2005). Teachers, schools, and academic achievement. Econometrica
  • Rockoff (2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review
  • Rockoff (2009). Field experiments in class size from the early twentieth century. Journal of Economic Perspectives
  • Rotter (1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs
  • Schneeweis, Zweimüller (2009). Girls, girls, girls: Gender composition and female school choice. University of Linz Economics Working Papers 05
  • Schütz, Ursprung, Wößmann (2008). Education policy and equality of opportunity. Kyklos
  • Smith, Dugan, Trompenaars (1997). Locus of control and affectivity by gender and occupational status: A 14 Nation Study. Sex Roles
  • Steele (1997). A threat in the air. How stereotypes shape intellectual identity and performance. American Psychologist
  • Sutter, Rützler (2010). Gender differences in competition emerge early in life. University of Innsbruck, Working Papers in Economics and Statistics 14
  • Trautwein et al. (2006). Self-esteem, academic self-concept, and achievement: How the learning environment moderates the dynamics of self-concept. Journal of Personality and Social Psychology
  • Trautwein et al. (2006). Tracking, grading, and student motivation: Using group composition and status to predict self-concept and interest in ninth-grade mathematics. Journal of Educational Psychology
  • Trautwein et al. (2009). Within-school social comparison: How students perceive the standing of their class predicts academic self-concept. Journal of Educational Psychology
  • Wigfield, Karpathian (1991). Who am I and what can I do? Children's self-concepts and motivation in achievement situations. Educational Psychologist

Cited by — in tracked papers (1)