Eta-Squared (η²)
The engine for Variance Discovery. Eta-Squared (η²) audits the total percentage of outcome variability 'owned' by a categorical factor, reveal the structural dominance of grouping in ANOVA designs.
What is it?
Eta-Squared (η²) is designed to mathematically isolate and quantify the magnitude of an observed outcome or model factor, independently of sample size.
The engine for Variance Discovery. Eta-Squared (η²) audits the total percentage of outcome variability 'owned' by a categorical factor, reveal the structural dominance of grouping in ANOVA designs.
Goals & Indications
- Variance Ownership Audit: Determine exactly what percentage of the 'Outcome Pie' is captured by your treatment grouping.
- Factorial Synergy Discovery: Quantify the relative importance of different predictors in explaining global data behavior.
- Global Impact Mapping: Identify the dominant drivers of success in complex, multi-factor ANOVA grids.
Core Idea Diagram
Claims tested
How it works
- Execute analysis of variance (ANOVA) to obtain sum of squares.
- Identify Group Sum of Squares (SS_effect) and Total Sum of Squares (SS_total).
- Calculate proportion of explained variance: eta² = SS_effect / SS_total.
- Reference eta² values to assess effect size magnitude.
Assumptions
Important Note
Eta-squared is a descriptive effect size metric, not a hypothesis test. It quantifies the proportion of total variance in the DV attributable to the IV. Always report with ANOVA results.
Worked Example
| SS effect | SS error | η² |
|---|---|---|
| 10.0 | 90.0 | 10.0% (Small) |
| 40.0 | 60.0 | 40.0% (Large) |
ANOVA Variance Segmentation Laboratory
Slide effect and error sum of squares (SS). Watch how the explained variance partition changes in real-time.
Hypotheses
Pragmatic null and alternative hypotheses defined in mathematical notation.
H₀: Effect size = 0 (the factor explains no variance in the outcome)
Hₐ: Effect size > 0 (the factor explains some proportion of variance)
Eta-squared is a descriptive effect size metric, not a hypothesis test. It quantifies the proportion of total variance in the DV attributable to the IV. Always report with ANOVA results.
Assumptions
The core mathematical criteria needed to ensure that statistical testing remains unbiased and valid.
Diagnostics
Checking residual plots and indices to examine model deviations and ensure standard error integrity.
- ANOVA assumption checks (Levene's, Q-Q plots, boxplots)
- Sample size adequacy (n ≥ 20 per group for stable estimates)
- SS decomposition verification (SS_total = SS_effect + SS_error)
- Bootstrap 95% CI for η² (addresses sampling variability)
- Compare η², ηp², and ω² to understand bias
- Sensitivity analysis: effect size with/without outliers
- Visual inspection of variance components
- Cross-validation of effect size in holdout sample
Applied Minds
Review concrete study examples, data layout guidelines, and copy executable syntax scripts.
Teaching Methods and Test Scores (One-way ANOVA)
Research question: Do different teaching methods affect student test performance? Design: 90 students randomized to 3 methods (Lecture n=30, Active Learning n=30, Flipped Classroom n=30). Outcome: Final exam score (0-100, continuous). Compute η², ηp², and ω² from ANOVA.
# Eta-squared effect sizes from one-way ANOVA
library(effectsize)
library(tidyverse)
# Simulate data
set.seed(2025)
data <- data.frame(
method = rep(c("Lecture", "Active", "Flipped"), each=30),
score = c(
rnorm(30, 72, 12), # Lecture: M=72, SD=12
rnorm(30, 78, 11), # Active: M=78, SD=11
rnorm(30, 82, 10) # Flipped: M=82, SD=10
)
)
# ANOVA
model <- aov(score ~ method, data=data)
summary(model)
# Extract SS values
anova_summary <- summary(model)[[1]]
SS_effect <- anova_summary["method", "Sum Sq"]
SS_error <- anova_summary["Residuals", "Sum Sq"]
SS_total <- SS_effect + SS_error
df_effect <- anova_summary["method", "Df"]
MS_error <- anova_summary["Residuals", "Mean Sq"]
# Manual computation
eta_sq <- SS_effect / SS_total
partial_eta_sq <- SS_effect / (SS_effect + SS_error) # Same as η² in one-way
omega_sq <- (SS_effect - df_effect * MS_error) / (SS_total + MS_error)
cat("=== Manual Calculation ===", "\n")
cat(sprintf("η² = %.3f (%.1f%% variance explained)\n", eta_sq, eta_sq*100))
cat(sprintf("ηp² = %.3f\n", partial_eta_sq))
cat(sprintf("ω² = %.3f (less biased estimate)\n", omega_sq))
# Using effectsize package (recommended)
cat("\n=== effectsize Package ===", "\n")
eta_squared(model, partial=FALSE) # η²
eta_squared(model, partial=TRUE) # ηp²
omega_squared(model) # ω²
# Interpretation
cat("\n=== Cohen(1988) Benchmarks ===", "\n")
cat("Small: .01, Medium: .06, Large: .14\n")
cat(sprintf("Result: ω² = %.3f → %s effect\n",
omega_sq,
ifelse(omega_sq >= .14, "LARGE",
ifelse(omega_sq >= .06, "Medium", "Small"))))
# Bootstrap CI for η²
library(boot)
boot_eta_sq <- function(data, indices) {
d <- data[indices, ]
model <- aov(score ~ method, data=d)
SS <- summary(model)[[1]][, "Sum Sq"]
SS[1] / sum(SS)
}
boot_results <- boot(data, boot_eta_sq, R=1000)
boot_ci <- boot.ci(boot_results, type="perc")
cat("\n95% CI for η²:", boot_ci$percent[4:5], "\n")
# APA report
cat("\n=== APA Report ===", "\n")
cat(sprintf("F(2, 87) = %.2f, p < .001, ω² = %.2f (large effect, 95%% CI [%.2f, %.2f])\n",
anova_summary["method", "F value"],
omega_sq,
boot_ci$percent[4], boot_ci$percent[5]))F(2, 87) = 8.45, p < .001, ω² = .13 (large effect, approaching Cohen's .14 threshold). Teaching method explains ~13% of variance in exam scores. Flipped classroom (M=82) outperformed lecture (M=72), d=0.91. Effect size indicates educationally meaningful differences.
Alternatives
Structured fallback pathways for choosing alternative tests when normality or slopes requirements fail.
- Omega-Squared (ω²) — The required pivot for small samples to subtract random sampling error.
- Epsilon-Squared (ε²) — A more conservative alternative for unbiased variance-explained.
- Partial Eta-Squared — Isolate the unique variance of one factor while ignoring others.
- Generalized Eta-Squared — The standard for comparing effects across different experimental designs.
Post-hoc
Group mean comparisons and correction controls (e.g. Tukey HSD, Bonferroni) to protect against Family-Wise Error Rates.
- Compare with omega-squared (less biased estimator)
- Compare with partial eta-squared for factorial designs
- Bootstrap confidence intervals
- Convert to Cohen's f for power analysis
- Examine epsilon-squared as alternative for unequal groups
Eta-squared is an effect size measure for ANOVA, not a hypothesis test. Post-hoc tests are not applicable.
Effect Size
Understanding effect sizes (e.g., Cohen's d, Partial Eta-Squared) and clinical impact benchmarks.
Proportion of total variance explained. Small: .01, Medium: .06, Large: .14 (Cohen, 1988). Biased upward in small samples.
Proportion of variance explained controlling for other factors. Same benchmarks (.01/.06/.14). Standard in factorial designs.
Less biased population estimate. Small: .01, Medium: .06, Large: .14. RECOMMENDED for reporting.
For Welch's ANOVA with unequal variances. Similar interpretation to ω².
Comparable across different research designs. Adjusts for manipulated vs measured factors.
0.2
0.5
0.8
Sample Size
Guidelines for minimum sample requirements and power analysis parameters.
The 'Variance Stability' Minimum: A minimum of 25 participants per factor level is essential. Eta-squared systematically overestimates variance-explained in small samples; robust estimates require cell saturation.
| Effect Size | Parameters | Required n |
|---|---|---|
| Small Effect | η² = .01 (Small) | n ≈ 1000 total |
| Medium Effect | η² = .06 (Medium) | n ≈ 160 total |
| Large Effect | η² = .14 (Large) | n ≈ 60 total |
The 'Sample Bias' Penalty: Pure η² counts random sampling error as 'Explained Variance'. In samples with N < 50, η² can claim 10% explained even if the true population effect is zero. Use Omega-squared for small samples to maintain rigor.
Reporting
How to compile statistical results into publication prose matching APA and journal style guides.
A one-way/factorial ANOVA revealed a significant effect of IV on DV, F(df_between, df_within) = X.XX, p < .XXX, ω² = .XX, 95% CI .XX, .XX, indicating a small/medium/large effect. Alternatively: η² = .XX (sample estimate) and ω² = .XX (population estimate). Approximately X% of the variance in DV was attributable to IV.
- F-statistic with degrees of freedom
- p-value
- Effect size (ω² preferred, η² acceptable)
- 95% confidence interval for effect size
- Effect size interpretation (small/medium/large)
- Descriptive statistics per group (M, SD, n)
Manuscript Lab
Copy standard summary tables and forensic reporting grids to outline analysis details.
| Source | Sum of Squares | Eta-Squared (η²) | Interpretation |
|---|---|---|---|
| Factor A | 45.2 | 0.12 | Small-Medium |
| Factor B | 112.8 | 0.30 | Large |
| Error | 214.1 | 0.58 | Residual Variance |
The 'Ownership' Ratio. Tells you what percentage of the TOTAL variation in the outcome is owned by this specific factor. Sum of all η² + Error η² = 1.0.
The 'Unknown'. Represents the proportion of variance left unexplained by the model.
Command Center
Syntax libraries and function parameters for executing calculations in stats packages.
# 1. Extract η² from ANOVA object
effectsize::eta_squared(anova_model, partial = FALSE)
# 2. Comparison with Partial η²
lsr::etaSquared(anova_model)Eta-squared is biased upward in small samples. If your sample is small, report 'Omega-Squared' (ω²) for a more accurate, conservative estimate of variance explained.
# Execute Unbiased Variance Audit
effectsize::omega_squared(anova_model)Common Mistakes
Analytical caveats and corrections to maintain modeling integrity.
References
Scholarly lineage and citation keys grounding the statistical framework.