In brief
- A systematic review is the whole structured process; a meta-analysis is an optional statistical step within it.
- Pool studies only when their populations, interventions, comparators, outcomes and designs are similar enough to answer the same question.
- A fixed-effect model assumes one true effect; a random-effects model assumes true effects vary between studies.
- I² describes the proportion of variability due to heterogeneity, and tau² estimates the between-study variance.
- A forest plot shows every study's estimate, its weight and the pooled result in one figure.
What is a meta-analysis? ¶
Every good meta-analysis sits inside a systematic review. Not every systematic review contains a meta-analysis.
A meta-analysis is a statistical method that combines the numerical results of two or more independent studies addressing the same question to produce a single pooled estimate of effect. Each study is weighted, usually by the inverse of its variance, so that larger and more precise studies contribute more. The result is a more precise estimate than any single study gives.
A systematic review, by contrast, is the full research process: a focused question, a registered protocol, a comprehensive search, independent screening, data extraction, risk of bias assessment, synthesis and reporting. Our systematic review guide walks through each step.
So the short answer to "systematic review vs meta-analysis" is that they work at different levels. The systematic review is the container; the meta-analysis is one possible way of synthesizing what the container holds.
Difference between a meta-analysis and a systematic review ¶
| Feature | Systematic review | Meta-analysis |
|---|---|---|
| What it is | A research design for collecting and appraising evidence | A statistical technique for pooling results |
| Purpose | Identify, appraise and synthesize all relevant studies on a question | Estimate an overall effect and explore variation between studies |
| Data | Qualitative, quantitative or both | Quantitative only (effect sizes with measures of precision) |
| Synthesis | Narrative, thematic or statistical | Statistical, with weighted averaging |
| Output | Summary tables, risk of bias judgments, certainty ratings | Pooled estimate, confidence interval, heterogeneity statistics, forest plot |
| Always possible? | Yes, given a clear question | Only when studies are similar enough to combine |
| Reporting guideline | PRISMA 2020 | PRISMA 2020 (synthesis items 13 and 20) |
A paper titled "a systematic review and meta-analysis" did both: it reviewed the literature systematically and then pooled at least one outcome. A scoping review is a third option that maps evidence and almost never includes a meta-analysis.
When is a meta-analysis appropriate? ¶
The Cochrane Handbook frames this as a question of whether combining studies makes sense clinically and methodologically, not only statistically. Before pooling, check that:
- The studies answer the same question. Participants, interventions, comparators and outcomes are similar enough that an average effect is meaningful.
- Outcomes can be expressed on a common scale. For example, a risk ratio for a binary outcome or a mean difference for a continuous one.
- Designs are compatible. Randomized and non-randomized studies are usually analyzed separately.
- Each study reports usable data, such as event counts, or means with standard deviations and sample sizes.
- Risk of bias is understood. Pooling biased studies produces a precise but misleading answer, so plan sensitivity analyses that exclude high-risk studies.
Two studies are technically enough to pool, but estimates of heterogeneity are very imprecise with few studies. When pooling is not appropriate, use a structured narrative synthesis and report it with the SWiM guideline. Avoid simple vote counting of significant versus non-significant results.
Decide your pooling criteria in the protocol. Deciding after you see the data invites selective analysis, and peer reviewers will check your protocol against the paper.
Systematic Review & Meta-Analysis Support
Planning a meta-analysis? Get expert input on your pooling criteria, model choice, heterogeneity analysis and forest plots.
How to conduct a systematic review and meta-analysis ¶
The meta-analysis comes near the end of the review, after the groundwork that makes it trustworthy.
- Register a protocol (for example on PROSPERO) that states your question, outcomes, effect measures, model and planned subgroup and sensitivity analyses.
- Search, screen and select studies systematically, and record the counts for your PRISMA flow diagram.
- Extract outcome data in duplicate: event counts, or means, standard deviations and sample sizes for each group.
- Assess risk of bias in each study with a tool such as RoB 2 or ROBINS-I.
- Pool the data with the pre-specified model, then examine heterogeneity and run sensitivity analyses.
- Check small-study effects with a funnel plot when you have enough studies.
- Rate certainty of the evidence for each outcome, commonly with GRADE, and report everything against the PRISMA 2020 checklist.
Effect measures used in meta-analysis ¶
| Outcome type | Common effect measures | Line of no effect |
|---|---|---|
| Binary (event yes or no) | Risk ratio (RR), odds ratio (OR), risk difference (RD) | 1 for RR and OR; 0 for RD |
| Continuous, same scale | Mean difference (MD) | 0 |
| Continuous, different scales | Standardized mean difference (SMD, such as Hedges' g) | 0 |
| Time to event | Hazard ratio (HR) | 1 |
| Association | Correlation (often analyzed as Fisher's z) | 0 |
Ratio measures are analyzed on the log scale and transformed back for presentation.
Fixed-effect vs random-effects models ¶
The choice of model reflects what you assume about the true effects behind the studies.
| Fixed-effect (common-effect) | Random-effects | |
|---|---|---|
| Assumption | All studies estimate one identical true effect | True effects differ between studies and follow a distribution |
| What the pooled result means | The best estimate of that single common effect | The average of the distribution of true effects |
| Weighting | Inverse variance; large studies dominate | Inverse of (within-study variance + tau²); weights more balanced |
| Confidence interval | Narrower | Wider when heterogeneity is present |
| Common methods | Inverse variance, Mantel-Haenszel, Peto | DerSimonian-Laird, REML, often with the Hartung-Knapp-Sidik-Jonkman adjustment |
Random-effects models are the usual choice in health and social sciences, where studies rarely share identical populations and settings. Choose the model on conceptual grounds in your protocol rather than switching after a heterogeneity test.
Heterogeneity: Q, I² and tau² ¶
Heterogeneity is variation in study results beyond what chance alone would produce. Three statistics describe it:
- Cochran's Q (chi-squared test) tests whether the variation exceeds chance. It has low power with few studies, so the Cochrane Handbook notes that a P value of 0.10 is sometimes used, and a non-significant result is not evidence of no heterogeneity.
- I² is the percentage of variability in effect estimates due to heterogeneity rather than chance. Cochrane's rough guide: 0% to 40% might not be important; 30% to 60% may be moderate; 50% to 90% may be substantial; 75% to 100% is considerable. The ranges overlap on purpose, because interpretation depends on the size and direction of effects.
- tau² is the estimated between-study variance in true effects, on the scale of the effect measure. Its square root, tau, is the standard deviation of true effects.
A prediction interval uses tau² to show the range in which the true effect of a new, similar study would likely fall. Explore heterogeneity with pre-specified subgroup analyses or meta-regression, not by dropping studies until I² falls.
How to read a forest plot ¶
A forest plot is the standard figure for a meta-analysis. Each row is a study: a square marks its estimate, with size proportional to its weight, and a horizontal line shows its 95% confidence interval. A vertical line marks no effect. The diamond at the bottom is the pooled estimate, its width the confidence interval.
Worked example: exercise and HbA1c (mean difference, %)
| Study | MD | 95% CI | Weight (random) |
|---|---|---|---|
| Study A 2016 | -0.45 | -0.84 to -0.06 | 17.3% |
| Study B 2018 | -0.20 | -0.49 to 0.09 | 23.0% |
| Study C 2019 | -0.70 | -1.19 to -0.21 | 13.1% |
| Study D 2021 | -0.10 | -0.34 to 0.14 | 27.1% |
| Study E 2023 | -0.55 | -0.90 to -0.20 | 19.4% |
| Random-effects (DerSimonian-Laird) | -0.35 | -0.57 to -0.13 | 100% |
Heterogeneity: Q = 8.27, df = 4, p = .08; I² = 52%; tau² = 0.03. 95% prediction interval: -1.01 to 0.31. Fixed-effect estimate for comparison: -0.30 (-0.44 to -0.15).
Reading: exercise lowered HbA1c by about 0.35 percentage points on average, and the confidence interval excludes zero. Heterogeneity is moderate, and the prediction interval crosses zero, so in some settings the effect may be negligible.
With 10 or more studies, add a funnel plot to look for small-study effects such as publication bias.
Meta-analysis software ¶
| Software | Notes |
|---|---|
| RevMan (Cochrane) | Standard for Cochrane reviews; forest plots and risk of bias figures built in |
R: metafor and meta packages | Free and flexible; meta-regression, multilevel models, prediction intervals |
Stata: meta suite | Built in since Stata 16; meta set, meta summarize, meta forestplot |
| Comprehensive Meta-Analysis (CMA) | Commercial, menu-driven |
| JASP and jamovi | Free point-and-click options with meta-analysis modules |
If you are running the analysis yourself and want someone to check the model, code and interpretation, our systematic review and meta-analysis support works through it with you. For hands-on help with the software, see R help or Stata help.
Sources and further reading
- Cochrane Handbook, Chapter 10: Analysing data and undertaking meta-analyses
- Cochrane Handbook for Systematic Reviews of Interventions (current version)
- Page MJ et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71
- Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw 2010;36(3)