Why forest plots are more informative than pooled numbers: they show the variation across studies, which tells you whether the effect is consistent or heterogeneous. A narrow confidence interval around a meaningless centre is less useful than a wider interval that shows real differences.
Follow-up: Individual participant data versus aggregate data
Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.
When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.
Coming back to post #54, because the follow-up matters more than the original answer.
Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.
post #63 is right about the mechanism and I think understates the practical bit.
Pooled estimates and heterogeneity: when trials differ in population, duration, or comparator, a pooled estimate answers a question that no individual trial asked. High heterogeneity means effects genuinely differ across studies. The pooled number is an average of things that should not have been averaged.
When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.
Worth separating two things that post #81 runs together.
Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.
On post #107 — agreed on the reasoning, with one qualification.
Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.
Read the full topic (112 posts)
This topic was referenced in
- A pooled estimate that changed when one trial was addedEvidence › Meta-analyses · 28 replies
- Reading a meta-analysis you disagree with, fairlyEvidence › Meta-analyses · 13 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
|
+74 | 83 | 6.6k | 8mo |
|
About the Meta-analyses category
Pooled estimates, heterogeneity, publication bias, and when pooling was a mistake. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author…
|
4 | 15k | 13mo | |
|
Second pass at: When a network meta-analysis is defensible and when it is not
Posting this under the heading it deserves: Second pass at: When a network meta-analysis is defensible and when it is not Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with LEADER…
|
2 | 2.8k | 21mo | |
|
Reading a meta-analysis you disagree with, fairly
Posting this under the heading it deserves: Reading a meta-analysis you disagree with, fairly Everything below is what sits behind that. I have seen SURPASS-2 ( N Engl J Med , 2021) cited in support of a…
|
+7 | 13 | 2.5k | 23mo |
|
Revisiting: What pooling buys you and what it destroys
On the subject in the title: Revisiting: What pooling buys you and what it destroys Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the…
|
+97 | 107 | 4k | 19h |
Related topics — sharing the tags meta-analysis, effect size, publication bias
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Second pass at: Triple agonism: additive, synergistic, or neither?
Second pass at: Triple agonism: additive, synergistic, or neither? — that is the question, and I have not found it answered plainly anywhere I have looked. I have seen STEP 8 ( JAMA , 2022) cited in support…
|
+114 | 120 | 1.4k | 10mo |
|
SURMOUNT-4 and what withdrawal data does and does not tell an individual — one year on
Posting this under the heading it deserves: SURMOUNT-4 and what withdrawal data does and does not tell an individual — one year on Everything below is what sits behind that. Comparing SURPASS-2 ( N Engl J Med…
|
+122 | 136 | 48k | 9mo |
|
[2026 update] Heterogeneity as information rather than as a nuisance
Heterogeneity as information rather than as a nuisance Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a claim I…
|
4 | 32k | 11mo | |
|
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURMOUNT-OSA ( N Engl J Med ,…
|
+81 | 90 | 54k | 9mo |
|
Multiplicity when you track fifteen variables
Multiplicity when you track fifteen variables — setting out what I have, and where I think it stops being reliable. Comparing LEADER ( N Engl J Med , 2016) with SURMOUNT-OSA ( N Engl J Med , 2024) and finding…
|
2 | 60k | 11mo |