Picking up post #4: that is the part I would want checked first.
Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.
Picking up post #4: that is the part I would want checked first.
Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.
Thank you for the correction. I have edited my earlier post with a note rather than silently, so the thread still makes sense to read. The error was mine and it was the kind that comes from remembering a figure instead of looking it up.
This follows post #18 rather than contradicting it.
Pooled estimates and heterogeneity: when trials differ in population, duration, or comparator, a pooled estimate answers a question that no individual trial asked. High heterogeneity means effects genuinely differ across studies. The pooled number is an average of things that should not have been averaged.
post #35 answers the question as asked. The question underneath it is different.
Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.
When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.
I read post #53 twice before replying, because I had assumed the opposite.
Having read the exchange above, I think I was wrong earlier in this topic and I want to say so plainly rather than quietly editing.
The correction was fair and I had been repeating something I had not checked carefully enough.
Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.
post #80 answers the question as asked. The question underneath it is different.
Study quality and weighting: some meta-analyses weight all studies equally; others weight by study size or study quality. The choice affects the result and should be stated and justified.
Coming back to post #93, because the follow-up matters more than the original answer.
When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.
Read the full topic (96 posts)
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
About the Meta-analyses category
Pooled estimates, heterogeneity, publication bias, and when pooling was a mistake. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author…
|
4 | 15k | 13mo | |
|
Revisiting: What pooling buys you and what it destroys
On the subject in the title: Revisiting: What pooling buys you and what it destroys Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the…
|
+97 | 107 | 4k | 19h |
|
Coming back to: Reading a meta-analysis you disagree with, fairly
Reading a meta-analysis you disagree with, fairly Writing it up because I had to work it out twice and would rather nobody else did. I have seen STEP 1 ( N Engl J Med , 2021) cited in support of a claim I do…
|
+30 | 34 | 9.3k | 17mo |
|
Pooling trials with different estimands — what changed since
Pooling trials with different estimands — what changed since — setting out what I have, and where I think it stops being reliable. Comparing STEP 4 ( JAMA , 2021) with SURPASS-4 ( Lancet , 2021) and finding…
|
+57 | 64 | 12k | 7mo |
|
Individual participant data versus aggregate data
Posting this under the heading it deserves: Individual participant data versus aggregate data Everything below is what sits behind that. Session topic: SCALE ( N Engl J Med , 2015). Please read it before…
|
+30 | 34 | 64k | 14mo |
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
Is there a ceiling dose beyond which semaglutide stops adding benefit?
Is there a ceiling dose beyond which semaglutide stops adding benefit? I have a specific reason for asking rather than idle curiosity, and the context is below. I have seen SURPASS-4 ( Lancet , 2021) cited in…
|
2 | 14k | 2mo | |
|
About the Statistics category
Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
|
+4 | 8 | 2.3k | 7mo |
|
Sample size intuition for a personal experiment
On the subject in the title: Sample size intuition for a personal experiment Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it before posting; the discussion is…
|
4 | 62k | 18mo | |
|
The "under review" status pill and when a moderator applies it
Posting this under the heading it deserves: The "under review" status pill and when a moderator applies it Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024). Please read it…
|
+96 | 119 | 17k | 3mo |
|
Measurement error in home scales, with a worked standard deviation — a second dataset
Measurement error in home scales, with a worked standard deviation — a second dataset — setting out what I have, and where I think it stops being reliable. Comparing FLOW ( N Engl J Med , 2024) with SURPASS-2…
|
2 | 13k | 7mo |