The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Meta-analyses · continued

Pooling trials with different estimands — what changed since posts 61–65

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

RI
retention_indexTL2Analytical chemist5 Dec 2025#61
d.vestergaard, post #41: On post #37 — agreed on the reasoning, with one qualification. Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical. Go to post

Pooled estimates and heterogeneity: when trials differ in population, duration, or comparator, a pooled estimate answers a question that no individual trial asked. High heterogeneity means effects genuinely differ across studies. The pooled number is an average of things that should not have been averaged.

11 likes in reply to #41 8mo
MA
m.adeyemiTL2 Moderator7 Dec 2025#62

Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical.

3 likes 8mo
C
chromatogramTL4Analytical chemist9 Dec 2025 · edited#63

On post #59 — agreed on the reasoning, with one qualification.

Subgroup analysis: sometimes a meta-analysis reports separate pooled estimates for different subgroups (e.g., by baseline body mass index or by trial duration). Be cautious — many subgroup analyses are exploratory and less reliable than the main analysis.

0 likes 8mo
AW
a.wikstromTL2 Moderator11 Dec 2025#64

post #63 answers the question as asked. The question underneath it is different.

When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate.

24 likes 8mo
AD
appeals_deskTL3Regular13 Dec 2025#65
n.vukovic, post #51: Picking up post #48: that is the part I would want checked first. When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate. Go to post

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

16 likes in reply to #51 7mo

Suggested topics

TopicParticipantsRepliesViewsActivity
Second pass at: What pooling buys you and what it destroys
Posting this under the heading it deserves: Second pass at: What pooling buys you and what it destroys Everything below is what sits behind that. I have seen STEP 8 ( JAMA , 2022) cited in support of a claim…
MHCCYMRMBJ+32 36 19k 4mo
Second pass at: When a network meta-analysis is defensible and when it is not
Posting this under the heading it deserves: Second pass at: When a network meta-analysis is defensible and when it is not Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with LEADER…
LSOID 2 2.8k 21mo
Second pass at: A pooled estimate that changed when one trial was added
On the subject in the title: Second pass at: A pooled estimate that changed when one trial was added Working notes rather than a conclusion. Session topic: SELECT ( N Engl J Med , 2023). Please read it before…
FLSTYAWNRM+26 30 22k 1mo
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
MDEHDHPMNA+74 83 6.6k 8mo
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it…
NCJVSDBSEF+95 106 20k 17mo

Related topics — sharing the tags publication bias, risk of bias, meta-analysis

TopicParticipantsRepliesViewsActivity
Retatrutide's phase 2 heart-rate signal and how to think about it
On the subject in the title: Retatrutide's phase 2 heart-rate signal and how to think about it Working notes rather than a conclusion. I have seen PIONEER 6 ( N Engl J Med , 2019) cited in support of a claim…
MVBERMBJER+19 23 20k 7mo
Critiquing an observational claim about a class effect — one year on
Critiquing an observational claim about a class effect — one year on — setting out what I have, and where I think it stops being reliable. I have seen LEADER ( N Engl J Med , 2016) cited in support of a claim…
FELDKRAWDO+5 9 3.2k 8mo
Regression to the mean in progress reports
On the subject in the title: Regression to the mean in progress reports Working notes rather than a conclusion. Session topic: PIONEER 6 ( N Engl J Med , 2019). Please read it before posting; the discussion…
HAAMTFAVDM+30 34 49k 12mo
About the Statistics category
Effect sizes, intervals, multiplicity, and the difference between absent and undetected. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
SLJMBVCAV+4 8 2.3k 7mo
Journal club: SELECT, absolute risk, and how it was reported — a second dataset
On the subject in the title: Journal club: SELECT, absolute risk, and how it was reported — a second dataset Working notes rather than a conclusion. Comparing SURMOUNT-1 ( N Engl J Med , 2022) with SELECT ( N…
VKJBFNAITH 4 1.3k 1mo