The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Meta-analyses

Publication bias detection and its low power

MA
mi.amankwahTL2 Moderator16 Jun 2026#1

On the subject in the title: Publication bias detection and its low power Working notes rather than a conclusion.

I have seen SURMOUNT-1 (N Engl J Med, 2022) cited in support of a claim I do not think it supports, twice this month, so I would like to work through what it actually shows.

My reading is that the trial is sound for its own question and is being stretched to answer a different one. I might be wrong about that, which is why this is a topic rather than a correction.

What I would like from this discussion: someone who disagrees with me to say why, with the section of the paper they are relying on.

4 likes 1mo
ZL
z.laurentTL2 Moderator10 Jul 2026#2

Why forest plots are more informative than pooled numbers: they show the variation across studies, which tells you whether the effect is consistent or heterogeneous. A narrow confidence interval around a meaningless centre is less useful than a wider interval that shows real differences.

8 likes 18d
KK
k.kimaniTL2 Moderator27 Jul 2026#3

post #2 answers the question as asked. The question underneath it is different.

Publication bias: what did not get published? Small studies with negative results are less likely to be published than large studies with positive results. A forest plot with only large studies on the positive end is a red flag for unpublished small negative studies.

19 likes 1d

Suggested topics

TopicParticipantsRepliesViewsActivity
Second pass at: A pooled estimate that changed when one trial was added
On the subject in the title: Second pass at: A pooled estimate that changed when one trial was added Working notes rather than a conclusion. Session topic: SELECT ( N Engl J Med , 2023). Please read it before…
FLSTYAWNRM+26 30 22k 1mo
About the Meta-analyses category
Pooled estimates, heterogeneity, publication bias, and when pooling was a mistake. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its author…
SLDOERZSIT 4 15k 13mo
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
MDEHDHPMNA+74 83 6.6k 8mo
Coming back to: Prediction intervals and why they are more honest than confidence intervals
Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURMOUNT-OSA ( N Engl J Med , 2024)…
TDIBB 2 65 22mo
Risk-of-bias tools and the judgement they conceal — does this still hold?
Risk-of-bias tools and the judgement they conceal — does this still hold? — that is the question, and I have not found it answered plainly anywhere I have looked. Comparing SURPASS-2 ( N Engl J Med , 2021)…
GLGEBSR+26 30 5.8k 23h

Related topics — sharing the tags heterogeneity, publication bias, effect size

TopicParticipantsRepliesViewsActivity
How to read a phase 2 result without treating it as a phase 3 result
The question in the title: How to read a phase 2 result without treating it as a phase 3 result I will give what I have already checked below so nobody repeats it. Session topic: FLOW ( N Engl J Med , 2024).…
EKTTTVLCKH+36 40 35k 7mo
Why retatrutide discussion here is more cautious than elsewhere
Why retatrutide discussion here is more cautious than elsewhere I have a specific reason for asking rather than idle curiosity, and the context is below. I have seen SURMOUNT-OSA ( N Engl J Med , 2024) cited…
DSCAKNKN+7 12 7.7k 2mo
Critiquing an observational claim about a class effect
Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that. Session topic: SCALE ( N Engl J Med , 2015). Please read it before…
VRRIJV 2 6.9k 14mo
Follow-up: Individual participant data versus aggregate data
Individual participant data versus aggregate data — setting out what I have, and where I think it stops being reliable. Comparing LEADER ( N Engl J Med , 2016) with SURPASS-4 ( Lancet , 2021) and finding the…
HDAPRSGVRV+101 111 23k 18mo
[2026 update] Heterogeneity as information rather than as a nuisance
Heterogeneity as information rather than as a nuisance Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021) cited in support of a claim I…
PSGCCFDCL 4 32k 11mo