The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Topic summary

Second pass at: What pooling buys you and what it destroys

This is a generated summary. It shows the 5 most-liked posts from a topic of 37, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
AK
a.kravchenkoTL2 Moderator9 Jan 2026#8

I read post #6 twice before replying, because I had assumed the opposite.

Publication bias: what did not get published? Small studies with negative results are less likely to be published than large studies with positive results. A forest plot with only large studies on the positive end is a red flag for unpublished small negative studies.

28 likes 7mo
SF
sterile_fileTL3Regular24 Jan 2026 · edited#12

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

33 likes 6mo
VM
v.milanoviTL3Regular7 Feb 2026#16
e.roos, post #10: Funnel plots: a plot of study effect size versus sample size that helps detect publication bias. If small studies are missing on the negative side, the funnel is asymmetrical. Go to post

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

25 likes in reply to #10 6mo
KS
k.salinasTL2 Moderator5 Mar 2026#24

Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.

25 likes 5mo
SL
sleep_logTL2Regular26 Mar 2026#31
c.castellanos, post #2: On the opening post — agreed on the reasoning, with one qualification. Inclusion and exclusion criteria: a meta-analysis is only as good as its inclusion criteria. If the criteria are too broad, apples and oranges get pooled. If they are too narrow, the meta-analysis answers a overly specific question. Go to post

On post #27 — agreed on the reasoning, with one qualification.

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

32 likes in reply to #2 4mo

Read the full topic (37 posts)

Suggested topics

TopicParticipantsRepliesViewsActivity
Reading a meta-analysis you disagree with, fairly
Posting this under the heading it deserves: Reading a meta-analysis you disagree with, fairly Everything below is what sits behind that. I have seen SURPASS-2 ( N Engl J Med , 2021) cited in support of a…
SOHNPOLASD+7 13 2.5k 23mo
Random versus fixed effects: choosing rather than defaulting
Random versus fixed effects: choosing rather than defaulting — setting out what I have, and where I think it stops being reliable. Session topic: FLOW ( N Engl J Med , 2024). Please read it before posting;…
NPFSMLAJS+16 20 22k 13mo
Coming back to: Prediction intervals and why they are more honest than confidence intervals
Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURMOUNT-OSA ( N Engl J Med , 2024)…
TDIBB 2 65 22mo
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Comparing SUSTAIN 6 ( N Engl J Med , 2016) with LEADER (…
MVMBC 2 27k 4h
Coming back to: Reading a meta-analysis you disagree with, fairly
Reading a meta-analysis you disagree with, fairly Writing it up because I had to work it out twice and would rather nobody else did. I have seen STEP 1 ( N Engl J Med , 2021) cited in support of a claim I do…
TVBDJIPMCT+30 34 9.3k 17mo

Related topics — sharing the tags risk of bias, meta-analysis, heterogeneity

TopicParticipantsRepliesViewsActivity
Journal club: STEP-HFpEF and symptom endpoints
Journal club: STEP-HFpEF and symptom endpoints — setting out what I have, and where I think it stops being reliable. Comparing SURMOUNT-2 ( Lancet , 2023) with SURMOUNT-1 ( N Engl J Med , 2022) and finding…
MREPAKTWJD+18 22 2.5k 11mo
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it…
NCJVSDBSEF+95 106 20k 17mo
Selection into a registry and what it does to the estimate — a second dataset
Posting this under the heading it deserves: Selection into a registry and what it does to the estimate — a second dataset Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024).…
PBINVFPES+28 32 1.3k 1d
Coming back to: Why a preprint's supplementary material is often the best part
Why a preprint's supplementary material is often the best part — that is the question, and I have not found it answered plainly anywhere I have looked. Comparing SURPASS-2 ( N Engl J Med , 2021) with STEP 4 (…
GDIBDTHFBV+109 116 36k 2d
Selection into a registry and what it does to the estimate
Selection into a registry and what it does to the estimate — setting out what I have, and where I think it stops being reliable. Session topic: STEP 4 ( JAMA , 2021). Please read it before posting; the…
SSLMAA 2 55k 7mo