The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Topic summary

Risk-of-bias tools and the judgement they conceal

This is a generated summary. It shows the 5 most-liked posts from a topic of 13, in their original order, with the accepted answer included where one exists. It is a reading aid and it will miss nuance — the full topic is the record.
HA
h.amankwahTL2 Moderator6 May 2025#2

Fixed-effects versus random-effects models: fixed-effects assumes all studies are estimating the same thing and variation is sampling error. Random-effects assumes studies are estimating effects from different distributions and allows between-study variance. Choice matters if heterogeneity is high.

18 likes 15mo
RM
r.molnarTL2 Moderator27 Jun 2025#6

post #5 is right about the mechanism and I think understates the practical bit.

Publication bias: what did not get published? Small studies with negative results are less likely to be published than large studies with positive results. A forest plot with only large studies on the positive end is a red flag for unpublished small negative studies.

25 likes 13mo
MO
m.onwukaTL2 Moderator28 Jul 2025#9
k.brandl_de, post #1: Risk-of-bias tools and the judgement they conceal Writing it up because I had to work it out twice and would rather nobody else did. I have seen STEP 1 ( N Engl J Med , 2021) cited in support of a claim I do not think it supports, twice this month, so I would like to work through what it actually shows. My reading is that the trial is… Go to post

On post #5 — agreed on the reasoning, with one qualification.

Sensitivity analysis: the authors re-run the meta-analysis excluding studies one at a time, or by quality, to see whether the pooled estimate changes. Robust results stay similar even when individual studies are excluded.

19 likes in reply to #1 12mo
MP
mira.patelTL4 Admin7 Aug 2025#10
f.chowdhury, post #8: When a meta-analysis is unhelpful: if the included studies are heterogeneous in population, intervention, or outcome, pooling them produces a number that represents nothing in particular. Reading the individual studies is more useful than reading the pooled estimate. Go to post

Number needed to treat from a meta-analysis: can be computed from the pooled estimate if the baseline risk is specified. More interpretable than pooled relative effects.

8 likes in reply to #8 12mo
AR
a.reyesTL4 Admin5 Sep 2025 · edited#13
Staff post. Actions described here are recorded in the public moderation log and may be challenged in Meta.

This follows post #10 rather than contradicting it.

Subgroup analysis: sometimes a meta-analysis reports separate pooled estimates for different subgroups (e.g., by baseline body mass index or by trial duration). Be cautious — many subgroup analyses are exploratory and less reliable than the main analysis.

9 likes 11mo

Read the full topic (13 posts)

Suggested topics

TopicParticipantsRepliesViewsActivity
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. Comparing SURMOUNT-2 ( Lancet , 2023) with LEADER ( N Engl J Med ,…
MDEHDHPMNA+74 83 6.6k 8mo
Coming back to: Prediction intervals and why they are more honest than confidence intervals
Prediction intervals and why they are more honest than confidence intervals Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURMOUNT-OSA ( N Engl J Med , 2024)…
TDIBB 2 65 22mo
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Comparing SUSTAIN 6 ( N Engl J Med , 2016) with LEADER (…
MVMBC 2 27k 4h
Follow-up: Individual participant data versus aggregate data
Individual participant data versus aggregate data — setting out what I have, and where I think it stops being reliable. Comparing LEADER ( N Engl J Med , 2016) with SURPASS-4 ( Lancet , 2021) and finding the…
HDAPRSGVRV+101 111 23k 18mo
Random versus fixed effects: choosing rather than defaulting — a second dataset
On the subject in the title: Random versus fixed effects: choosing rather than defaulting — a second dataset Working notes rather than a conclusion. Session topic: STEP 2 ( Lancet , 2021). Please read it…
NCJVSDBSEF+95 106 20k 17mo

Related topics — sharing the tags meta-analysis, heterogeneity, publication bias

TopicParticipantsRepliesViewsActivity
When a network meta-analysis is defensible and when it is not
When a network meta-analysis is defensible and when it is not I have a specific reason for asking rather than idle curiosity, and the context is below. Comparing SUSTAIN 6 ( N Engl J Med , 2016) with LEADER (…
MVMBC 2 27k 4h
[2026 update] Journal club: is percentage weight change the right endpoint?
Journal club: is percentage weight change the right endpoint? — that is the question, and I have not found it answered plainly anywhere I have looked. Comparing SURPASS-2 ( N Engl J Med , 2021) with…
MLSCNHHRS+105 118 18k 11mo
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove
Second pass at: Journal club: STEP 4 and what a withdrawal design can prove Writing it up because I had to work it out twice and would rather nobody else did. Session topic: SURMOUNT-OSA ( N Engl J Med ,…
AWFLAWCFZL+81 90 54k 9mo
Measurement error in home scales, with a worked standard deviation
Measurement error in home scales, with a worked standard deviation Writing it up because I had to work it out twice and would rather nobody else did. Comparing SURPASS-4 ( Lancet , 2021) with STEP 1 ( N Engl…
TKSTVMDEB+26 31 4.3k 4mo
Journal club: STEP 8 and the fairness of the comparator dose — a second dataset
Posting this under the heading it deserves: Journal club: STEP 8 and the fairness of the comparator dose — a second dataset Everything below is what sits behind that. Session topic: SURPASS-2 ( N Engl J Med ,…
OLIADSRFDO+18 22 656 13h