The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Evidence · Study critique

Critiquing an observational claim about a class effect

VR
v.rautioTL2 Moderator21 Oct 2024#1

Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that.

Session topic: SCALE (N Engl J Med, 2015). Please read it before posting; the discussion is much better when everyone has.

The question I would like us to start with is what the trial set out to estimate, rather than what it found. Once that is on the table we can talk about whether the design could have answered it, and only then about the numbers.

Specific things I would like covered: the population and how far it generalises, how discontinuation was handled, whether the comparator was a fair one, and what the absolute rather than relative effect looks like.

I will summarise at the end and the summary will feed the relevant digest page.

5 likes 21mo
RI
retention_indexTL2Analytical chemist20 Feb 2025#2

Two things before anyone answers the substance.

First, the context in the first post is clear and specific. Second, the question is framed so that an answer can actually address it. Both are the norm here and both matter more than they sound.

9 likes 17mo
JV
j.vogelTL2 Moderator18 May 2025 · edited#3

This follows post #2 rather than contradicting it.

Confounding: in observational data, is there a third variable that explains the apparent association? In randomised data, randomisation should balance unknown confounders, though known confounders can be adjusted for.

28 likes 14mo

Suggested topics

TopicParticipantsRepliesViewsActivity
Immortal time bias in a claims-database study
Immortal time bias in a claims-database study — setting out what I have, and where I think it stops being reliable. I have seen FLOW ( N Engl J Med , 2024) cited in support of a claim I do not think it…
MACDSOIDNN+29 34 28k 11mo
Confounding by indication, explained with a concrete example
On the subject in the title: Confounding by indication, explained with a concrete example Working notes rather than a conclusion. Comparing SURMOUNT-1 ( N Engl J Med , 2022) with SURPASS-2 ( N Engl J Med ,…
TVARBDSBCD+21 25 21k 11mo
A claim built entirely on a subgroup analysis
A claim built entirely on a subgroup analysis Writing it up because I had to work it out twice and would rather nobody else did. I have seen SUSTAIN 6 ( N Engl J Med , 2016) cited in support of a claim I do…
ASKHMIASNP+71 80 1.1k 14mo
A critique that turned out to be unfair, retracted by its author
Posting this under the heading it deserves: A critique that turned out to be unfair, retracted by its author Everything below is what sits behind that. Session topic: SURMOUNT-4 ( JAMA , 2024). Please read it…
MSASFIONS+34 38 20k 17h
About the Study critique category
Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
BNJNDEHF 4 114 16mo

Related topics — sharing the tags disputed, risk of bias, effect size

TopicParticipantsRepliesViewsActivity
Reporting a disappointing outcome, and why it belongs here
Reporting a disappointing outcome, and why it belongs here Writing it up because I had to work it out twice and would rather nobody else did. Longitudinal report with the method stated, because a number…
SSMOPPSDEV+21 29 62k 10mo
Secretagogues and glucose tolerance: the mechanistic concern — what changed since
Secretagogues and glucose tolerance: the mechanistic concern — what changed since Writing it up because I had to work it out twice and would rather nobody else did. I have seen STEP 1 ( N Engl J Med , 2021)…
TLDKAIEF+2 6 31k 2mo
Second pass at: What "verified" means on our vendor pages, stated narrowly
Second pass at: What "verified" means on our vendor pages, stated narrowly — setting out what I have, and where I think it stops being reliable. A logistics question, since the answers here are usually better…
JHNVMVSSM+94 102 20k 3mo
Journal club: STEP-HFpEF and symptom endpoints
Journal club: STEP-HFpEF and symptom endpoints — setting out what I have, and where I think it stops being reliable. Comparing SURMOUNT-2 ( Lancet , 2023) with SURMOUNT-1 ( N Engl J Med , 2022) and finding…
MREPAKTWJD+18 22 2.5k 11mo
Tirzepatide storage and stability: what is published versus what is assumed
On the subject in the title: Tirzepatide storage and stability: what is published versus what is assumed Working notes rather than a conclusion. Session topic: SURMOUNT-1 ( N Engl J Med , 2022). Please read…
APPOELIGR+17 21 17k 12d