A structured critique template this community uses — setting out what I have, and where I think it stops being reliable.
Structured critique template — I have the observation and I do not trust my interpretation of it, so I am posting the observation and holding the interpretation back.
Numbers, method and the conditions under which they were collected are below. Interpret them however they warrant.
Where a critique rests on a subgroup, check whether the interaction was tested. A difference between subgroups that is not statistically supported is not a difference.
The step people skip is the one I have spelled out.
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
A claim built entirely on a subgroup analysis — what changed since
On the subject in the title: A claim built entirely on a subgroup analysis — what changed since Working notes rather than a conclusion. What changes if the standard account of claim built is wrong? I ask…
|
2 | 2k | 18mo | |
|
Critiquing an observational claim about a class effect
Posting this under the heading it deserves: Critiquing an observational claim about a class effect Everything below is what sits behind that. I was wrong about critiquing an observational claim in a thread…
|
2 | 6.9k | 14mo | |
|
About the Study critique category
Structured criticism of a specific published study. Criticise the method, not the author. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded with its…
|
4 | 114 | 16mo | |
|
Criticising the method without criticising the authors
Criticising the method without criticising the authors Writing it up because I had to work it out twice and would rather nobody else did. I was wrong about criticising the method without criticising in a…
|
+55 | 61 | 60k | 15mo |
|
Measurement error in a self-reported exposure
Posting this under the heading it deserves: Measurement error in a self-reported exposure Everything below is what sits behind that. The question about measurement error that I actually want answered is the…
|
+117 | 129 | 45k | 5mo |
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
[2026 update] What we do not know about retatrutide, listed explicitly
What we do not know about retatrutide, listed explicitly — that is the question, and I have not found it answered plainly anywhere I have looked. Putting the numbers in the first post, because a question…
|
+79 | 83 | 952 | 11mo |
|
Sample size in a voluntary survey: the selection problem
Posting this under the heading it deserves: Sample size in a voluntary survey: the selection problem Everything below is what sits behind that. Sample size: setting out the arithmetic in full, because I have…
|
+1 | 5 | 12k | 15mo |
|
Absence of evidence and evidence of absence
Absence of evidence and evidence of absence Writing it up because I had to work it out twice and would rather nobody else did. Asking about absence of evidence on behalf of the question I keep seeing asked…
|
+16 | 20 | 3.9k | 5mo |
|
Second pass at: Designing a personal experiment that could change your mind
Second pass at: Designing a personal experiment that could change your mind Writing it up because I had to work it out twice and would rather nobody else did. The question about Designing a personal…
|
+39 | 44 | 632 | 14mo |
|
What pooling buys you and what it destroys
The question in the title: What pooling buys you and what it destroys I will give what I have already checked below so nobody repeats it. The question about pooling buys that I actually want answered is the…
|
+74 | 83 | 6.6k | 8mo |