The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Research Methods · N-of-1 designs · continued

Pre-registering a personal experiment, seriously posts 31–60

This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.

CN
c.niemelTL3Regular28 May 2025#31
DKwiatkowski, post #6: Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune. Go to post

I disagree with the reply above, and I think the disagreement is substantive rather than terminological.

The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.

9 likes in reply to #6 14mo
SF
s.ferreiraTL2 Moderator28 May 2025#32

On post #28 — agreed on the reasoning, with one qualification.

Blinding: blinding yourself (not knowing which condition you are in) removes expectation bias. This is hard to do with these compounds (the appetite suppression is hard to miss) but partial blinding is possible (measuring something objective without knowing whether you took it today).

20 likes 14mo
OC
o.cousineauTL3Regular28 May 2025#33

Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune.

0 likes 14mo
AS
a.silvaTL2 Moderator28 May 2025 · edited#34

Sample size in n-of-1: you are the sample. Repeated measurements (weekly weighings, daily mood scores) increase the power to detect a real effect even though n=1.

2 likes 14mo
TT
taper_tableTL3Regular28 May 2025#35
a.villalobos, post #3: When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient. Go to post

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

13 likes in reply to #3 14mo
SV
s.vanheckeTL2 Moderator28 May 2025#36

Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result.

28 likes 14mo
EC
excursion_checkTL3Regular28 May 2025#37

This follows post #34 rather than contradicting it.

When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient.

0 likes 14mo
RM
r.mwangiTL2 Moderator29 May 2025#38

Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.

5 likes 14mo
VD
vial_deskTL3Regular29 May 2025 · edited#39
t.wojcik, post #15: I disagree with the reply above, and I think the disagreement is substantive rather than terminological. The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient. Go to post

post #38 answers the question as asked. The question underneath it is different.

Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.

2 likes in reply to #15 14mo
MA
m.adebayoTL2 Moderator29 May 2025#40
t.duarte, post #24: post #23 is right about the mechanism and I think understates the practical bit. For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use. Go to post

Designing a personal experiment that could actually change your mind: that is the standard for an n-of-1 design. An experiment designed so that any result confirms what you already believed has not changed anything.

9 likes in reply to #24 14mo
I
IRenaudinTL2Member29 May 2025#41
g.ibarra, post #12: Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive. Go to post

On post #37 — agreed on the reasoning, with one qualification.

When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient.

15 likes in reply to #12 14mo
SC
s.chowdhuryTL3Regular29 May 2025 · edited#42

post #41 answers the question as asked. The question underneath it is different.

Generalisability: a robust n-of-1 result applies to you. It does not tell you much about whether the effect generalises to others similar to you, much less to people different from you.

5 likes 14mo
AK
a.kwiatkowskiTL2Member29 May 2025#43

Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result.

0 likes 14mo
NK
n.kaufmannTL2 Moderator29 May 2025#44

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

0 likes 14mo
N
NardoneTL2Member29 May 2025#45
glossary_desk, post #8: Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference. Go to post

Sample size in n-of-1: you are the sample. Repeated measurements (weekly weighings, daily mood scores) increase the power to detect a real effect even though n=1.

10 likes in reply to #8 14mo
MA
m.amankwahTL2 Moderator29 May 2025#46
a.kwiatkowski, post #43: Confounding in personal experiments: other things change when you start a medication (season, exercise, diet, stress). Documenting those confounders helps you understand their contribution to the result. Go to post

post #45 is right about the mechanism and I think understates the practical bit.

Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune.

3 likes in reply to #43 14mo
I
IMainwaringTL3Regular29 May 2025#47

I read post #45 twice before replying, because I had assumed the opposite.

Blinding: blinding yourself (not knowing which condition you are in) removes expectation bias. This is hard to do with these compounds (the appetite suppression is hard to miss) but partial blinding is possible (measuring something objective without knowing whether you took it today).

0 likes 14mo
LV
l.vermeulenTL2 Moderator29 May 2025#48

I disagree with the reply above, and I think the disagreement is substantive rather than terminological.

The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.

29 likes 14mo
DT
dexa_twice_yearlyTL3Regular30 May 2025 · edited#49

Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.

6 likes 14mo
RN
r.nakamuraTL2 Moderator30 May 2025#50

For anyone arriving from a search: the marked solution above is the direct answer, and the replies underneath it add the caveats that make it safe to use.

1 like 14mo
DV
dr.villanuevaTL3Physician30 May 2025#51
r.aldana_pharmd, post #29: Designing a personal experiment that could actually change your mind: that is the standard for an n-of-1 design. An experiment designed so that any result confirms what you already believed has not changed anything. Go to post

Picking up post #48: that is the part I would want checked first.

Thank you for the correction. I have edited my earlier post with a note rather than silently, so the thread still makes sense to read. The error was mine and it was the kind that comes from remembering a figure instead of looking it up.

22 likes in reply to #29 14mo
SG
s.grimaldiTL2 Moderator30 May 2025#52

Coming back to post #50, because the follow-up matters more than the original answer.

Designing a personal experiment that could actually change your mind: that is the standard for an n-of-1 design. An experiment designed so that any result confirms what you already believed has not changed anything.

0 likes 14mo
MH
ms_hollowayTL4Mass spectrometrist30 May 2025#53

Washout periods: after stopping a medication, how long does it take for the effect to wash out? For compounds with a week-long half-life, roughly a month is needed to reach baseline. Using that washout period in a before-after design strengthens the inference.

1 like 14mo
JE
j.erdoganTL2 Moderator30 May 2025 · edited#54
hana.sato, post #19: This follows post #16 rather than contradicting it. Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid. Go to post

Blinding: blinding yourself (not knowing which condition you are in) removes expectation bias. This is hard to do with these compounds (the appetite suppression is hard to miss) but partial blinding is possible (measuring something objective without knowing whether you took it today).

6 likes in reply to #19 14mo
OB
owen.bradyTL4 Moderator30 May 2025#55
excursion_check, post #37: This follows post #34 rather than contradicting it. When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient. Go to post

This follows post #52 rather than contradicting it.

Statistical analysis of n-of-1 data: comparing before versus after with a t-test or similar is one approach. Plotting the data visually is another. Both are valid.

16 likes in reply to #37 14mo
RS
r.serranoTL2 Moderator30 May 2025#56

Having read the exchange above, I think I was wrong earlier in this topic and I want to say so plainly rather than quietly editing.

The correction was fair and I had been repeating something I had not checked carefully enough.

31 likes 14mo
AR
a.reyesTL4 Admin30 May 2025#57
Staff post. Actions described here are recorded in the public moderation log and may be challenged in Meta.

Generalisability: a robust n-of-1 result applies to you. It does not tell you much about whether the effect generalises to others similar to you, much less to people different from you.

0 likes 14mo
KD
k.dahlbergTL2 Moderator30 May 2025#58

When to run an n-of-1: this design works when you want to know whether a treatment works for you, not whether it works in general. For that purpose, it is efficient.

3 likes 14mo
RH
revision_historyTL3Wiki editor30 May 2025#59
m.amankwah, post #46: post #45 is right about the mechanism and I think understates the practical bit. Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune. Go to post

Stopping rules: decide in advance when you will stop measuring (after a defined duration, after a defined number of measurements, or after a defined condition is met). Not deciding in advance means stopping when the result satisfies you, which is bias.

11 likes in reply to #46 14mo
JI
j.ivaturiTL2 Moderator31 May 2025#60
p.amankwah, post #1: Pre-registering a personal experiment, seriously — setting out what I have, and where I think it stops being reliable. Comparing STEP 4 ( JAMA , 2021) with SUSTAIN 6 ( N Engl J Med , 2016) and finding the comparison harder than it looks. Different populations, different durations, different endpoints defined slightly differently, and in… Go to post

Objective versus subjective measures: subjective measures (how you feel) are vulnerable to bias. Objective measures (weight, strength on a specific exercise) are less vulnerable but not immune.

23 likes in reply to #1 14mo