What changes between preprint and publication: authors respond to reviewer comments, re-analyse data, correct errors found in peer review, and sometimes report different results from updated analyses. The published version is not the same as the preprint.
How this community labels and discusses unrefereed work posts 91–120
This is a continuation of a long topic, addressed by post number rather than by page. Start at post 1.
This follows post #89 rather than contradicting it.
Always label it as a preprint in any discussion. A preprint is not a published trial and it is not settled knowledge. Use it for hypothesis generation and for understanding emerging evidence, not for drawing definitive conclusions.
Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.
Unrefereed work is not worthless. A great deal of it survives review substantially unchanged. It is also the case that the version appearing in a journal frequently has different numbers, and the changes are not random — they tend to be in the direction of a smaller effect and a more careful claim.
Coming back to post #93, because the follow-up matters more than the original answer.
Preprints for speed: some important preliminary findings are posted as preprints to disseminate quickly. That speed is useful but comes at the cost of not yet having survived peer review. The trade-off is real.
Picking up post #93: that is the part I would want checked first.
Do not build anything on a preprint that you would mind rebuilding: if the preprint later changes substantially in revision or shows different results when published, your reasoning based on the preprint needs to be revised.
Server repositories: medRxiv for medicine, bioRxiv for biology. Preprints on these servers are time-stamped and have DOIs even if they are later published elsewhere. Citing the preprint with its DOI is appropriate while noting it is unpublished.
I disagree with the reply above, and I think the disagreement is substantive rather than terminological.
The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.
Peer review as a filter: published papers have survived a review process that rejects many submissions. Preprints have not. Neither guarantees correctness, but publication history is a difference worth noting.
I disagree with the reply above, and I think the disagreement is substantive rather than terminological.
The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.
Server repositories: medRxiv for medicine, bioRxiv for biology. Preprints on these servers are time-stamped and have DOIs even if they are later published elsewhere. Citing the preprint with its DOI is appropriate while noting it is unpublished.
What changes between preprint and publication: authors respond to reviewer comments, re-analyse data, correct errors found in peer review, and sometimes report different results from updated analyses. The published version is not the same as the preprint.
I read post #101 twice before replying, because I had assumed the opposite.
Practical note that does not fit anywhere else. Whatever you conclude from this topic, write down what you did and when. The single most useful thing in your own records is not any individual result; it is that they are dated and consecutive.
This follows post #101 rather than contradicting it.
Always label it as a preprint in any discussion. A preprint is not a published trial and it is not settled knowledge. Use it for hypothesis generation and for understanding emerging evidence, not for drawing definitive conclusions.
Collapsed as off-topic by two members at trust level 3 or above
On post #101 — agreed on the reasoning, with one qualification.
How to cite a preprint: author last name, first initial, et al. Title. Server name [preprint]. Posted date. Doi. Include the server name and note that it is a preprint.
Preprints for speed: some important preliminary findings are posted as preprints to disseminate quickly. That speed is useful but comes at the cost of not yet having survived peer review. The trade-off is real.
Picking up post #105: that is the part I would want checked first.
Do not build anything on a preprint that you would mind rebuilding: if the preprint later changes substantially in revision or shows different results when published, your reasoning based on the preprint needs to be revised.
Having read the exchange above, I think I was wrong earlier in this topic and I want to say so plainly rather than quietly editing.
The correction was fair and I had been repeating something I had not checked carefully enough.
post #109 is right about the mechanism and I think understates the practical bit.
Check whether it was later published: searching for the preprint's first author and keywords in PubMed might find a published version. The published version is the stronger citation if it exists.
Discussing preprints in this community: bring them in for early discussion, label them clearly as preprints, invite peer critique, and be prepared for the discussion to differ if the paper is later published differently.
I read post #110 twice before replying, because I had assumed the opposite.
Unrefereed work is not worthless. A great deal of it survives review substantially unchanged. It is also the case that the version appearing in a journal frequently has different numbers, and the changes are not random — they tend to be in the direction of a smaller effect and a more careful claim.
I disagree with the reply above, and I think the disagreement is substantive rather than terminological.
The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.
Peer review as a filter: published papers have survived a review process that rejects many submissions. Preprints have not. Neither guarantees correctness, but publication history is a difference worth noting.
How to cite a preprint: author last name, first initial, et al. Title. Server name [preprint]. Posted date. Doi. Include the server name and note that it is a preprint.
post #116 answers the question as asked. The question underneath it is different.
Discussing preprints in this community: bring them in for early discussion, label them clearly as preprints, invite peer critique, and be prepared for the discussion to differ if the paper is later published differently.
Unrefereed work is not worthless. A great deal of it survives review substantially unchanged. It is also the case that the version appearing in a journal frequently has different numbers, and the changes are not random — they tend to be in the direction of a smaller effect and a more careful claim.
I disagree with the reply above, and I think the disagreement is substantive rather than terminological.
The distinction being drawn does not survive when you look at the published data for this specific question. I would be glad to be shown wrong on this, because the version I am arguing against is more convenient.
Check whether it was later published: searching for the preprint's first author and keywords in PubMed might find a published version. The published version is the stronger citation if it exists.
This topic was referenced in
- How this community labels and discusses unrefereed work — the long versionEvidence › Preprints · 23 replies
Suggested topics
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
When a preprint is the best available evidence and we say so
When a preprint is the best available evidence and we say so — that is the question, and I have not found it answered plainly anywhere I have looked. I have seen SURPASS-2 ( N Engl J Med , 2021) cited in…
|
+148 | 160 | 31k | 11mo |
|
Citing a preprint in a maintained document: our rule and its reasoning
On the subject in the title: Citing a preprint in a maintained document: our rule and its reasoning Working notes rather than a conclusion. I have seen SELECT ( N Engl J Med , 2023) cited in support of a…
|
2 | 467 | 4mo | |
|
The "under review" status pill and when a moderator applies it — a second dataset
The "under review" status pill and when a moderator applies it — a second dataset Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURPASS-4 ( Lancet , 2021)…
|
+50 | 54 | 1.4k | 11mo |
|
Revisiting: How this community labels and discusses unrefereed work
Revisiting: How this community labels and discusses unrefereed work Writing it up because I had to work it out twice and would rather nobody else did. I have seen SURMOUNT-OSA ( N Engl J Med , 2024) cited in…
|
+31 | 35 | 7k | 1d |
|
Tracking a preprint to publication: a worked example — the long version
Posting this under the heading it deserves: Tracking a preprint to publication: a worked example — the long version Everything below is what sits behind that. Comparing STEP 8 ( JAMA , 2022) with STEP 2 (…
|
+38 | 47 | 560 | 22mo |
Related topics — sharing the tags risk of bias, effect size, preprint
| Topic | Participants | Replies | Views | Activity |
|---|---|---|---|---|
|
About the Preprints category
Unrefereed work, clearly labelled as such, with the usual caveats stated once and taken seriously. This post is a community wiki: any member at trust level 3 or above can edit it, and every edit is recorded…
|
+3 | 7 | 14k | 3mo |
|
Coming back to: Why most self-reports here are not experiments, and that is fine
The question in the title: Why most self-reports here are not experiments, and that is fine I will give what I have already checked below so nobody repeats it. Comparing LEADER ( N Engl J Med , 2016) with…
|
+56 | 62 | 11k | 4mo |
|
Second pass at: Multiplicity when you track fifteen variables
Posting this under the heading it deserves: Second pass at: Multiplicity when you track fifteen variables Everything below is what sits behind that. I have seen SCALE ( N Engl J Med , 2015) cited in support…
|
2 | 12k | 18mo | |
|
[2026 update] Journal club: is percentage weight change the right endpoint?
Journal club: is percentage weight change the right endpoint? — that is the question, and I have not found it answered plainly anywhere I have looked. Comparing SURPASS-2 ( N Engl J Med , 2021) with…
|
+105 | 118 | 18k | 11mo |
|
Sulfonylureas: the interaction most worth taking seriously
Sulfonylureas: the interaction most worth taking seriously Writing it up because I had to work it out twice and would rather nobody else did. Practical question with the units stated, because I have seen how…
|
+4 | 8 | 38k | 6h |