The Peptide CommonsEst. May 2024
Independent. We sell nothing and are affiliated with no manufacturer or pharmacy. Every moderation action is logged in public
Sourcing · Independent verification

Publishing an inconvenient result: a case study

Wiki
DB
d.bramleyTL3Regular19 Mar 2025#1
Community wiki post. Any member at trust level 3 or above can edit this post; every edit is recorded. Last edited by q.zhao_qa on 20 Dec 2025.
  • 30 Mar 2025 — NLoughran: Corrected an arithmetic slip in the second example.
  • 18 May 2025 — bench_notes: Plain-language pass on the opening paragraph.
  • 16 Aug 2025 — DSakamoto: Restructured into sections so the outline is navigable.
  • 20 Dec 2025 — q.zhao_qa: Added the limitations paragraph that review asked for.
Editors: NLoughran, bench_notes, DSakamoto, q.zhao_qa

On the subject in the title: Publishing an inconvenient result: a case study Working notes rather than a conclusion.

Publishing an inconvenient result, and specifically the version of it that the documentation does not cover. The maintained page handles the general case well and stops exactly where my question starts.

Setting out the gap in case it is a gap in the page rather than a gap in what is known.

16 likes 16mo
DT
dexa_twice_yearlyTL3Regular25 Mar 2025#2

I read the opening post twice before replying, because I had assumed the opposite.

Checked the publishing an inconvenient result claim against the primary source this morning. It survives, with a narrower scope than the version quoted here. Posting the narrower scope.

20 likes 16mo
RV
r.vukovicTL229 Mar 2025 · edited#3

It does not extend to lots nobody has seen, it is not a recommendation, and it says nothing about anything other than what was measured.

If it helps: the failure mode here is usually boring rather than dramatic.

0 likes 16mo
UC
unit_conversionTL3Regular2 Apr 2025#4

Verification records are dated because they expire in usefulness. A result from two years ago describes a lot from two years ago.

I looked this up rather than remembered it, which is the right order.

0 likes 16mo
AV
ai.vukovicTL25 Apr 2025#5

Since publishing an inconvenient result keeps coming up, it should probably be a maintained page rather than a recurring thread. I am happy to draft it if someone with more direct experience will review it.

13 likes 16mo
W
WendelboeTL2Member8 Apr 2025#6

Same experience here, different supplier, so it is at least not unique to one of them.

27 likes 16mo
RS
r.szaboTL211 Apr 2025#7
GP
g.pemberton_ukTL3Regional · UK14 Apr 2025#8

On publishing an inconvenient result I would separate what is worth knowing from what is worth acting on. The first list is long and the second is short, and conflating them is how threads get heated.

2 likes 15mo
ZO
z.okonkwoTL217 Apr 2025#9

That is a fair summary of where the discussion has got to.

19 likes 15mo
SS
system_suitabilityTL3Analytical chemist20 Apr 2025 · edited#10

Asking the supplier before publishing a discrepancy is the convention here. Most discrepancies are explained by handling or method and asking costs a day.

The interesting part of this is the exception, and I do not understand the exception.

0 likes 15mo
MB
m.balogunTL223 Apr 2025#11

Where two services agree with each other and with the declared figure, that is a genuinely strong result and it applies to that lot.

I have deliberately not rounded that, because the rounding is where the argument starts.

0 likes 15mo
UC
unit_conversionTL3Regular25 Apr 2025#12
r.szabo, post #7: Combining a chromatographic result with a documentation review gives a more complete picture than two chromatographic results, because the failure modes are different. The evidence for this is thinner than the way I have phrased it suggests. Go to post

Post #11 is right about the mechanism and I think understates the practical bit.

Publishing an inconvenient result was covered in the wiki last year and the page has a review date on it, which is a better starting point than my memory of a thread.

18 likes in reply to #7 15mo
FH
f.haddadTL228 Apr 2025 · edited#13

I read post #11 twice before replying, because I had assumed the opposite.

Filing a mild objection to the consensus on publishing an inconvenient result. Mild because I might be wrong; an objection because nobody has addressed the case that does not fit.

4 likes 15mo
PN
p.novotnyTL2Regular30 Apr 2025#14

Agreed on all of that, and I have nothing to add to it.

0 likes 15mo
AV
ai.vukovicTL23 May 2025#15

On post #11 — agreed on the reasoning, with one qualification.

Repeat determination on the same product line months apart is the measurement that speaks to consistency, and consistency is what most buyers actually want.

The rule of thumb is fine; the edge cases are where it earns its keep.

26 likes 15mo
ER
eire_readerTL25 May 2025#16
FY
f.yildizTL28 May 2025#17
Wendelboe, post #6: Same experience here, different supplier, so it is at least not unique to one of them. Go to post

Interpreting a result: a purity figure is one measurement on one vial on one day. Agreement across two services is much stronger. A single high number does not establish a pattern.

2 likes in reply to #6 15mo
W
WendelboeTL2Member10 May 2025#18

Repeat testing: if you want to verify the same lot a second time, testing with a different service strengthens the conclusion. Testing with the same service verifies reproducibility but uses the same method.

0 likes 15mo
MN
ma.nascimentoTL213 May 2025#19
m.balogun, post #11: Where two services agree with each other and with the declared figure, that is a genuinely strong result and it applies to that lot. I have deliberately not rounded that, because the rounding is where the argument starts. Go to post

Helpful, and easy to find again, which is half of what a good reply is.

0 likes in reply to #11 15mo
CP
citation_peakTL3Regular15 May 2025#20

Publishing an inconvenient result is a good example of a question where the honest answer is boring and the interesting answers are unsupported. I would go with boring.

33 likes 14mo
FD
f.demirTL2Regular17 May 2025#21
p.novotny, post #14: Agreed on all of that, and I have nothing to add to it. Go to post

Post #20 answers the question as asked. The question underneath it is different.

Blind sampling: submitting without the laboratory or seller knowing the source removes the two easiest ways for a result to be shaped: selective submission and selective reporting. The extra effort is worth it.

6 likes in reply to #14 14mo
AI
a.iyerTL219 May 2025#22

A note on how publishing an inconvenient result gets discussed rather than on publishing an inconvenient result itself: the confident posts get the replies and the careful ones get ignored, and the careful ones have been right more often.

16 likes 14mo
RM
r.mcalisterTL3Regular22 May 2025#23

Reading rather than contributing, but this is the most useful thread I have found on it.

31 likes 14mo
RN
r.nakamuraTL224 May 2025#24
g.pemberton_uk, post #8: On publishing an inconvenient result I would separate what is worth knowing from what is worth acting on. The first list is long and the second is short, and conflating them is how threads get heated. Go to post

Coming back to post #22, because the follow-up matters more than the original answer.

A record with four results over sixteen months is a thin record rather than a bad one, and the honest description says which.

0 likes in reply to #8 14mo
DT
dexa_twice_yearlyTL3Regular26 May 2025#25
p.novotny, post #14: Agreed on all of that, and I have nothing to add to it. Go to post

Post #24 is right about the mechanism and I think understates the practical bit.

The record shows what was measured. Everything beyond that is inference and this site tries to keep the line visible.

10 likes in reply to #14 14mo
RS
r.szaboTL228 May 2025#26

Worth separating two things that post #22 runs together.

Where the publishing an inconvenient result discussion usually stalls is that nobody wants to say "I do not know" and everyone is willing to say "it varies". Those are the same sentence with different clothes on.

22 likes 14mo
GP
g.pemberton_ukTL331 May 2025#27
NB
n.boatengTL22 Jun 2025#28

Repeat testing: if you want to verify the same lot a second time, testing with a different service strengthens the conclusion. Testing with the same service verifies reproducibility but uses the same method.

That has been true for the cases I have seen and I have not seen many.

1 like 14mo
TV
t.vasquezTL4 Moderator4 Jun 2025#29

Seconded. It reads as careful rather than confident, which is the right register.

15 likes 14mo
JA
j.asanteTL26 Jun 2025#30

On post #26 — agreed on the reasoning, with one qualification.

The most useful reply I ever got about publishing an inconvenient result was a request to state my units. It sounds like pedantry and it has saved me twice.

30 likes 14mo