hamsa software
← All articles
AI tooling7 min read

A real source can still leave a claim unsupported

A primary source can establish a release date, report a case and make a vendor judgement. Those are different kinds of evidence, and the sentence beside the link needs to say which one it uses.

A circular geometric lens overlaps a slanted plane with four lines, suggesting close scrutiny of what a source actually supports.

A reference can make a sentence look more settled than it is

The link works. The page is the original announcement. The sentence beside it can still ask that source to prove something it never said. A reported coding task becomes a claim about every workflow, then somehow becomes permission to remove review. I would follow those changes in meaning before looking for another reference, because a more impressive bibliography cannot repair the leap already sitting in the sentence.

A technology announcement often puts dates, interface details, benchmark results, customer accounts and enthusiastic judgements on the same page. They need different wording when carried into an article. Released identifies an event; reported keeps an account attached to its source; described as attributes a judgement. Those verbs help a reader understand what they can rely on without making them conduct the entire source audit themselves.

Take Anthropic’s 22 May 2025 Claude 4 announcement. It introduces Opus 4 and Sonnet 4, describes Opus with the phrase “world’s best coding model”, and reports a Rakuten open-source refactor lasting seven hours. [1] Those statements provide a useful small source audit. They do not all have the same evidential status, and none automatically authorises an unrelated business to remove review from its own workflow.

Four claims hidden in one confident paragraph

Imagine an original draft paragraph saying: Claude 4 arrived on 22 May; it is the best coding model; it can run any business workflow unattended for seven hours; therefore a small team can dispense with human review. One link follows the paragraph. The first clause is an announcement fact supported by the dated primary source. The second is the vendor’s assessment and should be attributed. The third generalises beyond the reported case. The fourth is a separate operational recommendation with no support supplied.

The seven hours describe the duration of one reported refactor in its particular task and environment. They do not tell another team whether its required behaviour survived. For a local trial, ask which interfaces the change had to preserve, what independent cases checked them and what the reviewer still had to correct. A long run could produce a useful compatible patch or leave a substantial repair; the elapsed duration alone cannot distinguish those outcomes. Keep the reported case, then make the recommendation depend on the result the local task actually needs. That lets the launch justify trying the tool without letting one impressive time interval decide that review is unnecessary.

The paragraph can keep the interesting parts. State the release date, attribute the vendor’s assessment and describe the particular refactor it reported. Then explain why you think that makes a bounded local trial worthwhile. The recommendation belongs to the writer, with reasons a reader can inspect; it need not borrow the announcement’s authority. Separating it this way also leaves room for someone to accept the reported facts and still disagree with the proposed next step.

The downloadable ledger makes the four decisions inspectable: claim, source location, evidence class and revision. It is an editorial artefact, not an automated truth detector. Its value is that another reader can disagree with the classification by pointing to the exact missing passage or the exact leap in meaning. “This has a source” is a much harder statement to debate usefully because it leaves the relationship unspecified. Splitting the original paragraph also helps: keep the dated fact and its reference together, then begin a new paragraph for the recommendation. Layout can clarify the reasoning as well as the words.

One source does not support four kinds of claim

An original editorial audit separates a dated announcement, the vendor’s assessment, a reported case and an unsupported business recommendation.

Scroll sideways to see all columns.

Draft claimWhat the source suppliesEditorial decision
Models introduced 22 May 2025Dated announcement and model namesKeep as announcement fact
Best coding modelAnthropic’s own judgementAttribute; do not universalise
Any workflow unattended 7 hoursOne reported Rakuten refactorNarrow to that reported case
Small teams can remove reviewNo such operational conclusionRemove; require separate evidence
Primary source: Anthropic’s 22 May 2025 release. The four draft claims and audit are authored for this article. A vendor announcement can establish what the vendor said without independently proving every performance judgement.

A primary source answers a particular question

A vendor announcement is primary evidence for what was announced and what the vendor reported. That does not make it an independent comparison of every possible use case. Conversely, calling it marketing does not make all its contents worthless. A date or documented interface detail may be exactly the evidence required. Source quality depends partly on the claim being made, rather than a single badge attached to a domain.

Ask who produced the observation, what they observed and how directly the document exposes it. If a release quotes another organisation’s experience, retain that reporting chain. Do not quietly change “the vendor reports that a customer found…” into “research proves…”. The latter asks the source to carry an independence and a generality it has not supplied. A careful chain lets the reader judge the report without either dismissing it or lending it borrowed certainty.

The same discipline applies to a technical standard. A requirement can establish what conforming implementations should do; it does not prove a particular product follows it. An API reference can explain a field; it does not prove a request succeeded in the account being discussed. These distinctions matter when an article moves from explaining technology to advising a person how to depend on it. The link should support the step actually being taken.

Carry the conditions with the number

Numbers often lose their qualifications first. A benchmark score can depend on the task set, tools, attempts, selection procedure and compute budget. If the article uses the number to compare configurations, those conditions may be part of the claim. Copying the highest percentage while omitting the procedure can make two unlike results appear directly comparable, even when every digit has been transcribed correctly.

The reader rarely needs the whole methodology repeated beside every number. They do need the condition that changes its meaning. Multiple attempts followed by selection are not one ordinary attempt, and a result on a different kind of task does not settle their own deployment decision. A brief qualification attached to that inference does useful work. “Results may vary” at the bottom leaves the reader to discover which part of the comparison was never equivalent.

Dates have conditions too. An updated documentation page can contain newer API examples beside its original publication date, even when the address remains unchanged. Check which statement belongs to the period being discussed. If the precise historical wording cannot be established, avoid claiming it was available then. A current technical reference may still be useful, but introduce it as current documentation rather than smuggling a later capability into an earlier week’s story.

A small claim ledger can keep the intended sentence beside the supporting passage during research. Where several documents are needed, record the role each plays. If the support establishes only a narrower claim, revise before polishing the prose. This makes it easier to preserve source conditions and separate the original observation from the article’s inference, especially when a memorable reported number invites broader interpretation.

A benchmark number carries its procedure

Source conditions determine which comparison a reported score can support.

Scroll sideways to see all columns.

Source detailWhat must stay with the claimUnsupported shortcut
Multiple attempts plus selectionThe higher-compute procedureDescribe it as one ordinary attempt
Specific task and tool scaffoldTask set, tools and relevant environmentGeneralise to every business workflow
Living documentation and event datesWhen the capability was actually documentedAttribute later wording to the earlier week
Writer recommends a local trialThe writer’s reasoning and limitsImply the announcement itself proved local suitability
This extends the claim ledger’s evidential distinction to methodology and historical scope; it introduces no new benchmark result.

Let the reader see where your judgement begins

An article without judgement would be a fairly inconvenient collection of links. Readers want interpretation: what matters, which distinction changes the decision, what a small team might try next. The goal is to make that contribution visible. “I would trial this on a reversible coding task with independent acceptance cases” is an opinion with an explained basis. It does not need to pretend the announcement itself instructed every business to do the same.

A revised paragraph could therefore report the dated launch and the seven-hour refactor with attribution, then place the local-trial recommendation in its own sentence. That arrangement makes disagreement easier to locate. A reader might accept Anthropic’s account but think their importer’s compatibility requirements make a long unattended run unsuitable. They would be challenging the recommendation, not disputing the release date or alleging that the reported refactor never happened. The prose should leave that distinction available.

Place the reference where its scope is clear, and give it a useful label. A reader should be able to find the source for a date or a reported result without guessing which of six links covers it. If the article contains an original calculation, example or decision framework, say so. That credit is also accountability: the source supports its facts, while the writer owns the reasoning built on them.

In the Claude 4 example, the reader should finish knowing which part is the dated launch, which is Anthropic’s assessment, which is its reported refactor and which is the recommendation to try something locally. That division does not remove judgement from the writing. It gives judgement an identifiable author and a visible basis, so readers can decide whether the proposed trial follows from the evidence without having to reconstruct the argument from the links.

Working on a workflow like this? Hamsa helps finance and operations teams connect their tools and handle the exceptions, starting with one workflow.

See the Payment Operations Pilot

References & further reading

Primary sources behind this article. Living documentation may change.

  1. Anthropic: Introducing Claude 4, announcement and reported examples Published 22 May 2025
Hamsa Jama

Practical engineering. A human perspective.

More about Hamsa Software and the person behind it. Editorial notes.

A few more things
worth a read.

Back to the reading room
AI tooling7 min read

The prompt did not change. The system did.

Version the resolved configuration around an AI response so comparisons, investigations and rollback refer to the system that actually ran.