Back to Blog

Agent workflows

A DOI Match Is Not a Citation Check: A Research Agent Workflow

Separate bibliographic identity, publication updates and claim support so a research agent does not mistake a resolved DOI for trustworthy evidence.

OpenAgentSkillPublished:

The reference resolves, but the argument may still be wrong

A research agent repairs a bibliography and reports that every DOI resolves. That is useful progress, but it does not establish that each identifier belongs to the intended paper, that the publication has no relevant updates, or that the paper supports the sentence citing it.

Treat those as three separate jobs. For a literature review, our recommendation is to maintain an identity record, an update-status record and a claim-support record. A citation should not inherit an overall verified label merely because one of those jobs succeeded.

Methodology and intended use

This is a documentation-based workflow checked on September 11, 2026. We read Crossref's REST API, usage guidance and Retraction Watch documentation. We did not audit a manuscript, investigate any named researcher, or validate the scientific findings of a publication.

The workflow is intended for researchers and developers building literature-review skills. It proposes decision rules around retrieved evidence rather than a universal confidence score. Crossref is a useful metadata source, but the workflow must accommodate records outside its coverage and sources that cannot be accessed.

Resolve identity before correcting the bibliography

The Crossref REST API documentation describes metadata deposited by members and trusted sources, including bibliographic information and post-publication updates. It exposes an endpoint for a Crossref DOI and an endpoint identifying a DOI's registration agency.

Start with the identifier already present in the reference, when available. Compare the returned title, authors, venue and relevant publication dates with the intended work. Do not silently replace a citation with the first search result that looks similar. A related conference version and journal version may need separate treatment.

Our proposed identity outcomes are matched, ambiguous and unresolved. For ambiguous records, retain the original bibliography entry and list the conflicting fields. For unresolved records, distinguish a request failure from a successfully completed search with no satisfactory match. A service outage is not evidence that a paper does not exist.

Make metadata retrieval economical and reviewable

The Crossref usage guidance recommends caching results and avoiding repeated identical requests. It also distinguishes query and filtering approaches for retrieving records.

For a manuscript workflow, we recommend collecting unique identifiers before retrieval. Reuse the same metadata response for repeated citations within that run, while retaining a retrieval timestamp and the source used. That saves redundant requests without asking a model to regenerate factual metadata from memory.

Choose a refresh policy explicitly. A cached response can be sufficient for drafting, while final submission may justify refreshing update information. When refresh fails, report the age of the last successful check. Do not relabel an old response as a current check, and do not imply this workflow requires a paid language-model call for every citation.

Check updates without declaring a paper safe

The Retraction Watch documentation explains that research may be corrected or retracted after publication. Its coverage of corrections and expressions of concern is less comprehensive than its coverage of retractions.

That difference matters. The absence of a returned update should be recorded as no relevant update found in the checked sources at a particular time, not proof that the paper is reliable. If an update is present, retrieve and read the notice where accessible. Preserve its relationship to the work rather than guessing the implications from a short metadata field.

Our recommended update record includes the source, retrieval time, linked notice, update type as reported and any unresolved relationship. A correction may affect one result rather than the whole work. An agent should describe what the notice actually says and leave scientific interpretation to a qualified reviewer when the effect is unclear.

Tie each claim to an accessible passage

Identity and update checks still do not show whether a citation supports an argument. For each substantive claim, record the exact sentence in the draft, the cited work, the accessible supporting passage and its location.

Consider an illustrative sentence claiming that a method performs better across all deployment settings. If the agent can access only an abstract describing one experiment, it should not approve the broader sentence. The appropriate outcome is narrower support, insufficient access or a request for the relevant full-text section. This example is hypothetical, not a finding about a real paper.

Keep access level visible: metadata only, abstract, full text or supplementary material. Do not invent page numbers or imply that an inaccessible table was examined. Where publisher access is restricted, request an authorized copy or retain the uncertainty; bibliographic verification does not grant access rights.

A review packet instead of a single score

Before handoff, group citations by the action a researcher must take. Ambiguous identity requires choosing the intended work. A relevant notice requires reading its effect on the cited claim. Missing passage evidence requires narrowing the claim or supplying a source.

For an acceptance exercise, use a non-sensitive draft with one deliberately incomplete reference, one similarly titled alternative and one claim broader than its supplied excerpt. Write the expected unresolved outcomes before running the agent. These are proposed fixtures, not tests performed for this article.

A good packet makes disagreement inspectable. It should preserve the original wording and proposed change separately, so the researcher can reject an automated correction without reconstructing the previous reference.

Limitations and where this fits

Metadata can be incomplete, update coverage can lag and accessible text can omit essential context. No combination of these checks establishes scientific truth or replaces domain expertise. Avoid turning a workflow status into a safety certification.

Our PDF parser comparison addresses extracting document content. This workflow begins after extraction and asks what the extracted evidence actually supports. Explore the OpenAgentSkill directory for research candidates, but evaluate their handling of uncertainty as carefully as their citation formatting.