Contact
Open source · AI evaluation

RAG Citation Coverage Auditor

Check whether a local export of answer claims cites approved, permitted, fresh sources with an explicit support relation. Review the source and the answer separately.

v0.1.0 package · Node.js 22+ · MIT

Browse source and run locally · Read the RAG evaluation guide

Run two public exports

Clone the repository, use Node.js 22 or newer, and run these commands from its root. Both exports are synthetic. The fixed audit date makes their freshness results reproducible.

Passing citation

node bin/rag-citation-coverage-auditor.mjs --input examples/passing.json --scope public --as-of 2026-09-20 --json

The passing export has one covered claim, one resolved and usable citation, and no findings.

Inspect examples/passing.json

Unresolved citation

node bin/rag-citation-coverage-auditor.mjs --input examples/failing.json --scope public --as-of 2026-09-20 --json

The intentionally failing export has no covered claim and two errors: claim-uncovered and citation-unresolved.

Inspect examples/failing.json

Public fixture comparison: passing export covers one claim; failing export covers zero and reports two errors
Results from the public synthetic fixtures with scope public and audit date 2026-09-20. The failing citation ID is absent from the declared-complete source export.

What the result means

This read-only CLI checks declared export evidence; it does not independently prove that a source or answer is true. It makes no network requests and does not retrieve source text. Unknown inventory, permission, freshness or support evidence returns incomplete rather than pass. Review the cited material and answer with a person before relying on them.

Read the full export contract and rule definitions

Follow the declared evidence path

A citation ID alone is not support. The exported source must be approved, permitted for the requested scope, fresh under the selected policy and explicitly linked to the claim.

Conceptual flow from an answer claim through a citation ID to a declared approved source
Conceptual flow. The auditor checks declared export evidence; it does not fetch a source or decide whether a claim is true.

Continue the evaluation

Put citation review into an AI workflow

Discuss an evidence review workflow with Edilec. Share only material you are permitted to disclose.

Discuss an AI evidence workflow