Authority map
Rank sources by question type and record how conflicts or expired material are handled.
Source precedence and conflict policyEnterprise AI · Knowledge systems
Knowledge systems are engineered around source authority, permissions, retrieval quality, citation support, and editorial ownership. The interface is only useful when users can judge what supports an answer and what is missing.
02 · Retrieval path
The retrieval path separates content extraction, metadata, indexing, query interpretation, candidate selection, and context assembly so each stage can be tested and corrected.
Preserve document identity, sections, dates, permissions, and source links during ingestion.
Ingestion manifest and rejected-content logTest search behavior against representative questions, terminology, and access contexts.
Question-to-evidence relevance setFit selected evidence into a bounded context with explicit citation identifiers.
Context traces and truncation cases03 · Evidence
Reviewers assess whether the right sources were retrieved, claims are supported, citations resolve, conflicting evidence is represented, and the system declines when the answer is not available.
Measure whether authoritative passages appear for representative questions and identities.
Versioned relevance judgmentsCheck material claims against cited passages rather than scoring style alone.
Claim-support review recordTest denied content, stale sources, conflicting sources, and unanswerable questions.
Refusal and conflict case results04 · Experience
Users need direct routes to source material, visible freshness, correction paths, and a clear distinction between sourced findings and generated synthesis.

References open the exact approved source location the user is permitted to view.
Users can flag an answer or source issue for the accountable content owner.
The interface distinguishes missing evidence, denied evidence, and system failure.
05 · Service ownership
Handover includes ingestion runbooks, source-owner responsibilities, access-change tests, quality review cadence, incident routes, and a controlled path for changing retrieval behavior.
Source additions, corrections, expiry, and deletion follow a documented process.
Permission changes are reflected predictably and tested against representative identities.
Question sets and reviewer findings guide a prioritised improvement backlog.
The next step is a bounded working session: one workflow, its evidence sources, the decision owner, and the conditions under which the system must stop or hand over.
Assess a knowledge workflow