OpenGov summary: Difference between revisions

Line 103: Line 103:
* It starts by reading the retrieved official content (e.g., text from a Federal Register notice, an agency program page, or USAspending data).
* It starts by reading the retrieved official content (e.g., text from a Federal Register notice, an agency program page, or USAspending data).
* Using retrieval-augmented generation (RAG) techniques, it synthesizes that information into a draft:
* Using retrieval-augmented generation (RAG) techniques, it synthesizes that information into a draft:
Fills in the structured Cargo template fields (e.g., program name, sponsoring agency, authorizing legislation, funding amount).
** Fills in the structured Cargo template fields (e.g., program name, sponsoring agency, authorizing legislation, funding amount). Writes a concise narrative summary for the MediaWiki page. Proposes relationships (e.g., "This program links to Statute X and Agency Y").
Writes a concise narrative summary for the MediaWiki page.
** Its job is to be creative and comprehensive—turning raw source material into coherent, usable wiki content and graph data—while staying grounded in what was retrieved.
Proposes relationships (e.g., "This program links to Statute X and Agency Y").
* Its job is to be creative and comprehensive—turning raw source material into coherent, usable wiki content and graph data—while staying grounded in what was retrieved.
 
==== Verifier AI ====
==== Verifier AI ====


Line 113: Line 110:
* It runs independently after the generator finishes its draft.
* It runs independently after the generator finishes its draft.
* It goes through every part of the draft step-by-step:
* It goes through every part of the draft step-by-step:
Compares each claim, field value, and relationship directly against the original source documents.
** Compares each claim, field value, and relationship directly against the original source documents.
Scores for factual accuracy (e.g., does the funding number match exactly?).
** Scores for factual accuracy (e.g., does the funding number match exactly?).
Checks citation completeness (is every key fact traceable?).
** Checks citation completeness (is every key fact traceable?).
Evaluates logical consistency and neutrality (no unsupported assumptions or biased phrasing).
** Evaluates logical consistency and neutrality (no unsupported assumptions or biased phrasing).
 
* It gives an overall confidence score and flags any mismatches, gaps, or potential issues.
* It gives an overall confidence score and flags any mismatches, gaps, or potential issues.
* If both AIs agree at a high threshold (≥95% confidence), the draft auto-publishes as a new page revision.
* If both AIs agree at a high threshold (≥95% confidence), the draft auto-publishes as a new page revision.