How citations are checked, and what the badges mean
What "checked", "partly supports", "not verified" and "found" mean, and the citator signals beside judgments.
The agents never type a citation themselves. They are given the passages the library search returned, each with a short handle (P1, P2 and so on), and they cite by handle. The app turns a handle into the citation from the stored paragraph. So a citation either points at a real passage in the library or it does not appear at all.
The checks, in order
- The handle must be one of the passages that search returned for this question. If not, the citation is removed and the card says so.
- Any quoted words must appear in the stored passage, character for character, after spaces and quote marks are evened out. Words left out with an ellipsis must still appear in order.
- In live mode, a second model reads the passage and the sentence that cites it and decides whether the passage supports it, partly supports it, or does not.
- If the judgment has been treated negatively by later judgments in the library, the citation is flagged.
The badges next to a citation
- checked
- The passage was found, any quote matched, and the support check found that the passage supports the sentence.
- partly supports
- The passage is relevant but the sentence goes further than the passage does. Read it before you rely on it.
- not verified
- The quote did not match the stored text, or the passage does not support the sentence. Do not rely on it without reading the judgment.
- found
- The passage exists and any quote matched, but no support check was made (for example in demo mode).
Citator signals on judgments
- good law so far
- Later judgments in our library cite it without negative treatment.
- distinguished or doubted
- At least one later judgment in the library distinguished or doubted it.
- treated negatively
- A later judgment in the library treated it negatively, for example overruled it.
- not yet cited in library
- No later judgment in our library cites it yet. This says nothing about the wider law reports.
Signals come only from the judgments in our library, which is still small. They are a prompt to read the later cases, not a guarantee.
The Checker’s report on a draft
Each draft carries a report: how many citations it has, how many passed, which need a look, and how many blanks are left to fill. A draft is marked checked only when no citation needs a look.