Case & CodeA FIELD GUIDE TO AI
Start learning
← Home
News & research

News archive

Earlier developments in legal AI, document retrieval, and agent reliability. Read what changed, why it matters, and what the evidence does—and does not—show.

Dates are original announcement or paper-submission dates. These historical summaries were checked against their sources on 18 October 2026. Practical implications are editorial assessments.

Product releaseGoogle Research

Deep Review expands automated document review

Google announced worldwide access to Deep Review, moving beyond scientific manuscripts to broader document review. The initial release accepts PDF and plain text, with two complimentary reviews per week.

Practical implications and limitations

Why it matters: A possible second-pass check for inconsistencies in expert reports or draft arguments; its usefulness for litigation must be tested separately.

Limitations: Multi-file input was still forthcoming. Google says uploads are not used for model training, but are stored for one year. Scientific review results do not establish legal accuracy or suitability for confidential client records.

Read the original source
Research preprintDocument retrieval research

SCOUT combines visual search with document summaries

SCOUT filters document pages with a lightweight retriever, then reranks a smaller set using a stronger visual model. A second track searches page and document summaries. The authors report faster retrieval on four benchmarks.

Practical implications and limitations

Why it matters: For a precedent or evidence collection, the approach suggests a way to search tables, figures, and page layouts without comparing every page at full computational cost.

Limitations: Reported speed gains are benchmark results, not measured savings in a law firm. Indexing and summary preparation add work; litigation recall and confidentiality require separate assessment.

Read the original source
Research paperDocument retrieval research

VL-DocIR tests whether retrieval finds all the needed pages

The benchmark evaluates visual retrieval across single pages, multiple pages, and multiple documents. It uses 388,548 rendered pages and finds that evidence spread across documents remains substantially harder to retrieve.

Practical implications and limitations

Why it matters: A useful evaluation principle for litigation: test whether a system finds every page needed to support a proposition, rather than merely one plausible match.

Limitations: The source documents come from Wikipedia, research papers, biomedical literature, and SEC proxy statements. Results do not establish performance on scanned productions or Ontario litigation records.

Read the original source
Research preprintAgent evaluation research

An agent benchmark’s scoring defect inflated success

An audit identified a scoring defect that changed the test environment before results were assessed. Correcting the measurement reduced reported success from 94.3% to 65.5% in the studied benchmark.

Practical implications and limitations

Why it matters: When evaluating a drafting or retrieval assistant, verify the scoring process and known-answer examples as well as the assistant itself.

Limitations: The numerical result applies to the tested benchmark and configuration. The method could not validate a second benchmark because its logs could not reconstruct the necessary reference state.

Read the original source
General availabilityMicrosoft

Execution Containers put boundaries around agents

Microsoft made Execution Containers generally available, allowing developers and administrators to define which files, network destinations, and other resources an agent may access, with enforcement outside the agent’s control.

Practical implications and limitations

Why it matters: A building block for restricting a legal assistant to a permitted matter folder and limiting outbound connections. It requires integration and a tested access policy.

Limitations: Containment options differ by operating system; MicroVM support was experimental. Permissive mode records otherwise-denied access but allows it. Containment alone does not make cloud inference offline or establish confidentiality.

Read the original source
Research preprintLegal agent research

Legal agents adapt through memory and role checks

The researchers combine reusable experience from prior cases with checks on the actions of different roles. The method adapts agents during use without updating the underlying model’s parameters, and reports improvements on two legal benchmarks.

Practical implications and limitations

Why it matters: A design idea for a drafting workflow: preserve validated lessons from prior work and check each role’s output against explicit requirements.

Limitations: Benchmark improvements do not establish Canadian legal competence. Any practical memory system must keep matter-specific confidential material separate and avoid carrying one case’s facts into another.

Read the original source
Research preprintAgent security research

Prompt-injection safeguards can fail between agents

Can CaMeLs Talk? shows how untrusted material can become trusted input when passed between agents. The proposed multi-CaMeL protocol preserves the distinction between instructions and data across those handoffs.

Practical implications and limitations

Why it matters: An evidence-review agent should not turn instructions embedded in a produced document into commands for a drafting or file-management agent.

Limitations: The authors report zero successful attacks in their tested setting, with a utility cost. That result is not proof of immunity to other attacks or a guarantee for a deployed legal system.

Read the original source
Research preprintAgent evaluation research

Reliability scores can change with the reviewer

A study of 2,611 production interviews found that reviewer severity and changes to the deployed agent both affected reliability scores. The authors distinguish changes in measurement from changes in the system itself.

Practical implications and limitations

Why it matters: Use consistent review criteria when comparing legal drafting assistants, and reassess after model or workflow changes.

Limitations: This is a study of one voice-and-video interviewing agent, not legal drafting. It does not establish that evaluation caused the observed improvements or set a universal retesting interval.

Read the original source
Research preprintLegal investigation research

InvestigationWorlds tests competing factual explanations

The environment combines real U.S. federal summary-judgment records with attorney-validated synthetic documents. Across 100 cases, agents often selected an incorrect explanation even after retrieving relevant evidence.

Practical implications and limitations

Why it matters: Finding a relevant document is only the first step. A litigation assistant also needs to test competing explanations and distinguish what the evidence supports from what merely sounds coherent.

Limitations: The benchmark uses U.S. proceedings and synthetic additions. It treats the court-adopted hypothesis as its target; that is a benchmark choice, not a universal account of factual truth.

Read the original source
Research preprintAgent security research

Prompt-injection detector rankings transfer poorly

Passing the Test You Trained On evaluates detectors on agent tool outputs. A detector leading one benchmark caught only 2% of injections in another at a 1% false-positive rate.

Practical implications and limitations

Why it matters: Test safeguards on the kinds of documents and tool responses the legal assistant will actually encounter, including benign records that should not be blocked.

Limitations: Results come from the tested datasets and replay setup. A published detector score alone does not establish protection for a particular firm’s workflow.

Read the original source

Lessons, terms, practical guides and sources ESC