High-Risk Multidisciplinary CareNCT07597499
ANCHOR Validation Trial in High-Risk Multidisciplinary Care
A study testing Gemini 3.1 Pro with Safety Prompt and ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro) in people with High-Risk Multidisciplinary Care and Clinical Decision Support, run by Waymark at 1 site in United States.
Trial summary
This pre-registered, pragmatic, three-arm (1:1:1) patient-level randomized controlled trial with mixed-effects analysis at the encounter level tests two questions in real high-risk multidisciplinary clinical encounters at the Waymark clinically integrated network across three U.S. Read more about this study
- Who is it for?
- Ages 18 years and older
- Conditions the study is for
- High-Risk Multidisciplinary Care, Clinical Decision Support, Artificial Intelligence-Assisted Care
- What is being tested?
- Gemini 3.1 Pro with Safety Prompt and ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro)
- Type of treatment
- Lifestyle or therapy programme
- Could I receive a placebo?
- No, everyone receives an active treatment
- How many people
- 240 participants
- Where
- 1 siteUnited States
- Study dates
- 15 May 2026to 6 Jul 2026
- Phase
- Interventional
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 years and older
- All sexes
- No healthy volunteers
- Adult, Older adult
Who may be able to join
- Age 18 years or older.
- Attributed to a participating Waymark provider (academic medical center, community-hospital network, federally qualified health center, or independent physician practice in Ohio, Washington, or Virginia; full TIN-consolidated list deposited at the Open Science Framework).
- Meets high-risk multidisciplinary criteria (combined claims-based and clinical: 2 or more emergency-department visits or 1 or more hospitalization in the prior 12 months, 5 or more active medications, 2 or more active specialist relationships, 2 or more chronic conditions, or claims-based equivalents).
- Encounter occurs in one of the three Waymark service modalities: high-risk primary care, specialty care coordination, or real-time telemedicine urgent care.
- English-language clinical documentation.
- Encounter requires clinical reasoning (not administrative-only).
Who cannot join
- Pediatric (age less than 18 years).
- Hospice or palliative-care-exclusive care plan.
- Active psychiatric crisis routed to crisis line.
- Encounter is administrative only.
- Pharmacy-only encounter that does not surface a clinical decision to the supervising physician.
- Encounter where the supervising physician is the principal investigator.
- Patient enrolled in a competing AI-safety study within the prior 90 days.
Trial locations and contacts
1 site in 1 country.
About this study
Official title: ANCHOR (Auditable Navigation of Clinical Hazards With Oversight and Reasoning) Multicenter Randomized Validation Study: A Pragmatic Three-Arm (1:1:1) Patient-Level Randomized Controlled Trial of a Structural Verification Layer for AI-Assisted High-Risk Multidisciplinary Care Across Three U.S. States
This pre-registered, pragmatic, three-arm (1:1:1) patient-level randomized controlled trial with mixed-effects analysis at the encounter level tests two questions in real high-risk multidisciplinary clinical encounters at the Waymark clinically integrated network across three U.S. states (Ohio, Washington, Virginia): (1) does adding ANCHOR - a clinical AI structural verification layer - to a Gemini 3.1 Pro-assisted supervising-physician workflow reduce the rate of clinically meaningful safety failures, compared with the same Gemini 3.1 Pro-assisted workflow without ANCHOR? (2) does the Gemini 3.1 Pro-assisted workflow itself reduce the same safety endpoint compared with unassisted standard care in which the supervising physician writes their own SOAP assessment/plan from a blank template?
ANCHOR is a single-call structural verification layer combining a Logical Neural Network (Riegel et al. 2020) certificate, six specialist agents, and concept-decomposed output with PMID citation provenance. ANCHOR is physician-facing only and is used by supervising physicians, not by the multidisciplinary clinical team they oversee.
Read more
The trial randomizes 240 patients 1:1:1 across the Waymark clinically integrated network over a 12-week active-enrolment window (80 per arm). Eligible patients are adults (age 18+) identified as high-risk by combined claims-based and clinical criteria. Eligible encounters span three integrated Waymark service modalities: high-risk primary care, specialty care coordination, and real-time telemedicine urgent care. The primary endpoint is a per-encounter binary composite: any of (a) failure to mention a do-not-miss diagnosis, (b) under-triage, (c) contraindicated medication recommendation, (d) failure to recommend escalation when clinically warranted; adjudicated by a blinded panel of 3 board-certified physicians with majority-of-three scoring. The primary contrast is Arm 3 (LLM+ANCHOR) versus Arm 2 (LLM with safety prompt), isolating ANCHOR's marginal contribution over a deployment-equivalent LLM safety stack. The pre-specified secondary contrast is Arm 2 versus Arm 1.
The trial is sized to the operational ceiling of the Waymark integrated-network workflow across the three states (240 enrollees over 12 weeks). At realistic effect sizes derived from the retrospective evaluation, the trial is underpowered for definitive efficacy declaration on either pairwise contrast and is reported as an initial deployment-feasibility validation cohort with effect estimates and 95 percent confidence intervals; full power calculations are pre-registered in the Statistical Analysis Plan.
Single-blind outcome adjudication: 3 adjudicators score only the supervising physician's final clinical decision, so all three arms produce adjudication packets in identical format and arm allocation is structurally invisible. Statisticians remain blinded until database lock. A full waiver of informed consent is requested per 45 CFR 46.116(f)(3) with a companion HIPAA waiver of authorization under 45 CFR 164.512(i)(2)(ii). The study is registered on the Open Science Framework prior to first enrollment and reported under CONSORT-AI 2020.
Read the detailed description
DESIGN. Pragmatic, multicenter, encounter-level, three-arm parallel randomized controlled trial. 1:1:1 patient-level stratified permuted-block randomization, block size 6, stratified by site and acuity stratum. Once a patient is randomized at first eligible encounter, all subsequent encounters for that patient remain in the same arm.
ARMS.
- Arm 1 (Unassisted standard care, n=80): No LLM. No ANCHOR. The supervising physician opens a blank SOAP note template and writes their own assessment and plan from scratch.
- Arm 2 (Gemini 3.1 Pro with safety prompt, n=80): Gemini 3.1 Pro generates the recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. The supervising physician reviews the LLM output directly. This stack is operationally equivalent to LLM-assisted clinical-decision-support deployments already in routine use at major U.S. health systems.
- Arm 3 (Gemini 3.1 Pro + ANCHOR, n=80): Gemini 3.1 Pro generates the recommendation under the same safety prompt as Arm 2; ANCHOR augments that output with the Logical Neural Network certificate, specialist-agent verification, and concept-decomposed audit trail.
OPERATIONAL SIZING. The Waymark integrated-network workflow across Ohio, Washington, and Virginia captures approximately 20 eligible high-risk multidisciplinary encounters per week. With 12 weeks of active enrolment, total enrolment is 240 encounters (80 per arm at 1:1:1).
POWER CALCULATION. Anchored on the architectural-argument retrospective cohort. For each pairwise contrast at n=80 per arm, the plausible effect range is 5 to 11 percentage points absolute reduction (midpoint 8 percentage points). At the midpoint planning effect (Arm 2 event rate 25 percent versus Arm 3 17 percent), power is approximately 0.50 for the verification-layer-specific contrast (Arm 3 versus Arm 2) at alpha = 0.05. The trial functions as a calibration cohort with effect estimates and 95 percent confidence intervals.
PRIMARY ENDPOINT. Per-encounter binary composite, adjudicated by 3 board-certified physicians blinded to allocation; final scoring by majority of three. Components: (a) Failure to mention a do-not-miss diagnosis; (b) Under-triage; (c) Recommendation of a medication contraindicated by documented allergies/conditions/comorbidities; (d) Failure to recommend escalation when clinically warranted.
PRIMARY CONTRAST: Arm 3 versus Arm 2 (ANCHOR-specific). PRE-SPECIFIED SECONDARY CONTRAST: Arm 2 versus Arm 1 (AI-introduction).
SECONDARY ENDPOINTS (hierarchical fixed sequence, Holm-Bonferroni step-down at family-wise alpha = 0.05): (1) Appropriate triage escalation rate; (2) Time-to-physician-decision; (3) Clinician acceptance rate of ANCHOR flags (Arm 3 only); (4) 30-day emergency-department visit rate (EXPLORATORY); (5) 30-day hospitalization rate (EXPLORATORY); (6) Social-determinants-of-health response composite.
STATISTICAL ANALYSIS. Mixed-effects logistic regression with arm (3-level categorical) as primary fixed-effect predictor and random intercept for patient nested within supervising physician; fixed-effect adjustment for site and acuity stratum. Gatekeeping for the two pairwise contrasts. Pre-specified sensitivity analyses: cluster-robust standard errors at patient level; generalized estimating equations with patient cluster and exchangeable correlation; patient-level aggregated analysis; Bayesian logistic regression with informative prior on the ANCHOR-specific contrast from the retrospective evaluation; exact methods. Missing data via multiple imputation by chained equations (m=20). Intention-to-treat primary with treatment-policy estimand (per ICH E9(R1)); per-protocol sensitivity excluding API-failure encounters. No interim efficacy stop. Pre-specified safety-halt threshold check at midpoint (n=120 cumulative across arms) for greater than 5 percentage points absolute increase in over-escalation in Arm 3 relative to Arm 2.
ANCHOR DIAGNOSTIC-TEST CHARACTERIZATION (independent of trial primary endpoint). ANCHOR's certificate (operational state: hazard flagged / no hazard flagged / out of scope) is characterized as a diagnostic test against adjudicated ground truth: sensitivity, specificity, positive predictive value, negative predictive value, area under the receiver-operating-characteristic curve, and calibration metrics (Expected Calibration Error, Brier score, reliability diagram).
PRE-SPECIFIED ALGORITHMIC FAIRNESS AUDIT. Equalized odds gap, equal opportunity gap, predictive parity gap, and within-subgroup calibration (Brier-difference tolerance 0.05) across race/ethnicity, sex assigned at birth, age band, urban/rural per RUCA 2024, and primary language. Multiplicity correction: Benjamini-Yekutieli false discovery rate with q=0.05. Disparity decision rule (locked pre-unblinding): any pairwise equalized-odds gap exceeding 0.10 with the lower bootstrap 95 percent confidence interval bound greater than 0.05 triggers a Limitations section, mitigation proposal, and a hold on broader deployment until mitigation is validated.
DATA CAPTURE. The 30-day endpoints use Waymark's integrated electronic-health-record + real-time admission/discharge/transfer feed + claims pipeline. ADT events are detected in near-real time across the full network of acute and ambulatory facilities; claims are reconciled at day 30 to confirm capture completeness. Pre-trial registration locked at the Open Science Framework prior to first enrolment; reported under CONSORT-AI 2020.
- Conditions
- High-Risk Multidisciplinary Care, Clinical Decision Support, Artificial Intelligence-Assisted Care, Telemedicine
- Being tested
- Gemini 3.1 Pro with Safety Prompt, ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro)
- Keywords
- clinical decision support, large language model, artificial intelligence, verification layer, logical neural network, care management, telemedicine, patient safety, algorithmic fairness, CONSORT-AI
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Gemini 3.1 Pro with Safety PromptBehavioural
Gemini 3.1 Pro generates the care-management recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. Supervising physician reviews the LLM output directly without ANCHOR augmentation.
ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro)Behavioural
Same Gemini 3.1 Pro generation as Arm 2, with ANCHOR additionally applied: a single-call structural verification layer combining a Logical Neural Network safety certificate over a 3,206-rule clinical logic library, six concurrent specialist agents (drug interaction, lab interpretation, guideline compliance, citation verification, safety net, differential-diagnosis breadth), and a concept-decomposition module with PMID-traceable provenance. Decision support only; clinician retains all clinical decision authority.
| Study group | Role | What they receive |
|---|---|---|
| Arm 1 - Unassisted standard care (control) | No intervention | n=80. No LLM. No ANCHOR. The supervising physician opens a blank SOAP note template and writes their own assessment and plan from scratch based on the patient context and any prior chart review. Existing Waymark integrated-network multidisciplinary clinical-team support continues unchanged. |
| Arm 2 - Gemini 3.1 Pro with safety prompt (active comparator) | Active comparator | n=80. Gemini 3.1 Pro generates the care-management recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. The supervising physician reviews the LLM output directly without ANCHOR augmentation. This stack is operationally equivalent to LLM-assisted clinical-decision-support deployments already in routine use at major U.S. health systems. Decision support only; the supervising physician retains all clinical decision authority. Receives: Behavioral: Gemini 3.1 Pro with Safety Prompt |
| Arm 3 - Gemini 3.1 Pro + ANCHOR (intervention) | Experimental | n=80. Same Gemini 3.1 Pro generation as Arm 2, with ANCHOR additionally applied: a single-call structural verification layer (Logical Neural Network certificate over a 3,206-rule clinical logic library; six specialist agents - drug interaction, lab interpretation, guideline compliance, citation verification, safety net, differential-diagnosis breadth; concept-decomposed output with PMID provenance) augments the LLM output. Supervising physician reviews the ANCHOR-augmented output. Decision support only; clinician retains all clinical decision authority. Receives: Behavioral: ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro) |
What is being measured
The primary outcome is the main question the study is designed to answer.
Per-encounter clinical safety failure (adjudicated binary composite)
Adjudicated binary composite of any of: (a) failure to mention a do-not-miss diagnosis appropriate for the presentation; (b) under-triage (routine/semi-urgent when emergent/urgent appropriate); (c) recommendation of a medication contraindicated by documented allergies/conditions/comorbidities; (d) failure to recommend escalation when clinically warranted. Adjudicated by a blinded panel of 3 board-certified physicians (Internal Medicine, Family Medicine, or Medicine-Pediatrics); final scoring by majority of three. Reported as proportion of encounters with composite safety failure.
Measured: At the encounter (encounter-level outcome adjudicated within 4 weeks post-encounter)
Secondary outcomes (4)
Appropriate triage escalation rate
Proportion of encounters in which the assigned triage level was appropriate to the clinical presentation, adjudicated.
Measured: At the encounter
Time-to-physician-decision
Continuous duration in seconds from encounter start to supervising-physician final decision; log-transformed for analysis. Excludes API latency.
Measured: Within the encounter (real-time)
30-day emergency-department visit rate (exploratory)
Any emergency-department visit within 30 days post-encounter, captured through Waymark's integrated electronic-health-record + real-time admission/discharge/transfer feed + claims pipeline. EXPLORATORY: underpowered at n=240; reported as effect estimate with 95 percent confidence interval without significance claim.
Measured: 30 days post-randomization
30-day hospitalization rate (exploratory)
Any hospitalization within 30 days post-encounter, captured through the integrated EHR + ADT + claims pipeline. EXPLORATORY: underpowered at n=240; reported as effect estimate with 95 percent confidence interval without significance claim.
Measured: 30 days post-randomization
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted19 May 2026
- Study start15 May 2026
- Primary completion2 Jul 2026
- Study completion6 Jul 2026
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Other trials for High-Risk Multidisciplinary CareStudies of the same condition, open and under way.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Interventional
- Phase
- Phase N/A
- Primary purpose
- Health services research
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Model description
- Three-arm parallel patient-level stratified permuted-block randomization, block size 6, stratified by site and acuity stratum. Once a patient is randomized at first eligible encounter, all subsequent encounters for that patient remain in the same arm.
- Masking
- Single blind
- Who is masked
- Outcomes assessor
- Enrolment
- 240 participants (actual)
Sponsor and investigators
- Lead sponsor
- Waymark
- Sponsor type
- Industry (pharma, biotech, devices)
- Responsible party
- Principal investigator, Sanjay Basu, Waymark
- Investigators
- Sanjay Basu, MD, PhD, Principal investigator, Waymark
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT07597499
- Sponsor's protocol ID
- ANCHOR-2026-01
- Status last verified
- Jul 2026
- First submitted
- 8 May 2026
- Last updated
- 8 Jul 2026
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- No: The trial dataset contains protected health information governed by HIPAA; no patient-level data, de-identified or otherwise, will be deposited in a public repository or shared with peer reviewers. Aggregate per-arm summary statistics, primary and secondary endpoint estimates, and adverse-event tables will be posted to ClinicalTrials.gov in accordance with the Final Rule (42 CFR Part 11).
Study at a glance
From the registry record, last updated by the sponsor on 8 Jul 2026. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- ANCHOR (Auditable Navigation of Clinical Hazards With Oversight and Reasoning) Multicenter Randomized Validation Study: A Pragmatic Three-Arm (1:1:1) Patient-Level Randomized Controlled Trial of a Structural Verification Layer for AI-Assisted High-Risk Multidisciplinary Care Across Three U.S. States
- ClinicalTrials.gov ID
- NCT07597499
- Acronym / sponsor ID
- ANCHOR-2026-01
- Conditions
- High-Risk Multidisciplinary Care, Clinical Decision Support, Artificial Intelligence-Assisted Care, Telemedicine
- Keywords
- clinical decision support, large language model, artificial intelligence, verification layer, logical neural network, care management, telemedicine, patient safety
- Study type
- Interventional
- Recruitment status
- Completed
- Enrolment
- 240 participants (actual)
- Lead sponsor
- WaymarkIndustry (pharma, biotech, devices)
- Study start
- 15 May 2026 (actual)
- Primary completion
- 2 Jul 2026 (actual)
- Study completion
- 6 Jul 2026 (actual)
- First posted
- 19 May 2026 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
This pre-registered, pragmatic, three-arm (1:1:1) patient-level randomized controlled trial with mixed-effects analysis at the encounter level tests two questions in real high-risk multidisciplinary clinical encounters at the Waymark clinically integrated network across three U.S. states (Ohio, Washington, Virginia): (1) does adding ANCHOR - a clinical AI structural verification layer - to a Gemini 3.1 Pro-assisted supervising-physician workflow reduce the rate of clinically meaningful safety failures, compared with the same Gemini 3.1 Pro-assisted workflow without ANCHOR? (2) does the Gemini 3.1 Pro-assisted workflow itself reduce the same safety endpoint compared with unassisted standard care in which the supervising physician writes their own SOAP assessment/plan from a blank template?
ANCHOR is a single-call structural verification layer combining a Logical Neural Network (Riegel et al. 2020) certificate, six specialist agents, and concept-decomposed output with PMID citation provenance. ANCHOR is physician-facing only and is used by supervising physicians, not by the multidisciplinary clinical team they oversee.
The trial randomizes 240 patients 1:1:1 across the Waymark clinically integrated network over a 12-week active-enrolment window (80 per arm). Eligible patients are adults (age 18+) identified as high-risk by combined claims-based and clinical criteria. Eligible encounters span three integrated Waymark service modalities: high-risk primary care, specialty care coordination, and real-time telemedicine urgent care. The primary endpoint is a per-encounter binary composite: any of (a) failure to mention a do-not-miss diagnosis, (b) under-triage, (c) contraindicated medication recommendation, (d) failure to recommend escalation when clinically warranted; adjudicated by a blinded panel of 3 board-certified physicians with majority-of-three scoring. The primary contrast is Arm 3 (LLM+ANCHOR) versus Arm 2 (LLM with safety prompt), isolating ANCHOR's marginal contribution over a deployment-equivalent LLM safety stack. The pre-specified secondary contrast is Arm 2 versus Arm 1.
The trial is sized to the operational ceiling of the Waymark integrated-network workflow across the three states (240 enrollees over 12 weeks). At realistic effect sizes derived from the retrospective evaluation, the trial is underpowered for definitive efficacy declaration on either pairwise contrast and is reported as an initial deployment-feasibility validation cohort with effect estimates and 95 percent confidence intervals; full power calculations are pre-registered in the Statistical Analysis Plan.
Single-blind outcome adjudication: 3 adjudicators score only the supervising physician's final clinical decision, so all three arms produce adjudication packets in identical format and arm allocation is structurally invisible. Statisticians remain blinded until database lock. A full waiver of informed consent is requested per 45 CFR 46.116(f)(3) with a companion HIPAA waiver of authorization under 45 CFR 164.512(i)(2)(ii). The study is registered on the Open Science Framework prior to first enrollment and reported under CONSORT-AI 2020.
Detailed description
DESIGN. Pragmatic, multicenter, encounter-level, three-arm parallel randomized controlled trial. 1:1:1 patient-level stratified permuted-block randomization, block size 6, stratified by site and acuity stratum. Once a patient is randomized at first eligible encounter, all subsequent encounters for that patient remain in the same arm.
ARMS.
- Arm 1 (Unassisted standard care, n=80): No LLM. No ANCHOR. The supervising physician opens a blank SOAP note template and writes their own assessment and plan from scratch.
- Arm 2 (Gemini 3.1 Pro with safety prompt, n=80): Gemini 3.1 Pro generates the recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. The supervising physician reviews the LLM output directly. This stack is operationally equivalent to LLM-assisted clinical-decision-support deployments already in routine use at major U.S. health systems.
- Arm 3 (Gemini 3.1 Pro + ANCHOR, n=80): Gemini 3.1 Pro generates the recommendation under the same safety prompt as Arm 2; ANCHOR augments that output with the Logical Neural Network certificate, specialist-agent verification, and concept-decomposed audit trail.
OPERATIONAL SIZING. The Waymark integrated-network workflow across Ohio, Washington, and Virginia captures approximately 20 eligible high-risk multidisciplinary encounters per week. With 12 weeks of active enrolment, total enrolment is 240 encounters (80 per arm at 1:1:1).
POWER CALCULATION. Anchored on the architectural-argument retrospective cohort. For each pairwise contrast at n=80 per arm, the plausible effect range is 5 to 11 percentage points absolute reduction (midpoint 8 percentage points). At the midpoint planning effect (Arm 2 event rate 25 percent versus Arm 3 17 percent), power is approximately 0.50 for the verification-layer-specific contrast (Arm 3 versus Arm 2) at alpha = 0.05. The trial functions as a calibration cohort with effect estimates and 95 percent confidence intervals.
PRIMARY ENDPOINT. Per-encounter binary composite, adjudicated by 3 board-certified physicians blinded to allocation; final scoring by majority of three. Components: (a) Failure to mention a do-not-miss diagnosis; (b) Under-triage; (c) Recommendation of a medication contraindicated by documented allergies/conditions/comorbidities; (d) Failure to recommend escalation when clinically warranted.
PRIMARY CONTRAST: Arm 3 versus Arm 2 (ANCHOR-specific). PRE-SPECIFIED SECONDARY CONTRAST: Arm 2 versus Arm 1 (AI-introduction).
SECONDARY ENDPOINTS (hierarchical fixed sequence, Holm-Bonferroni step-down at family-wise alpha = 0.05): (1) Appropriate triage escalation rate; (2) Time-to-physician-decision; (3) Clinician acceptance rate of ANCHOR flags (Arm 3 only); (4) 30-day emergency-department visit rate (EXPLORATORY); (5) 30-day hospitalization rate (EXPLORATORY); (6) Social-determinants-of-health response composite.
STATISTICAL ANALYSIS. Mixed-effects logistic regression with arm (3-level categorical) as primary fixed-effect predictor and random intercept for patient nested within supervising physician; fixed-effect adjustment for site and acuity stratum. Gatekeeping for the two pairwise contrasts. Pre-specified sensitivity analyses: cluster-robust standard errors at patient level; generalized estimating equations with patient cluster and exchangeable correlation; patient-level aggregated analysis; Bayesian logistic regression with informative prior on the ANCHOR-specific contrast from the retrospective evaluation; exact methods. Missing data via multiple imputation by chained equations (m=20). Intention-to-treat primary with treatment-policy estimand (per ICH E9(R1)); per-protocol sensitivity excluding API-failure encounters. No interim efficacy stop. Pre-specified safety-halt threshold check at midpoint (n=120 cumulative across arms) for greater than 5 percentage points absolute increase in over-escalation in Arm 3 relative to Arm 2.
ANCHOR DIAGNOSTIC-TEST CHARACTERIZATION (independent of trial primary endpoint). ANCHOR's certificate (operational state: hazard flagged / no hazard flagged / out of scope) is characterized as a diagnostic test against adjudicated ground truth: sensitivity, specificity, positive predictive value, negative predictive value, area under the receiver-operating-characteristic curve, and calibration metrics (Expected Calibration Error, Brier score, reliability diagram).
PRE-SPECIFIED ALGORITHMIC FAIRNESS AUDIT. Equalized odds gap, equal opportunity gap, predictive parity gap, and within-subgroup calibration (Brier-difference tolerance 0.05) across race/ethnicity, sex assigned at birth, age band, urban/rural per RUCA 2024, and primary language. Multiplicity correction: Benjamini-Yekutieli false discovery rate with q=0.05. Disparity decision rule (locked pre-unblinding): any pairwise equalized-odds gap exceeding 0.10 with the lower bootstrap 95 percent confidence interval bound greater than 0.05 triggers a Limitations section, mitigation proposal, and a hold on broader deployment until mitigation is validated.
DATA CAPTURE. The 30-day endpoints use Waymark's integrated electronic-health-record + real-time admission/discharge/transfer feed + claims pipeline. ADT events are detected in near-real time across the full network of acute and ambulatory facilities; claims are reconciled at day 30 to confirm capture completeness. Pre-trial registration locked at the Open Science Framework prior to first enrolment; reported under CONSORT-AI 2020.
Study design
- Primary purpose
- Health services research
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Masking
- Single blind (outcomes assessor)
- Number of arms
- 3
- Model description
- Three-arm parallel patient-level stratified permuted-block randomization, block size 6, stratified by site and acuity stratum. Once a patient is randomized at first eligible encounter, all subsequent encounters for that patient remain in the same arm.
| Arm | Type | Receives |
|---|---|---|
| Arm 1 - Unassisted standard care (control) | No intervention | –n=80. No LLM. No ANCHOR. The supervising physician opens a blank SOAP note template and writes their own assessment and plan from scratch based on the patient context and any prior chart review. Existing Waymark integrated-network multidisciplinary clinical-team support continues unchanged. |
| Arm 2 - Gemini 3.1 Pro with safety prompt (active comparator) | Active comparator | Behavioral: Gemini 3.1 Pro with Safety Promptn=80. Gemini 3.1 Pro generates the care-management recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. The supervising physician reviews the LLM output directly without ANCHOR augmentation. This stack is operationally equivalent to LLM-assisted clinical-decision-support deployments already in routine use at major U.S. health systems. Decision support only; the supervising physician retains all clinical decision authority. |
| Arm 3 - Gemini 3.1 Pro + ANCHOR (intervention) | Experimental | Behavioral: ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro)n=80. Same Gemini 3.1 Pro generation as Arm 2, with ANCHOR additionally applied: a single-call structural verification layer (Logical Neural Network certificate over a 3,206-rule clinical logic library; six specialist agents - drug interaction, lab interpretation, guideline compliance, citation verification, safety net, differential-diagnosis breadth; concept-decomposed output with PMID provenance) augments the LLM output. Supervising physician reviews the ANCHOR-augmented output. Decision support only; clinician retains all clinical decision authority. |
Who may qualify
- Ages
- 18 years and older
- Sex
- All
- Healthy volunteers
- Not accepted
- Age groups
- Adult, Older adult
Key inclusion criteria (6 listed)
- Age 18 years or older.
- Attributed to a participating Waymark provider (academic medical center, community-hospital network, federally qualified health center, or independent physician practice in Ohio, Washington, or Virginia; full TIN-consolidated list deposited at the Open Science Framework).
- Meets high-risk multidisciplinary criteria (combined claims-based and clinical: 2 or more emergency-department visits or 1 or more hospitalization in the prior 12 months, 5 or more active medications, 2 or more active specialist relationships, 2 or more chronic conditions, or claims-based equivalents).
- Encounter occurs in one of the three Waymark service modalities: high-risk primary care, specialty care coordination, or real-time telemedicine urgent care.
- English-language clinical documentation.
Key exclusion criteria (7 listed)
- Pediatric (age less than 18 years).
- Hospice or palliative-care-exclusive care plan.
- Active psychiatric crisis routed to crisis line.
- Encounter is administrative only.
- Pharmacy-only encounter that does not surface a clinical decision to the supervising physician.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Gemini 3.1 Pro with Safety PromptGemini 3.1 Pro generates the care-management recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. Supervising physician reviews the LLM output directly without ANCHOR augmentation. | Behavioural | Arm 2 - Gemini 3.1 Pro with safety prompt (active comparator) |
| ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro)Same Gemini 3.1 Pro generation as Arm 2, with ANCHOR additionally applied: a single-call structural verification layer combining a Logical Neural Network safety certificate over a 3,206-rule clinical logic library, six concurrent specialist agents (drug interaction, lab interpretation, guideline compliance, citation verification, safety net, differential-diagnosis breadth), and a concept-decomposition module with PMID-traceable provenance. Decision support only; clinician retains all clinical decision authority. | Behavioural | Arm 3 - Gemini 3.1 Pro + ANCHOR (intervention) |
Primary outcome
Per-encounter clinical safety failure (adjudicated binary composite)
Time frame: At the encounter (encounter-level outcome adjudicated within 4 weeks post-encounter)
Adjudicated binary composite of any of: (a) failure to mention a do-not-miss diagnosis appropriate for the presentation; (b) under-triage (routine/semi-urgent when emergent/urgent appropriate); (c) recommendation of a medication contraindicated by documented allergies/conditions/comorbidities; (d) failure to recommend escalation when clinically warranted. Adjudicated by a blinded panel of 3 board-certified physicians (Internal Medicine, Family Medicine, or Medicine-Pediatrics); final scoring by majority of three. Reported as proportion of encounters with composite safety failure.
4 secondary outcomes
Appropriate triage escalation rate
Time frame: At the encounter
Time-to-physician-decision
Time frame: Within the encounter (real-time)
30-day emergency-department visit rate (exploratory)
Time frame: 30 days post-randomization
30-day hospitalization rate (exploratory)
Time frame: 30 days post-randomization
Results and safety
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 8 Jul 2026.
- Individual participant dataSharing planned: No. The trial dataset contains protected health information governed by HIPAA; no patient-level data, de-identified or otherwise, will be deposited in a public repository or shared with peer reviewers. Aggregate per-arm summary statistics, primary and secondary endpoint estimates, and adverse-event tables will be posted to ClinicalTrials.gov in accordance with the Final Rule (42 CFR Part 11).
Related trials for High-Risk Multidisciplinary Care
Enrolling by invitationObservational study
Epilepsy Emergency Department High Utilizer Program
Epilepsy, Uncontrolled Seizures
Not yet recruiting
Integrated Rehabilitation in HDU for Post-Intensive Care SyndromeLiberation in Patients With PICS
Post-Intensive Care Syndrome (PICS), Critical Illness Recovery
Active, not recruiting
Effects of Preoperative Multidisciplinary Team Meetings for High-risk, Adult, Noncardiac Surgical Patients
Interdisciplinary Communication, Postoperative Complications
Enrolling by invitationObservational study
Integrated Care After Repeated Psychiatric Hospital Stays - Evaluation of an Interdisciplinary Treatment Program
High Utilization / Heavy Use, Psychiatric Hospitalization
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
Sanjay Basu, MD, PhD principal investigator
Waymark
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
A study testing Gemini 3.1 Pro with Safety Prompt and ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro) in people with High-Risk Multidisciplinary Care and Clinical Decision Support, run by Waymark at 1 site in United States.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 6 inclusion and 7 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 8 Jul 2026. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in United States. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Per-encounter clinical safety failure (adjudicated binary composite) (time frame: At the encounter (encounter-level outcome adjudicated within 4 weeks post-encounter)). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 8 Jul 2026.