AzTrials
AzTrials

Retinal DiseaseNCT07651943

AI-Assisted Interpretation of Ultra-Widefield Retinal Images

An observational study of Retinal Disease, run by Xiamen Ophthalmology Center Affiliated to Xiamen University at 5 sites in China.

Completed

Finished. The study has ended and is not enrolling. Results may be posted on the official record.

Official record
Search all trials

Trial summary

The goal of this prospective observational study is to evaluate the impact of artificial intelligence (AI) assistance on clinician interpretation of ultra-widefield (UWF) retinal images. Read more about this study

Who is it for?
Ages 18 years and olderHealthy volunteers can take part
Conditions the study is for
Retinal Disease
What is being tested?
AI-Assisted Interpretation and Unaided Interpretation
Type of treatment
Medical device
How many people
462 participants
Where
5 sitesChina
Study dates
1 Jan 2026to 10 Feb 2026
Phase
Observational
Are there results?
None posted in the registry

Key requirements

Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.

  • Ages 18 years and older
  • All sexes
  • Healthy volunteers accepted
  • Adult, Older adult

Study population: Participants undergoing clinically indicated ultra-widefield retinal imaging at participating ophthalmic centers in China, including individuals with diverse retinal diseases and retinal findings encountered in real-world clinical practice.

Who may be able to join

  • Participants undergoing ultra-widefield retinal imaging at participating ophthalmic centers;

Who cannot join

  • Poor-quality or ungradable retinal images;

Trial locations and contacts

5 sites in 1 country.

5 sites in 1 country

China5 sites
  • Chongqing Huaxia Eye Hospital

    Chongqing, Chongqing Municipality

  • Fuzhou Eye Hospital

    Fuzhou, Fujian, 361000

  • Hengshui Tongrui Eye Hospital

    Hengshui, Hebei

  • Heze Huaxia Eye Hospital

    Heze, Shandong

  • Xiamen Eye Center of Xiamen University

    Xiamen, Fujian, 361000

Other trials in China

About this study

Official title: Prospective Multi-Center Evaluation of AI-Assisted Interpretation of Ultra-Widefield Retinal Images in a Multi-Reader Crossover Study

The goal of this prospective observational study is to evaluate the impact of artificial intelligence (AI) assistance on clinician interpretation of ultra-widefield (UWF) retinal images.

The main questions it aims to answer are:

Read more

whether AI assistance improves the diagnostic performance of ophthalmologists in detecting retinal findings on UWF retinal images; whether AI assistance improves sensitivity, specificity, and inter-reader agreement across clinicians with different levels of experience.

Approximately 600 UWF retinal images prospectively collected from multiple ophthalmic centers in China will be included. Images will be independently annotated by expert retinal specialists to establish reference labels for retinal finding categories.

Four ophthalmologists with different levels of clinical experience, including one senior retinal specialist and three junior ophthalmologists, will participate in a crossover multi-reader study.

For each clinician, the dataset will be randomly divided into two equal subsets. During the first reading session, clinicians will evaluate one subset without AI assistance and the other subset with AI assistance. After a washout interval of at least two weeks, the reading conditions will be reversed in a second reading session with independently randomized image order.

Under the AI-assisted condition, clinicians will be provided with category-level AI prediction probabilities for retinal findings. No localization maps, heatmaps, segmentation overlays, or automated diagnostic recommendations will be displayed. Clinicians will retain full autonomy over final decisions.

Reader performance under AI-assisted and unaided conditions will be compared using expert reference annotations as the ground truth.

Read the detailed description

This study is a prospective multi-center observational reader study designed to evaluate the impact of artificial intelligence (AI) assistance on clinician interpretation of ultra-widefield (UWF) retinal images.

Approximately 600 UWF retinal images will be prospectively collected from multiple ophthalmic centers in China. Images will be acquired using clinically routine UWF retinal imaging systems and will include a broad spectrum of retinal diseases and retinal findings encountered in real-world clinical practice.

All images will undergo independent expert annotation by retinal specialists to establish reference labels for retinal finding categories. These expert annotations will serve as the reference standard for subsequent performance evaluation.

Four ophthalmologists with different levels of clinical experience will participate in the reader study, including:

one senior retinal specialist with approximately five years of retinal clinical experience; three junior ophthalmologists with approximately two years of ophthalmology residency training.

A randomized crossover multi-reader design will be implemented to minimize recall bias and balance reading conditions.

For each clinician, the image dataset will be randomly divided into two equal subsets (subset A and subset B; approximately 300 images each).

During Round 1:

subset A will be interpreted without AI assistance; subset B will be interpreted with AI assistance.

After a washout interval of at least two weeks, the reading conditions will be reversed during Round 2:

subset A will be interpreted with AI assistance; subset B will be interpreted without AI assistance.

Image order will be independently randomized for each session and each clinician.

Under the unaided condition, clinicians will evaluate retinal images using standard clinical interpretation without AI output.

Under the AI-assisted condition, clinicians will receive category-level AI prediction probabilities for retinal finding categories. The AI output will provide probabilistic confidence scores only and will not include lesion localization maps, heatmaps, segmentation overlays, or automated binary recommendations.

Clinicians will remain blinded to the expert reference labels and to the interpretations of other readers. Final diagnostic decisions will be independently determined by each clinician.

The primary analysis will compare diagnostic performance between unaided and AI-assisted conditions, including sensitivity, specificity, area under the receiver operating characteristic curve (AUC), and inter-reader agreement.

Conditions
Retinal Disease
Being tested
AI-Assisted Interpretation, Unaided Interpretation
Keywords
Artificial Intelligence, Ultra-Widefield Imaging, Retinal Imaging, Reader Study, Diagnostic Performance, AI-Assisted Diagnosis
Medical subject headings
Retinal Diseases

What participants receive

What participants receive. In a randomised study each person is assigned to one group by chance.

  • AI-Assisted InterpretationDevice

    Clinicians interpret ultra-widefield retinal images with access to AI-generated category-level prediction probabilities for retinal findings.

  • Unaided InterpretationDevice

    Clinicians interpret ultra-widefield retinal images without AI assistance using routine retinal image interpretation alone.

Study groups in NCT07651943
Study groupRoleWhat they receive
AI-Assisted InterpretationClinicians interpret ultra-widefield retinal images with access to AI-generated category-level prediction probabilities for retinal findings.
Receives: Device: AI-Assisted Interpretation
Unaided InterpretationClinicians interpret ultra-widefield retinal images without AI assistance using routine retinal image interpretation alone.
Receives: Device: Unaided Interpretation

What is being measured

The primary outcome is the main question the study is designed to answer.

  1. Sensitivity for retinal finding detection

    Sensitivity of clinicians in detecting retinal finding categories under AI-assisted and unaided conditions using expert annotations as the reference standard.

    Measured: through study completion, an average of 2 months

  2. Specificity for retinal finding detection

    Specificity of clinicians in detecting retinal finding categories under AI-assisted and unaided conditions.

    Measured: through study completion, an average of 2 months

Secondary outcomes (3)
  1. Area under the receiver operating characteristic curve (AUC)

    The AUC quantifies the overall ability to correctly distinguish the presence versus absence of predefined retinal findings on ultra-widefield retinal images. AUC values range from 0.5 (no discriminative ability) to 1.0 (perfect discrimination). Clinician interpretations will be compared with an expert-adjudicated reference standard under AI-assisted and unaided conditions.

    Measured: through study completion, an average of 2 months

  2. Inter-reader agreement

    Agreement among participating clinicians in classifying predefined retinal findings on ultra-widefield retinal images. Agreement will be quantified using Cohen's kappa coefficient (for pairwise comparisons) or Fleiss' kappa coefficient (for multiple readers). Kappa values range from 0 (no agreement beyond chance) to 1 (perfect agreement).

    Measured: At study completion (up to 3 months)

  3. Diagnostic performance improvement among junior ophthalmologists

    Improvement in diagnostic performance of junior ophthalmologists when interpreting ultra-widefield retinal images with AI assistance compared with unaided interpretation, measured by changes in sensitivity, specificity, accuracy, and AUC using the expert-adjudicated reference standard.

    Measured: At study completion (up to 3 months)

Timeline

From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.

  1. First posted16 Jun 2026
  2. Study start1 Jan 2026
  3. Primary completion1 Feb 2026
  4. Study completion10 Feb 2026

Resources

More details

For doctors and researchers: how the study is designed, who runs it, and its registry IDs.

Study design
Study type
Observational
Observational model
Other
Time perspective
Prospective
Enrolment
462 participants (actual)
IDs, dates and publications
ClinicalTrials.gov ID
NCT07651943
Sponsor's protocol ID
XMYKZX-KY-2026-008
Status last verified
Jun 2026
First submitted
5 Jun 2026
Last updated
16 Jun 2026
Results posted
No
Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
Individual data sharing
No: De-identified individual participant data underlying the results reported in this study, including retinal imaging data and associated annotations, may be made available upon reasonable request to the corresponding investigator following publication, subject to institutional ethics approval, data-sharing agreements, and applicable data governance and privacy regulations.

Questions about this trial

What is this clinical trial studying?

An observational study of Retinal Disease, run by Xiamen Ophthalmology Center Affiliated to Xiamen University at 5 sites in China.

The full registered description is in the About this study section and the official record.

Who may be eligible to take part?

The sponsor lists 1 inclusion and 1 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.

Is this clinical trial currently recruiting?

The record says: finished, as of the sponsor's last update on 16 Jun 2026. Status can change between updates, so confirm with the study contact before making plans.

Where is the study taking place?

The record lists 5 sites in China. Whether a site is taking part right now should be confirmed with that site. See every site.

What are the possible benefits and risks?

They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.

Are results available for this study?

The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.

How can a doctor refer a patient or contact the research team?

The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.

What does the primary outcome measure?

Sensitivity for retinal finding detection (time frame: through study completion, an average of 2 months). The study lists 2 primary outcomes in all. It is what the study was designed to measure, not a finding.

Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?

No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.

How often is this information updated?

AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 16 Jun 2026.

Free account

Log in to keep searching

You’ve used your 3 free searches. AzTrials is free: log in or create a free account to keep searching clinical trials and save the ones you want to follow.

Create a free accountLog in