Artificial Intelligence (AI)NCT06980467
Evaluation of AI-Generated Clinical Advice by Physicians
A study testing Large Language Model in people with Artificial Intelligence (AI), run by Tsinghua University at 2 sites in China.
Trial summary
This study examines how artificial intelligence systems interact with medical professionals. Researchers will compare physician responses to different AI-generated outputs in simulative medical scenarios. Read more about this study
- Who is it for?
- Ages 18 to 80 yearsHealthy volunteers can take part
- Conditions the study is for
- Artificial Intelligence (AI)
- What is being tested?
- Large Language Model
- Could I receive a placebo?
- No, everyone receives an active treatment
- How many people
- 8 participants
- Where
- 2 sitesChina
- Study dates
- 15 May 2025to 23 May 2025
- Phase
- Interventional
- Are there results?
- Not yet: the study is under way
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 to 80 years
- All sexes
- Healthy volunteers accepted
- Adult, Older adult
Who may be able to join
- Age ≥ 18 years old;
- Licensed physician or medical professional qualified to perform clinical evaluations;
- Willing to sign informed consent and commit time to participate in the study.
Who cannot join
- Unable to dedicate sufficient time to complete the study tasks;
- Unable or unwilling to understand and follow study instructions.
Trial locations and contacts
2 sites in 1 country. Contact the study team or a site near you to ask about taking part.
China2 sites
Tsinghua University
Beijing, Beijing Municipality, 100084
Yixiao Jin, +86 17721026692, jin-yx24@mails.tsinghua.edu.cn
Shanghai Health and Medical Center
Wuxi, Jiangsu, 214065
Jing Gu, 86+(510)82335104, g950324@163.com
About this study
Official title: A Study on the Evaluation of Artificial Intelligence-Generated Clinical Advisory Outputs in Medical Professional Contexts
This study examines how artificial intelligence systems interact with medical professionals. Researchers will compare physician responses to different AI-generated outputs in simulative medical scenarios.
- Conditions
- Artificial Intelligence (AI)
- Being tested
- Large Language Model
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Large Language ModelOther
An artificial intelligence system generating clinical recommendations using prompts, designed to simulate clinical advisory outputs. The protocol focuses on structured medical language generation.
| Study group | Role | What they receive |
|---|---|---|
| control group | No intervention | Participants evaluate clinical recommendations generated by Language Model A (LLM-A), with subsequent assessments of communication style characteristics using rating scales. |
| intervention group | Experimental | Participants evaluate clinical recommendations generated by Language Model B (LLM-B), followed by evaluations of communication style characteristics through metric instruments. Receives: Other: Large Language Model |
What is being measured
The primary outcome is the main question the study is designed to answer.
Physician Response to AI-Generated Medical Content
Participants will rate their level of agreement with AI-generated clinical suggestions presented in simulated medical scenarios. Responses will be recorded using a standardized rating scale (range 1-5, where higher scores indicate better agreement).
Measured: Through study completion, an average of 1 week
Secondary outcomes (1)
Physician Perception of Communication Quality in AI-Generated Content
Participants will assess the communication style of AI-generated content, focusing on factors such as empathy. Ratings will be collected using a standardized 5-point scale (range 1-5, where higher scores reflect higher perceived quality).
Measured: Through study completion, an average of 1 week
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted20 May 2025
- Study start15 May 2025 (estimated)
- Primary completion22 May 2025 (estimated)
- Study completion23 May 2025 (estimated)
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Other trials for Artificial Intelligence (AI)Studies of the same condition, open and under way.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Interventional
- Phase
- Phase N/A
- Primary purpose
- Other
- Allocation
- Randomised
- Intervention model
- Crossover
- Masking
- Single blind
- Who is masked
- Participant
- Enrolment
- 8 participants (estimated)
Sponsor and investigators
- Lead sponsor
- Tsinghua University
- Sponsor type
- University, hospital or other
- Responsible party
- Principal investigator, Tien Yin Wong, Tsinghua University
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT06980467
- Sponsor's protocol ID
- 2025-07
- Status last verified
- May 2025
- First submitted
- 28 Apr 2025
- Last updated
- 20 May 2025
- Results posted
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
Study at a glance
From the registry record, last updated by the sponsor on 20 May 2025. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- A Study on the Evaluation of Artificial Intelligence-Generated Clinical Advisory Outputs in Medical Professional Contexts
- ClinicalTrials.gov ID
- NCT06980467
- Acronym / sponsor ID
- 2025-07
- Conditions
- Artificial Intelligence (AI)
- Study type
- Interventional
- Recruitment status
- Not yet recruiting
- Enrolment
- 8 participants (estimated)
- Lead sponsor
- Tsinghua UniversityUniversity, hospital or other
- Study start
- 15 May 2025 (estimated)
- Primary completion
- 22 May 2025 (estimated)
- Study completion
- 23 May 2025 (estimated)
- First posted
- 20 May 2025 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
This study examines how artificial intelligence systems interact with medical professionals. Researchers will compare physician responses to different AI-generated outputs in simulative medical scenarios.
Study design
- Primary purpose
- Other
- Allocation
- Randomised
- Intervention model
- Crossover
- Masking
- Single blind (participant)
- Number of arms
- 2
| Arm | Type | Receives |
|---|---|---|
| control group | No intervention | –Participants evaluate clinical recommendations generated by Language Model A (LLM-A), with subsequent assessments of communication style characteristics using rating scales. |
| intervention group | Experimental | Other: Large Language ModelParticipants evaluate clinical recommendations generated by Language Model B (LLM-B), followed by evaluations of communication style characteristics through metric instruments. |
Who may qualify
- Ages
- 18 to 80 years
- Sex
- All
- Healthy volunteers
- Accepted
- Age groups
- Adult, Older adult
Key inclusion criteria (3 listed)
- Age ≥ 18 years old;
- Licensed physician or medical professional qualified to perform clinical evaluations;
- Willing to sign informed consent and commit time to participate in the study.
Key exclusion criteria (2 listed)
- Unable to dedicate sufficient time to complete the study tasks;
- Unable or unwilling to understand and follow study instructions.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Large Language ModelAn artificial intelligence system generating clinical recommendations using prompts, designed to simulate clinical advisory outputs. The protocol focuses on structured medical language generation. | Other | intervention group |
Primary outcome
Physician Response to AI-Generated Medical Content
Time frame: Through study completion, an average of 1 week
Participants will rate their level of agreement with AI-generated clinical suggestions presented in simulated medical scenarios. Responses will be recorded using a standardized rating scale (range 1-5, where higher scores indicate better agreement).
1 secondary outcome
Physician Perception of Communication Quality in AI-Generated Content
Time frame: Through study completion, an average of 1 week
Results and safety
This study is still under way. Results are not available in the source record yet.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 20 May 2025.
Related trials for Artificial Intelligence (AI)
Not yet recruiting
Multimodal AI-Driven Out-of-Hospital Management for Hypertension and Cardiometabolic Risk
Hypertension, Hyperglycemia
RecruitingObservational study
Multicenter Study for the Validation of Willem AI: Aortic StenoSis Early Diagnosis With AI-electrocardiogram Study
Aortic Stenosis
Not yet recruiting
Comparison of Two Patient Education Methods in Women With Chronic Low Back Pain: Online Pain Education vs. AI-Driven Patient Education on Pain Beliefs, Catastrophizing, and Self-Efficacy
Chronic Low Back Pain (CLBP)
Active, not recruitingObservational study
Epigenetic Changes in Long COVID Patients
Long COVID-19 Syndrome, Long COVID Symptoms
Not yet recruiting
Manus AI-Assisted Orthodontic Education and Oral Health-Related Quality of Life
Oral Health-Related Quality of Life
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part.
2 sites in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
A study testing Large Language Model in people with Artificial Intelligence (AI), run by Tsinghua University at 2 sites in China.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 3 inclusion and 2 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: opening soon, as of the sponsor's last update on 20 May 2025. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 2 sites in China. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
This study is still under way. Results are not available in the source record yet.
How can a doctor refer a patient or contact the research team?
Contact Yixiao Jin (+86 17721026692, jin-yx24@mails.tsinghua.edu.cn), or a site near the patient. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Physician Response to AI-Generated Medical Content (time frame: Through study completion, an average of 1 week). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 20 May 2025.