AI (Artificial Intelligence)NCT07505862
Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination
An observational study of AI (Artificial Intelligence), run by Guangdong Provincial People's Hospital at 1 site in China.
Trial summary
This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. Read more about this study
- Who is it for?
- Ages 18 to 60 yearsHealthy volunteers can take part
- Conditions the study is for
- AI (Artificial Intelligence)
- How many people
- 20 participants
- Where
- 1 siteChina
- Study dates
- 1 Oct 2025to 30 Mar 2026
- Phase
- Observational
- Are there results?
- Not yet: the study is under way
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 to 60 years
- All sexes
- Healthy volunteers accepted
- Adult
Study population: Medical students currently enrolled in a Standardized Residency Training (SRT) program.
Who may be able to join
- 1.Professional Status: Medical students currently enrolled in a Standardized Residency Training (SRT) program.
- 2.Educational Background: Holders of a Bachelor of Medicine degree or higher, with foundational clinical knowledge.
- 3.Informed Consent: Voluntarily participate in the study and provide written informed consent.
- 4.Technical Competency: Proficient in using digital platforms to complete assessments and scoring.
Who cannot join
- 1.Conflict of Interest: Individuals involved in the AI model training, prompt engineering, or the creation of the human-authored question bank for this study.
- 2.Inability to Complete: Presence of visual/auditory impairments or severe illness that precludes completion of the assessment within the specified time.
- 3.Investigator's Discretion: Any other condition that, in the opinion of the investigator, renders the participant unsuitable for the study.
Trial locations and contacts
1 site in 1 country. Contact the study team or a site near you to ask about taking part.
China1 site, 1 recruiting
- Recruiting
Guangdong Provincial People's Hospital
Guangzhou, Guangdong
ZhuoYi Chen MD, +86 18737552662, 18737552662@163.com
About this study
Official title: Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination: An Empirical Analysis Based on the "Answering-Generating" Closed Loop and Transformation of Competency Assessment
This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. The entire study adheres to the principles of single-blinding, randomization, and standardization to ensure scientific rigor and reproducibility.
The single-blind design is implemented during the "standardized testing" phase, where the system intersperses AI-generated items with those authored by human experts. Participants remain blinded to the source of each item (AI-generated vs. human-authored) throughout the testing and scoring processes, thereby ensuring the objectivity of the evaluation results.
- Conditions
- AI (Artificial Intelligence)
What is being measured
The primary outcome is the main question the study is designed to answer.
Comparative Analysis of Item Accuracy
The investigators will evaluate the average accuracy rates coefficients of AI-generated items compared to human-generated items
Measured: Baseline
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted1 Apr 2026
- Study start1 Oct 2025
- Primary completion30 Mar 2026 (estimated)
- Study completion30 Mar 2026 (estimated)
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Other trials for AI (Artificial Intelligence)Studies of the same condition, open and under way.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Observational
- Observational model
- Other
- Time perspective
- Cross-sectional
- Enrolment
- 20 participants (estimated)
Sponsor and investigators
- Lead sponsor
- Guangdong Provincial People's Hospital
- Sponsor type
- University, hospital or other
- Responsible party
- Principal investigator, Xiong hao, Guangdong Provincial People's Hospital
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT07505862
- Sponsor's protocol ID
- KY2025-1298-02
- Status last verified
- Mar 2026
- First submitted
- 22 Mar 2026
- Last updated
- 1 Apr 2026
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
Study at a glance
From the registry record, last updated by the sponsor on 1 Apr 2026. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination: An Empirical Analysis Based on the "Answering-Generating" Closed Loop and Transformation of Competency Assessment
- ClinicalTrials.gov ID
- NCT07505862
- Acronym / sponsor ID
- KY2025-1298-02
- Conditions
- AI (Artificial Intelligence)
- Study type
- Observational
- Recruitment status
- Recruiting
- Enrolment
- 20 participants (estimated)
- Lead sponsor
- Guangdong Provincial People's HospitalUniversity, hospital or other
- Study start
- 1 Oct 2025 (actual)
- Primary completion
- 30 Mar 2026 (estimated)
- Study completion
- 30 Mar 2026 (estimated)
- First posted
- 1 Apr 2026 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. The entire study adheres to the principles of single-blinding, randomization, and standardization to ensure scientific rigor and reproducibility.
The single-blind design is implemented during the "standardized testing" phase, where the system intersperses AI-generated items with those authored by human experts. Participants remain blinded to the source of each item (AI-generated vs. human-authored) throughout the testing and scoring processes, thereby ensuring the objectivity of the evaluation results.
Study design
- Observational model
- Other
- Time perspective
- Cross-sectional
Who may qualify
- Ages
- 18 to 60 years
- Sex
- All
- Healthy volunteers
- Accepted
- Age groups
- Adult
- Study population
- Medical students currently enrolled in a Standardized Residency Training (SRT) program.
Key inclusion criteria (4 listed)
- 1.Professional Status: Medical students currently enrolled in a Standardized Residency Training (SRT) program.
- 2.Educational Background: Holders of a Bachelor of Medicine degree or higher, with foundational clinical knowledge.
- 3.Informed Consent: Voluntarily participate in the study and provide written informed consent.
- 4.Technical Competency: Proficient in using digital platforms to complete assessments and scoring.
Key exclusion criteria (3 listed)
- 1.Conflict of Interest: Individuals involved in the AI model training, prompt engineering, or the creation of the human-authored question bank for this study.
- 2.Inability to Complete: Presence of visual/auditory impairments or severe illness that precludes completion of the assessment within the specified time.
- 3.Investigator's Discretion: Any other condition that, in the opinion of the investigator, renders the participant unsuitable for the study.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Primary outcome
Comparative Analysis of Item Accuracy
Time frame: Baseline
The investigators will evaluate the average accuracy rates coefficients of AI-generated items compared to human-generated items
Results and safety
This study is still under way. Results are not available in the source record yet.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 1 Apr 2026.
Related trials for AI (Artificial Intelligence)
Recruiting
Longitudinal AI-Assisted Management of Indeterminate Pulmonary Nodules
Pulmonary Nodules, Lung Neoplasms
Recruiting
A Multicenter Randomized Trial of CT-Based AI Decision Support for Early Pneumonia Care
Pneumonia; Pulmonary Infection
Recruiting
Feasibility and Acceptability of an LLM-based Chatbot for Family Caregivers: Evaluation Study
Caregivers
Enrolling by invitationObservational study
Comparing an AI-driven Hearing Test With the Standard Hearing Test in Adults With Hearing Loss and Tinnitus
Sensorineural Hearing Loss, Tinnitus
Not yet recruiting
AI-Powered Sleep Hygiene Mentor for Adults Living With HIV
Sleep Wake Disorders, Sleep Initiation and Maintenance Disorders
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part.
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
An observational study of AI (Artificial Intelligence), run by Guangdong Provincial People's Hospital at 1 site in China.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 4 inclusion and 3 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: looking for participants now, as of the sponsor's last update on 1 Apr 2026. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in China. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
This study is still under way. Results are not available in the source record yet.
How can a doctor refer a patient or contact the research team?
Contact Zhuoyi Chen MD (+86 18737552662, 18737552662@163.com), or a site near the patient. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Comparative Analysis of Item Accuracy (time frame: Baseline). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 1 Apr 2026.