Patient SatisfactionNCT06247475
Generating Fast and Slow for Entree Level Medical Knowledge
An observational study of Patient Satisfaction, run by National Taiwan University Hospital at 1 site in Taiwan.
Trial summary
The generative artificial intelligence tool, ChatGPT, has garnered widespread interest since its launch. This innovative multimedia platform has the potential to enhance medical communication and health education, thereby improving medical accessibility and reducing the burden on healthcare professionals. Read more about this study
- Who is it for?
- Ages 18 years and olderHealthy volunteers can take part
- Conditions the study is for
- Patient Satisfaction
- What is being tested?
- Answers generated by ChatGPT
- How many people
- 120 participants
- Where
- 1 siteTaiwan
- Study dates
- Feb 2024to Jun 2024
- Phase
- Observational
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 years and older
- All sexes
- Healthy volunteers accepted
- Adult, Older adult
Study population: The medical professionals, healthcare-related professionals, and medical students refer to attending physician, medical radiation technologist from National Taiwan University Hospital, and medical students from National Taiwan University College of Medicine, respectively. The general public refer to volunteers from Taiwan Emergency Medical Technician Association.
Who may be able to join
- National Taiwan University Hospital
- Medical professionals
- Healthcare-related professionals
- Medical students
- Taiwan Emergency Medical Technician Association.
- Volunteers
Who cannot join
- N/A.
Trial locations and contacts
1 site in 1 country.
Taiwan1 site
National Taiwan University
Taipei, 100
Kuanju Huang, MS, +886-5-5323911 ext. 63413, Y06058@ms1.ylh.gov.tw
Kuanju Huang, +886-972655731, restroomer@icloud.com
About this study
The generative artificial intelligence tool, ChatGPT, has garnered widespread interest since its launch. This innovative multimedia platform has the potential to enhance medical communication and health education, thereby improving medical accessibility and reducing the burden on healthcare professionals. Some studies have indicated that ChatGPT achieves higher levels of satisfaction in counseling compared to human healthcare professionals. Additionally, research has shown that ChatGPT's performance in answering objective structured clinical examination questions is comparable to that of typical medical students. However, in both scenarios, it still requires editing by professionals before being used. Moreover, a recent meta-analysis evaluating ChatGPT's ability in various types of medical exams revealed inconsistent results. Before its application and actual integration into clinical practice, the investigators need to comprehend the advantages, disadvantages, and relevant limitations of ChatGPT in the field of medical communication. This study aims to simulate virtual consultations between ChatGPT, acting as a health professional, and study participants, serving as patients. It will evaluate the participants' satisfaction with the virtual consultation questions, categorized by different levels of cognition through Bloom's Taxonomy. This study plans to recruit medical professionals, healthcare-related professionals, medical students from National Taiwan University Hospital, and the general public. Two researchers will select 20 questions from the USMLE step 3 practice tests and the second stage of the Taiwan Medical Licensing Examination. These questions will be categorized into different levels of cognition based on knowledge, comprehension, application, analysis, synthesis, or evaluation. ChatGPT 3.5 and 4.0 will answer these 20 questions without specifying the question's level of cognition. Each participant will review the answers to these 20 questions and assign a satisfaction score based on the appropriateness of each answer.
- Conditions
- Patient Satisfaction
- Being tested
- Answers generated by ChatGPT
- Keywords
- Artificial Intelligence, Decision Making, Shared
- Medical subject headings
- Patient Satisfaction
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Answers generated by ChatGPTOther
Participants will assign a satisfaction score based on the appropriateness of each answer.
| Study group | Role | What they receive |
|---|---|---|
| Medical professionals | Attending physicians of National Taiwan University Hospital Receives: Other: Answers generated by ChatGPT | |
| Healthcare-related professionals | Medical Radiation Technologist of National Taiwan University Hospital Receives: Other: Answers generated by ChatGPT | |
| Medical students | Medical students of National Taiwan University College of Medicine who have passed the first stage of Taiwan Medical Licencing Exam. Receives: Other: Answers generated by ChatGPT | |
| General public | Volunteers from Taiwan Emergency Medical Technician Association Receives: Other: Answers generated by ChatGPT |
What is being measured
The primary outcome is the main question the study is designed to answer.
Correlation between satisfaction and Bloom's taxonomy
Divided by the four participant groups
Measured: baseline (at completion of study questionnaire)
Secondary outcomes (1)
Correctness of answers
Answers from ChatGPT 3.5/4.0 and the answers provided by Medical Licencing Exam institutions
Measured: baseline (at completion of study questionnaire)
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted8 Feb 2024
- Study startFeb 2024 (estimated)
- Primary completionJun 2024 (estimated)
- Study completionJun 2024 (estimated)
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Other trials for Patient SatisfactionStudies of the same condition, open and under way.
- More trials run by National Taiwan University HospitalThe sponsor's other registered studies.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Observational
- Observational model
- Other
- Time perspective
- Prospective
- Enrolment
- 120 participants (estimated)
Sponsor and investigators
- Lead sponsor
- National Taiwan University Hospital
- Sponsor type
- University, hospital or other
- Collaborators
- Taiwan Emergency Medical Technician Association
- Responsible party
- Sponsor
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT06247475
- Sponsor's protocol ID
- 202308059RINB
- Status last verified
- Jan 2024
- First submitted
- 29 Jan 2024
- Last updated
- 16 Feb 2024
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- No: Data would be shared by request.
Study at a glance
From the registry record, last updated by the sponsor on 16 Feb 2024. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Generating Fast and Slow for Entree Level Medical Knowledge
- ClinicalTrials.gov ID
- NCT06247475
- Acronym / sponsor ID
- 202308059RINB
- Conditions
- Patient Satisfaction
- Keywords
- Artificial Intelligence, Decision Making, Shared
- Study type
- Observational
- Recruitment status
- Unknown status
- Enrolment
- 120 participants (estimated)
- Lead sponsor
- National Taiwan University HospitalUniversity, hospital or other
- Collaborators
- Taiwan Emergency Medical Technician Association
- Study start
- Feb 2024 (estimated)
- Primary completion
- Jun 2024 (estimated)
- Study completion
- Jun 2024 (estimated)
- First posted
- 8 Feb 2024 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
The generative artificial intelligence tool, ChatGPT, has garnered widespread interest since its launch. This innovative multimedia platform has the potential to enhance medical communication and health education, thereby improving medical accessibility and reducing the burden on healthcare professionals. Some studies have indicated that ChatGPT achieves higher levels of satisfaction in counseling compared to human healthcare professionals. Additionally, research has shown that ChatGPT's performance in answering objective structured clinical examination questions is comparable to that of typical medical students. However, in both scenarios, it still requires editing by professionals before being used. Moreover, a recent meta-analysis evaluating ChatGPT's ability in various types of medical exams revealed inconsistent results. Before its application and actual integration into clinical practice, the investigators need to comprehend the advantages, disadvantages, and relevant limitations of ChatGPT in the field of medical communication. This study aims to simulate virtual consultations between ChatGPT, acting as a health professional, and study participants, serving as patients. It will evaluate the participants' satisfaction with the virtual consultation questions, categorized by different levels of cognition through Bloom's Taxonomy. This study plans to recruit medical professionals, healthcare-related professionals, medical students from National Taiwan University Hospital, and the general public. Two researchers will select 20 questions from the USMLE step 3 practice tests and the second stage of the Taiwan Medical Licensing Examination. These questions will be categorized into different levels of cognition based on knowledge, comprehension, application, analysis, synthesis, or evaluation. ChatGPT 3.5 and 4.0 will answer these 20 questions without specifying the question's level of cognition. Each participant will review the answers to these 20 questions and assign a satisfaction score based on the appropriateness of each answer.
Study design
- Observational model
- Other
- Time perspective
- Prospective
- Number of arms
- 4
| Arm | Type | Receives |
|---|---|---|
| Medical professionals | – | Other: Answers generated by ChatGPTAttending physicians of National Taiwan University Hospital |
| Healthcare-related professionals | – | Other: Answers generated by ChatGPTMedical Radiation Technologist of National Taiwan University Hospital |
| Medical students | – | Other: Answers generated by ChatGPTMedical students of National Taiwan University College of Medicine who have passed the first stage of Taiwan Medical Licencing Exam. |
| General public | – | Other: Answers generated by ChatGPTVolunteers from Taiwan Emergency Medical Technician Association |
Who may qualify
- Ages
- 18 years and older
- Sex
- All
- Healthy volunteers
- Accepted
- Age groups
- Adult, Older adult
- Study population
- The medical professionals, healthcare-related professionals, and medical students refer to attending physician, medical radiation technologist from National Taiwan University Hospital, and medical students from National Taiwan University College of Medicine, respectively. The general public refer to volunteers from Taiwan Emergency Medical Technician Association.
Key inclusion criteria (6 listed)
- National Taiwan University Hospital
- Taiwan Emergency Medical Technician Association.
Key exclusion criteria (1 listed)
- N/A.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Answers generated by ChatGPTParticipants will assign a satisfaction score based on the appropriateness of each answer. | Other | General public, Healthcare-related professionals, Medical professionals, Medical students |
Primary outcome
Correlation between satisfaction and Bloom's taxonomy
Time frame: baseline (at completion of study questionnaire)
Divided by the four participant groups
1 secondary outcome
Correctness of answers
Time frame: baseline (at completion of study questionnaire)
Results and safety
Results are not available in the source record.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 16 Feb 2024.
- Individual participant dataSharing planned: No. Data would be shared by request.
Related trials for Patient Satisfaction
RecruitingObservational study
Non-interventional Study of Subcutaneous Ocrelizumab in Persons With Relapsing-Remitting Multiple Sclerosis
Relapsing-Remitting Multiple Sclerosis
Not yet recruiting
Efficacy, Safety, and Treatment Satisfaction of Once-Weekly Tirzepatide in Obese Type 2 Diabetic Patients
Type 2 Diabetes Mellitus (T2DM), Obesity, Overweight
RecruitingObservational study
Patient Satisfaction Following Multidisciplinary Cancer Care Assessment in Day Hospital.
Patient Satisfaction, Cancer
Active, not recruiting
PREWELL Digital Well-being Promotion Intervention With the BitHabit App
General Mental Health and Well-Being, Mental Disorders
Active, not recruitingPhase 4
Comparison of Two Timings of Levothyroxine Intake in Hypothyroid Patients: A Cross-over Randomized Control Trial
Hypothyroidism Primary
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
An observational study of Patient Satisfaction, run by National Taiwan University Hospital at 1 site in Taiwan.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 6 inclusion and 1 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: status not confirmed, as of the sponsor's last update on 16 Feb 2024. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in Taiwan. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
Results are not available in the source record.
How can a doctor refer a patient or contact the research team?
Each site lists its own contact: choose the nearest one under Trial locations. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Correlation between satisfaction and Bloom's taxonomy (time frame: baseline (at completion of study questionnaire)). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 16 Feb 2024.