Patient SatisfactionNCT07111845
Human Doctors or AI: Evaluating Patient Satisfaction in Urinary Stone Disease Consultations
A study testing Medical Consultation in people with Patient Satisfaction, run by Abant Izzet Baysal University at 1 site in Turkey (Türkiye).
Trial summary
The goal of this observational study is to understand how satisfied patients are after getting medical advice about urinary stone disease from either a real doctor or an artificial intelligence (AI) chatbot. Read more about this study
- Who is it for?
- Ages 18 years and older
- Conditions the study is for
- Patient Satisfaction
- What is being tested?
- Medical Consultation
- Type of treatment
- Lifestyle or therapy programme
- Could I receive a placebo?
- No, everyone receives an active treatment
- How many people
- 100 participants
- Where
- 1 siteTurkey (Türkiye)
- Study dates
- 1 Jan 2025to 30 May 2025
- Phase
- Interventional
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 years and older
- All sexes
- No healthy volunteers
- Adult, Older adult
Who may be able to join
- Newly diagnosed with urinary stone disease,
- Aged 18 years or older,
- Provided written informed consent to participate in the study.
Who cannot join
- History of previous urinary stone disease, stone-related procedures,
- Presence of other acute medical conditions unrelated to urinary stone disease,
- Cognitive or communication impairments,
- Pregnancy.
Trial locations and contacts
1 site in 1 country.
Turkey (Türkiye)1 site
İzzet Baysal Eğitim ve Araştırma Hastanesi
Bolu, 14030
About this study
The goal of this observational study is to understand how satisfied patients are after getting medical advice about urinary stone disease from either a real doctor or an artificial intelligence (AI) chatbot. We want to learn whether people feel more satisfied with the information and support they get from human doctors or from AI tools like ChatGPT, Gemini, Perplexity, or Copilot.
The main questions it aims to answer are:
Read more
- Are patients more satisfied after consulting a real doctor or an AI chatbot?
- Does the time spent in the consultation affect satisfaction?
Researchers will compare doctor consultations with consultations from different AI chatbots to see if there are differences in patient satisfaction.
Participants will:
- Ask all their medical questions about urinary stones to one of the sources (a doctor or a specific AI chatbot)
- Fill out a short questionnaire (CSQ-8) to rate how satisfied they felt with the answers they received
- Conditions
- Patient Satisfaction
- Being tested
- Medical Consultation
- Keywords
- AI in healthcare, chatbot consultations, patient experience, urinary stone disease, digital medicine
- Medical subject headings
- Patient Satisfaction
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Medical ConsultationBehavioural
Participants will be randomly assigned to receive medical consultation about urinary stone disease from one of five sources: a real urologist (in-person) or one of four AI chatbots (ChatGPT, Gemini, Perplexity, or Microsoft Copilot). Each participant will be instructed to ask all their questions related to urinary stone disease and continue the consultation until they feel adequately informed. The consultation format (human vs. AI) will depend on group assignment. After the session, participants will complete a validated satisfaction questionnaire (CSQ-8) to assess their experience.
| Study group | Role | What they receive |
|---|---|---|
| Doctors Group | Experimental | Participants consult a real urologist. Receives: Behavioral: Medical Consultation |
| ChatGPT Group | Experimental | Participants ask all questions to ChatGPT. Receives: Behavioral: Medical Consultation |
| Gemini Group | Experimental | Participants ask all questions to Gemini. Receives: Behavioral: Medical Consultation |
| Perplexity Group | Experimental | Participants ask all questions to Perplexity. Receives: Behavioral: Medical Consultation |
| Copilot Group | Experimental | Participants ask all questions to Microsoft Copilot. Receives: Behavioral: Medical Consultation |
What is being measured
The primary outcome is the main question the study is designed to answer.
Patient Satisfaction Score
Patient satisfaction will be measured using the validated Client Satisfaction Questionnaire (CSQ-8), which consists of 8 items scored on a 4-point Likert scale. The total score ranges from 8 to 32, with higher scores indicating greater satisfaction.
Measured: Within 1 hour after the consultation
Secondary outcomes (1)
Consultation Duration
Total duration (in minutes) of the consultation session (doctor or chatbot) will be recorded and compared across all groups.
Measured: During consultation
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted8 Aug 2025
- Study start1 Jan 2025
- Primary completion20 May 2025
- Study completion30 May 2025
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Publications (4)Papers the sponsor has linked to this study.
- Other trials for Patient SatisfactionStudies of the same condition, open and under way.
- More trials run by Abant Izzet Baysal UniversityThe sponsor's other registered studies.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Interventional
- Phase
- Phase N/A
- Primary purpose
- Health services research
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Masking
- None (open label)
- Enrolment
- 100 participants (actual)
Sponsor and investigators
- Lead sponsor
- Abant Izzet Baysal University
- Sponsor type
- University, hospital or other
- Responsible party
- Principal investigator, H. Alperen YILDIZ, Abant Izzet Baysal University
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT07111845
- Sponsor's protocol ID
- 20243209
- Status last verified
- Aug 2025
- First submitted
- 25 Jul 2025
- Last updated
- 8 Aug 2025
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- No: The data generated and analysed during the current study are not publicly available due to ethical and privacy concerns but are available from the corresponding author on reasonable request.
Publications
Whiles BB, Bird VG, Canales BK, DiBianco JM, Terry RS. Caution! AI Bot Has Entered the Patient Chat: ChatGPT Has Limitations in Providing Accurate Urologic Healthcare Advice. Urology. 2023 Oct;180:278-284. doi: 10.1016/j.urology.2023.07.010. Epub 2023 Jul 17.
PubMed 37467806Hanci V, Ergun B, Gul S, Uzun O, Erdemir I, Hanci FB. Assessment of readability, reliability, and quality of ChatGPT(R), BARD(R), Gemini(R), Copilot(R), Perplexity(R) responses on palliative care. Medicine (Baltimore). 2024 Aug 16;103(33):e39305. doi: 10.1097/MD.0000000000039305.
PubMed 39151545Simon BD, Gelikman DG, Turkbey B. Evaluating the efficacy of artificial intelligence chatbots in urological health: insights for urologists on patient interactions with large language models. Transl Androl Urol. 2024 May 31;13(5):879-883. doi: 10.21037/tau-23-635. Epub 2024 May 7. No abstract available.
PubMed 38855603Yildiz HA. Human Doctors or AI? Evaluating Patient Satisfaction in Urinary Stone Disease Consultations. J Surg Res. 2026 Jan;317:181-188. doi: 10.1016/j.jss.2025.11.026. Epub 2025 Dec 11.
PubMed 41385971
Study at a glance
From the registry record, last updated by the sponsor on 8 Aug 2025. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Human Doctors or AI: Evaluating Patient Satisfaction in Urinary Stone Disease Consultations
- ClinicalTrials.gov ID
- NCT07111845
- Acronym / sponsor ID
- 20243209
- Conditions
- Patient Satisfaction
- Keywords
- AI in healthcare, chatbot consultations, patient experience, urinary stone disease, digital medicine
- Study type
- Interventional
- Recruitment status
- Completed
- Enrolment
- 100 participants (actual)
- Lead sponsor
- Abant Izzet Baysal UniversityUniversity, hospital or other
- Study start
- 1 Jan 2025 (actual)
- Primary completion
- 20 May 2025 (actual)
- Study completion
- 30 May 2025 (actual)
- First posted
- 8 Aug 2025 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
The goal of this observational study is to understand how satisfied patients are after getting medical advice about urinary stone disease from either a real doctor or an artificial intelligence (AI) chatbot. We want to learn whether people feel more satisfied with the information and support they get from human doctors or from AI tools like ChatGPT, Gemini, Perplexity, or Copilot.
The main questions it aims to answer are:
- Are patients more satisfied after consulting a real doctor or an AI chatbot?
- Does the time spent in the consultation affect satisfaction?
Researchers will compare doctor consultations with consultations from different AI chatbots to see if there are differences in patient satisfaction.
Participants will:
- Ask all their medical questions about urinary stones to one of the sources (a doctor or a specific AI chatbot)
- Fill out a short questionnaire (CSQ-8) to rate how satisfied they felt with the answers they received
Study design
- Primary purpose
- Health services research
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Masking
- None (open label)
- Number of arms
- 5
| Arm | Type | Receives |
|---|---|---|
| Doctors Group | Experimental | Behavioral: Medical ConsultationParticipants consult a real urologist. |
| ChatGPT Group | Experimental | Behavioral: Medical ConsultationParticipants ask all questions to ChatGPT. |
| Gemini Group | Experimental | Behavioral: Medical ConsultationParticipants ask all questions to Gemini. |
| Perplexity Group | Experimental | Behavioral: Medical ConsultationParticipants ask all questions to Perplexity. |
| Copilot Group | Experimental | Behavioral: Medical ConsultationParticipants ask all questions to Microsoft Copilot. |
Who may qualify
- Ages
- 18 years and older
- Sex
- All
- Healthy volunteers
- Not accepted
- Age groups
- Adult, Older adult
Key inclusion criteria (3 listed)
- Newly diagnosed with urinary stone disease,
- Aged 18 years or older,
- Provided written informed consent to participate in the study.
Key exclusion criteria (4 listed)
- History of previous urinary stone disease, stone-related procedures,
- Presence of other acute medical conditions unrelated to urinary stone disease,
- Cognitive or communication impairments,
- Pregnancy.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Medical ConsultationParticipants will be randomly assigned to receive medical consultation about urinary stone disease from one of five sources: a real urologist (in-person) or one of four AI chatbots (ChatGPT, Gemini, Perplexity, or Microsoft Copilot). Each participant will be instructed to ask all their questions related to urinary stone disease and continue the consultation until they feel adequately informed. The consultation format (human vs. AI) will depend on group assignment. After the session, participants will complete a validated satisfaction questionnaire (CSQ-8) to assess their experience. | Behavioural | ChatGPT Group, Copilot Group, Doctors Group, Gemini Group, Perplexity Group |
Primary outcome
Patient Satisfaction Score
Time frame: Within 1 hour after the consultation
Patient satisfaction will be measured using the validated Client Satisfaction Questionnaire (CSQ-8), which consists of 8 items scored on a 4-point Likert scale. The total score ranges from 8 to 32, with higher scores indicating greater satisfaction.
1 secondary outcome
Consultation Duration
Time frame: During consultation
Results and safety
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 8 Aug 2025.
- Results publication: PubMed 37467806Whiles BB, Bird VG, Canales BK, DiBianco JM, Terry RS. Caution! AI Bot Has Entered the Patient Chat: ChatGPT Has Limitations in Providing Accurate Urologic Healthcare Advice. Urology. 2023 Oct;180:278-284. doi: 10.1016/j.urology.2023.07.010. Epub 2023 Jul 17.
- Results publication: PubMed 39151545Hanci V, Ergun B, Gul S, Uzun O, Erdemir I, Hanci FB. Assessment of readability, reliability, and quality of ChatGPT(R), BARD(R), Gemini(R), Copilot(R), Perplexity(R) responses on palliative care. Medicine (Baltimore). 2024 Aug 16;103(33):e39305. doi: 10.1097/MD.0000000000039305.
- Results publication: PubMed 38855603Simon BD, Gelikman DG, Turkbey B. Evaluating the efficacy of artificial intelligence chatbots in urological health: insights for urologists on patient interactions with large language models. Transl Androl Urol. 2024 May 31;13(5):879-883. doi: 10.21037/tau-23-635. Epub 2024 May 7. No abstract available.
- Derived from this study: PubMed 41385971Yildiz HA. Human Doctors or AI? Evaluating Patient Satisfaction in Urinary Stone Disease Consultations. J Surg Res. 2026 Jan;317:181-188. doi: 10.1016/j.jss.2025.11.026. Epub 2025 Dec 11.
- Individual participant dataSharing planned: No. The data generated and analysed during the current study are not publicly available due to ethical and privacy concerns but are available from the corresponding author on reasonable request.
Related trials for Patient Satisfaction
Recruiting
The Effect of Virtual Reality Headsets on Pain, Anxiety, Patient Satisfaction, and Physiological Parameters in Patients Undergoing Open-Heart Surgery
Pain After Surgery, Pain and Anxiety
RecruitingObservational study
Patient Needs and Preferences for NSCL Cancer Treatment Monitoring
Lung Cancer (NSCLC)
Not yet recruiting
The Impact of Equine-Assisted Therapy on Mental Health and Addictive Behaviors in Patients Receiving Addiction Treatment
Equine-assisted Therapy, Addiction
RecruitingObservational study
Non-interventional Study of Subcutaneous Ocrelizumab in Persons With Relapsing-Remitting Multiple Sclerosis
Relapsing-Remitting Multiple Sclerosis
Active, not recruiting
PREWELL Digital Well-being Promotion Intervention With the BitHabit App
General Mental Health and Well-Being, Mental Disorders
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
The record lists no contact. Use the official record to reach the sponsor.
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
A study testing Medical Consultation in people with Patient Satisfaction, run by Abant Izzet Baysal University at 1 site in Turkey (Türkiye).
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 3 inclusion and 4 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 8 Aug 2025. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in Turkey (Türkiye). Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Patient Satisfaction Score (time frame: Within 1 hour after the consultation). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
On the ClinicalTrials.gov record for NCT07111845, which also lists 4 linked publications.
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 8 Aug 2025.