StutteringNCT07835347
Large Language Models for Stuttering Assessment and Therapy
An observational study of Stuttering, run by Istanbul Gelisim University at 1 site in Turkey (Türkiye).
Trial summary
This observational study aims to compare the quality of responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to questions about stuttering. The study focuses on three main areas: general information about stuttering, clinical assessment, and therapy. Read more about this study
- Who is it for?
- Ages 18 years and olderHealthy volunteers can take part
- Conditions the study is for
- Stuttering
- What is being tested?
- ChatGPT-Generated Responses, Claude-Generated Responses and Google Gemini-Generated Responses
- How many people
- 5 participants
- Where
- 1 siteTurkey (Türkiye)
- Study dates
- 7 Aug 2026to 6 Sep 2026
- Phase
- Observational
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 years and older
- All sexes
- Healthy volunteers accepted
- Adult, Older adult
Study population: The study population consisted of adult speech-language therapists in Türkiye who were actively working in the field of stuttering and fluency disorders. Five speech-language therapists with clinical experience in stuttering were purposively selected to independently evaluate responses generated by four large language models to standardized questions concerning stuttering information, assessment, and therapy.
Who may be able to join
- Having an undergraduate or postgraduate degree in speech and language therapy.
- Actively practicing clinically in the field of stuttering/fluency disorders.
- Voluntarily agreeing to participate in the study.
- Completing the evaluation form in full.
Who cannot join
- Not having active clinical experience in the field of stuttering.
- Incomplete completion of the evaluation form.
- Withdrawal of voluntary participation during the evaluation process.
Trial locations and contacts
1 site in 1 country.
Turkey (Türkiye)1 site
Istanbul Gelisim University
Istanbul, Istanbul, 34310
About this study
Official title: Alignment of Large Language Model Responses on Stuttering Definition, Assessment, and Therapy With Clinical Practice Guidelines: A Multi-Model Comparison
This observational study aims to compare the quality of responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to questions about stuttering. The study focuses on three main areas: general information about stuttering, clinical assessment, and therapy. A total of nine questions were developed based on evidence-based clinical practice guidance, including the American Speech-Language-Hearing Association (ASHA) Practice Portal. Each question is presented to each language model in separate sessions, and the generated responses are recorded for evaluation.
Five speech-language therapists with clinical experience in stuttering independently evaluate the model-generated responses. Each response is rated for relevance, accuracy, clarity, completeness, and consistency using a 5-point Likert scale. The responses are also compared with guideline-based reference information. The study does not involve any clinical intervention or treatment of patients. The aim is to determine how closely large language model responses align with current clinical practice guidance and to identify their potential strengths and limitations when used as informational or clinical support tools in the field of stuttering.
- Conditions
- Stuttering
- Being tested
- ChatGPT-Generated Responses, Claude-Generated Responses, Google Gemini-Generated Responses, Grok-4.20-Generated Responses
- Medical subject headings
- Stuttering
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
ChatGPT-Generated ResponsesOther
ChatGPT responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency.
Claude-Generated ResponsesOther
Claude responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency.
Google Gemini-Generated ResponsesOther
Google Gemini responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency.
Grok-4.20-Generated ResponsesOther
Grok-4.20 responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency.
| Study group | Role | What they receive |
|---|---|---|
| Expert Speech-Language Therapists | Five speech-language therapists with clinical experience in stuttering independently evaluated responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20). The responses addressed nine questions covering general information about stuttering, clinical assessment, and therapy. Each response was rated for relevance, accuracy, clarity, completeness, and consistency using a 5-point Likert scale. Receives: Other: ChatGPT-Generated Responses; Other: Claude-Generated Responses; Other: Google Gemini-Generated Responses; Other: Grok-4.20-Generated Responses |
What is being measured
The primary outcome is the main question the study is designed to answer.
Expert-Rated Quality of Large Language Model Responses
Responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to nine standardized questions about stuttering were independently evaluated by five speech-language therapists with clinical experience in stuttering. Each response was rated using a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree) across five criteria: relevance, accuracy, clarity, completeness, and consistency. Responses were evaluated against guideline-based reference information derived from evidence-based clinical practice guidance. Higher scores indicate better response quality and closer alignment with clinical practice guidance. Mean scores were calculated for each large language model and each evaluation criterion.
Measured: During the single cross-sectional expert evaluation conducted over approximately 1 month
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted22 Sep 2026
- Study start7 Aug 2026
- Primary completion6 Sep 2026
- Study completion6 Sep 2026
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Other trials for StutteringStudies of the same condition, open and under way.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Observational
- Observational model
- Other
- Time perspective
- Cross-sectional
- Enrolment
- 5 participants (actual)
Sponsor and investigators
- Lead sponsor
- Istanbul Gelisim University
- Sponsor type
- University, hospital or other
- Responsible party
- Principal investigator, Esra EROL, Istanbul Gelisim University
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT07835347
- Sponsor's protocol ID
- LLM-STUTTER-2026
- Status last verified
- Sep 2026
- First submitted
- 17 Sep 2026
- Last updated
- 22 Sep 2026
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
Study at a glance
From the registry record, last updated by the sponsor on 22 Sep 2026. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Alignment of Large Language Model Responses on Stuttering Definition, Assessment, and Therapy With Clinical Practice Guidelines: A Multi-Model Comparison
- ClinicalTrials.gov ID
- NCT07835347
- Acronym / sponsor ID
- LLM-STUTTER-2026
- Conditions
- Stuttering
- Study type
- Observational
- Recruitment status
- Completed
- Enrolment
- 5 participants (actual)
- Lead sponsor
- Istanbul Gelisim UniversityUniversity, hospital or other
- Study start
- 7 Aug 2026 (actual)
- Primary completion
- 6 Sep 2026 (actual)
- Study completion
- 6 Sep 2026 (actual)
- First posted
- 22 Sep 2026 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
This observational study aims to compare the quality of responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to questions about stuttering. The study focuses on three main areas: general information about stuttering, clinical assessment, and therapy. A total of nine questions were developed based on evidence-based clinical practice guidance, including the American Speech-Language-Hearing Association (ASHA) Practice Portal. Each question is presented to each language model in separate sessions, and the generated responses are recorded for evaluation.
Five speech-language therapists with clinical experience in stuttering independently evaluate the model-generated responses. Each response is rated for relevance, accuracy, clarity, completeness, and consistency using a 5-point Likert scale. The responses are also compared with guideline-based reference information. The study does not involve any clinical intervention or treatment of patients. The aim is to determine how closely large language model responses align with current clinical practice guidance and to identify their potential strengths and limitations when used as informational or clinical support tools in the field of stuttering.
Study design
- Observational model
- Other
- Time perspective
- Cross-sectional
- Number of arms
- 1
| Arm | Type | Receives |
|---|---|---|
| Expert Speech-Language Therapists | – | Other: ChatGPT-Generated Responses, Other: Claude-Generated Responses, Other: Google Gemini-Generated Responses, Other: Grok-4.20-Generated ResponsesFive speech-language therapists with clinical experience in stuttering independently evaluated responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20). The responses addressed nine questions covering general information about stuttering, clinical assessment, and therapy. Each response was rated for relevance, accuracy, clarity, completeness, and consistency using a 5-point Likert scale. |
Who may qualify
- Ages
- 18 years and older
- Sex
- All
- Healthy volunteers
- Accepted
- Age groups
- Adult, Older adult
- Study population
- The study population consisted of adult speech-language therapists in Türkiye who were actively working in the field of stuttering and fluency disorders. Five speech-language therapists with clinical experience in stuttering were purposively selected to independently evaluate responses generated by four large language models to standardized questions concerning stuttering information, assessment, and therapy.
Key inclusion criteria (4 listed)
- Having an undergraduate or postgraduate degree in speech and language therapy.
- Actively practicing clinically in the field of stuttering/fluency disorders.
- Voluntarily agreeing to participate in the study.
- Completing the evaluation form in full.
Key exclusion criteria (3 listed)
- Not having active clinical experience in the field of stuttering.
- Incomplete completion of the evaluation form.
- Withdrawal of voluntary participation during the evaluation process.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| ChatGPT-Generated ResponsesChatGPT responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. | Other | Expert Speech-Language Therapists |
| Claude-Generated ResponsesClaude responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. | Other | Expert Speech-Language Therapists |
| Google Gemini-Generated ResponsesGoogle Gemini responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. | Other | Expert Speech-Language Therapists |
| Grok-4.20-Generated ResponsesGrok-4.20 responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. | Other | Expert Speech-Language Therapists |
Primary outcome
Expert-Rated Quality of Large Language Model Responses
Time frame: During the single cross-sectional expert evaluation conducted over approximately 1 month
Responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to nine standardized questions about stuttering were independently evaluated by five speech-language therapists with clinical experience in stuttering. Each response was rated using a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree) across five criteria: relevance, accuracy, clarity, completeness, and consistency. Responses were evaluated against guideline-based reference information derived from evidence-based clinical practice guidance. Higher scores indicate better response quality and closer alignment with clinical practice guidance. Mean scores were calculated for each large language model and each evaluation criterion.
Results and safety
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 22 Sep 2026.
Related trials for Stuttering
Recruiting
Using Non-invasive Brain Stimulation to Explore Potential Treatments to Reduce Speech Errors in Adults Who Stutter
Stuttering, Fluency Disorder
Recruiting
Network Connectivity and Temporal Processing in Adolescents Who Stutter
Stuttering, Childhood, Stuttering
Recruiting
Transcranial Alternating Current Stimulation (tACS) in Stuttering
Stuttering, Adult, Stuttering, Childhood
Not yet recruiting
Effectiveness of Virtually Simulated Intervention for Patients Having Stuttering
Stuttering
Not yet recruiting
Development and Pilot Testing of Virtually Simulated Intervention for Patients Having Stuttering
Stuttering
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
The record lists no contact. Use the official record to reach the sponsor.
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
An observational study of Stuttering, run by Istanbul Gelisim University at 1 site in Turkey (Türkiye).
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 4 inclusion and 3 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 22 Sep 2026. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in Turkey (Türkiye). Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Expert-Rated Quality of Large Language Model Responses (time frame: During the single cross-sectional expert evaluation conducted over approximately 1 month). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 22 Sep 2026.