Preoperative CareNCT05945004
ChatGPT v.s. Human in Writing a Preoperative Visit Sheet
An observational study of Preoperative Care, run by Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd..
Trial summary
The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are: Can large language models read clinical records and make preoperative visit sheets same as physicians? Can physicians… Read more about this study
- Who is it for?
- Any age
- Conditions the study is for
- Preoperative Care
- What is being tested?
- ChatGPT-4 and Clinician
- How many people
- 120 participants
- Where
- No sites listed yet
- Study dates
- 1 Aug 2023to 1 Sep 2023
- Phase
- Observational
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages Any age
- All sexes
- No healthy volunteers
- Child, Adult, Older adult
Study population: No restictions are applied to population.
Who may be able to join
- Any as records are generated using ChatGPT-4.
Who cannot join
- Any as records are generated using ChatGPT-4.
About this study
Official title: Using Natural Language Processing Models for Writing Preoperative Visit Sheets: a Preliminary Study Comparing ChatGPT and Clinicians
The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:
- Can large language models read clinical records and make preoperative visit sheets same as physicians?
- Can physicians distinguish preoperative visit sheets made by physicians and models?
Read more
Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively.
A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.
- Conditions
- Preoperative Care
- Being tested
- ChatGPT-4, Clinician
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
ChatGPT-4Other
Subjects' clinical records will be read by ChatGPT-4 to write preoperative visit sheets.
ClinicianOther
Subjects' clinical records will be read by clinicians to write preoperative visit sheets.
| Study group | Role | What they receive |
|---|---|---|
| Experiment | Not described Receives: Other: ChatGPT-4 | |
| Control | Not described Receives: Other: Clinician |
What is being measured
The primary outcome is the main question the study is designed to answer.
Familiarity to human writing
Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".
Measured: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
Satisfaction for clinical use
A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.
Measured: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted14 Jul 2023
- Study start1 Aug 2023 (estimated)
- Primary completion15 Aug 2023 (estimated)
- Study completion1 Sep 2023 (estimated)
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Other trials for Preoperative CareStudies of the same condition, open and under way.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Observational
- Observational model
- Cohort
- Time perspective
- Cross-sectional
- Enrolment
- 120 participants (estimated)
Sponsor and investigators
- Lead sponsor
- Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.
- Sponsor type
- Industry (pharma, biotech, devices)
- Collaborators
- Tsinghua University
- Responsible party
- Sponsor
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT05945004
- Sponsor's protocol ID
- US2023002
- Status last verified
- Jul 2023
- First submitted
- 30 Jun 2023
- Last updated
- 14 Jul 2023
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
Study at a glance
From the registry record, last updated by the sponsor on 14 Jul 2023. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Using Natural Language Processing Models for Writing Preoperative Visit Sheets: a Preliminary Study Comparing ChatGPT and Clinicians
- ClinicalTrials.gov ID
- NCT05945004
- Acronym / sponsor ID
- US2023002
- Conditions
- Preoperative Care
- Study type
- Observational
- Recruitment status
- Unknown status
- Enrolment
- 120 participants (estimated)
- Lead sponsor
- Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.Industry (pharma, biotech, devices)
- Collaborators
- Tsinghua University
- Study start
- 1 Aug 2023 (estimated)
- Primary completion
- 15 Aug 2023 (estimated)
- Study completion
- 1 Sep 2023 (estimated)
- First posted
- 14 Jul 2023 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:
- Can large language models read clinical records and make preoperative visit sheets same as physicians?
- Can physicians distinguish preoperative visit sheets made by physicians and models?
Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively.
A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.
Study design
- Observational model
- Cohort
- Time perspective
- Cross-sectional
- Number of arms
- 2
| Arm | Type | Receives |
|---|---|---|
| Experiment | – | Other: ChatGPT-4 |
| Control | – | Other: Clinician |
Who may qualify
- Sex
- All
- Healthy volunteers
- Not accepted
- Age groups
- Child, Adult, Older adult
- Study population
- No restictions are applied to population.
Key inclusion criteria (1 listed)
- Any as records are generated using ChatGPT-4.
Key exclusion criteria (1 listed)
- Any as records are generated using ChatGPT-4.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| ChatGPT-4Subjects' clinical records will be read by ChatGPT-4 to write preoperative visit sheets. | Other | Experiment |
| ClinicianSubjects' clinical records will be read by clinicians to write preoperative visit sheets. | Other | Control |
Primary outcome
Familiarity to human writing
Time frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".
Satisfaction for clinical use
Time frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.
Results and safety
Results are not available in the source record.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 14 Jul 2023.
Related trials for Preoperative Care
RecruitingObservational study
Vascular Events In Patients Undergoing Same-day Noncardiac Surgery (VALIANCE) Study
Preoperative Care, Surgery--Complications
Recruiting
Pharyngeal Mucosal Conditioning to Prevent Postoperative Sore Throat in Septoplasty Patients With Severe Nasal Obstruction
Postoperative Sore Throat, Nasal Obstruction
RecruitingObservational study
Preoperative Anxiety and One-year Patient-reported Outcomes in Orthopedic Surgery Patients Receiving Enhanced Recovery After Surgery or Conventional Care
Preoperative Anxiety, Orthopedic Surgery
Recruiting
Evaluating the Feasibility of Prehabilitation Delivery Models for Patients Preparing for Gynecologic Cancer Surgery
Prehabilitation, Preoperative Aerobic Training
Recruiting
Intermittent Fasting Versus Carbohydrate Drinks Before Surgery
Perioperative Care, Intermittent Fasting
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
The record lists no contact. Use the official record to reach the sponsor.
Questions about this trial
What is this clinical trial studying?
An observational study of Preoperative Care, run by Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd..
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 1 inclusion and 1 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: status not confirmed, as of the sponsor's last update on 14 Jul 2023. Status can change between updates, so confirm with the study contact before making plans.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
Results are not available in the source record.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Familiarity to human writing (time frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.). The study lists 2 primary outcomes in all. It is what the study was designed to measure, not a finding.
Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 14 Jul 2023.