Vaccination HesitancyNCT05424952
The Effectiveness of Conversational AI Service (Chatbot) Utilization on Vaccine Confidence
A study testing Conversational AI Service (Chatbot) in people with Vaccination Hesitancy, run by The University of Hong Kong at 3 sites in 3 countries.
Trial summary
The primary objective of this study is to develop and evaluate a conversational AI service (chatbot) on social media platforms to obtain accurate and up-to-date vaccine information, and assess the impact of chatbot usage on users' vaccine confidence and acceptance in Hong Kong, Singapore, and Thailand. Read more about this study
- Who is it for?
- Ages 18 years and olderHealthy volunteers can take part
- Conditions the study is for
- Vaccination Hesitancy
- What is being tested?
- Conversational AI Service (Chatbot)
- Type of treatment
- Vaccines
- Could I receive a placebo?
- No, everyone receives an active treatment
- How many people
- 1,000 participants
- Where
- 3 sitesin 3 countries
- Study dates
- 11 Feb 2022to 17 Feb 2023
- Phase
- Interventional
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 years and older
- All sexes
- Healthy volunteers accepted
- Adult, Older adult
Who may be able to join
- Hong Kong adult residents (English or Chinese users) with (a) unvaccinated senior parents/grandparents aged 60 (including those who received first dose after the announcement of the COVID passport on 4th of January) or (b) unvaccinated children aged below 18.
- Thailand adult residents (Thai users) with (a) unvaccinated senior parents/grandparents aged 60 or above or (b) unvaccinated children aged below 18.
- Singapore adult residents (English or Chinese users) with unvaccinated children aged between 5 to 11 years old.
Who cannot join
- People who do not meet the inclusion criteria.
Trial locations and contacts
3 sites in 3 countries.
3 sites in 3 countries
About this study
The primary objective of this study is to develop and evaluate a conversational AI service (chatbot) on social media platforms to obtain accurate and up-to-date vaccine information, and assess the impact of chatbot usage on users' vaccine confidence and acceptance in Hong Kong, Singapore, and Thailand.
Read the detailed description
The investigators will focus on vulnerable seniors and/or children from Hong Kong, Singapore and Thailand who have refused or delayed COVID-19 vaccination. Participants will be recruited by an online panel to meet the target quota by age and sex. Participants will then be randomly assigned to the intervention group and the control group. For both intervention and control groups, evaluation questionnaires will be given out to the study participants asking questions about their demographics, including age, sex, educational level, employment status and household income levels. Participants will then answer questions regarding COVID-19 vaccine confidence, including the effectiveness and safety of vaccines, and the motivations of the policymakers who decided on the needed vaccines. Participants will be asked about COVID-19 vaccine acceptance including the intention to receive COVID-19 vaccines, make plans to receive COVID-19 vaccines, and receive at least one dose of COVID-19 vaccines. The intervention group will then be asked to use the chatbot developed by the research team for up to two weeks. The chatbot is developed under the RE-AIM framework for formative, impact, and process evaluation of the intervention. The control group will have no exposure to the chatbot.
The chatbot will be supported with data from 1) social listening analytics for monitoring local real-time discourses in the digital space on COVID-19 vaccine hesitancy and misinformation, and 2) formative, baseline, and endpoint evaluation, which will generate evidence for development and improvement/refinement.
- Conditions
- Vaccination Hesitancy
- Being tested
- Conversational AI Service (Chatbot)
- Medical subject headings
- Vaccination Hesitancy
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Conversational AI Service (Chatbot)Other
WhatsApp or Messenger Chatbot for COVID-19 vaccines
| Study group | Role | What they receive |
|---|---|---|
| Control | No intervention | Eligible adults with unvaccinated senior parents/grandparents or children. |
| Intervention | Experimental | Eligible adults with unvaccinated senior parents/grandparents or children. Receives: Other: Conversational AI Service (Chatbot) |
What is being measured
The primary outcome is the main question the study is designed to answer.
Covid-19 vaccines confidence Index
- "Overall, I think COVID-19 vaccines are important for children/senior parents (or grandparents)"
- "Overall, I think COVID-19 vaccines are safe for children/parents (or grandparents)"
- "Overall, I think COVID-19 vaccines are effective for children/parents (or grandparents)"
The response is a 5-point Likert scale: (a) Strongly agree (b)Tend to agree (c) Do not know (d) Tend to disagree (e) Strongly disagree
Measured: 1 week
Covid-19 vaccines acceptance
- What is the vaccination status of your children/senior parents (or grandparents) as of now?
- Is vaccinated with at least the first dose of the vaccine
- Has made an appointment but has not been vaccinated with the first dose yet
- Has not made an appointment but will get the vaccine.
- Has no plan to get vaccinated anytime soon.
- Do you want your children/senior parents (or grandparents) vaccinated against COVID-19 if vaccination is indicated and available for them?
- Yes, definitely.
- Unsure, but leaning towards yes.
- Unsure, but leaning towards no.
- No, definitely not.
Measured: 1 week
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted21 Jun 2022
- Study start11 Feb 2022
- Primary completion17 Feb 2023
- Study completion17 Feb 2023
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Publications (18)Papers the sponsor has linked to this study.
- Other trials for Vaccination HesitancyStudies of the same condition, open and under way.
- More trials run by The University of Hong KongThe sponsor's other registered studies.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Interventional
- Phase
- Phase N/A
- Primary purpose
- Health services research
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Masking
- Double blind
- Who is masked
- Participant, Investigator
- Enrolment
- 1,000 participants (actual)
Sponsor and investigators
- Lead sponsor
- The University of Hong Kong
- Sponsor type
- University, hospital or other
- Collaborators
- National University of Singapore, Health Intervention and Technology Assessment Program (HITAP)
- Responsible party
- Principal investigator, Joseph Tsz Kei Wu, The University of Hong Kong
- Investigators
- Joseph T Wu, PhD, Principal investigator, The University of Hong Kong
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT05424952
- Sponsor's protocol ID
- UW 21-659
- Status last verified
- Dec 2024
- First submitted
- 21 Dec 2021
- Last updated
- 6 Dec 2024
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- Yes: Individual participant data that underlie the results reported in the article, after de-identification (text, tables, figures, and appendices), will be shared. A written data-sharing request for meta-analysis should be submitted by email with a methodologically sound proposal. Proposals should be directed to kathysleung@connect.hku.hk; to gain access, data requestors will need to sign a data access agreement.
Publications
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999 Sep;89(9):1322-7. doi: 10.2105/ajph.89.9.1322.
PubMed 10474547Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013 Jun;103(6):e38-46. doi: 10.2105/AJPH.2013.301299. Epub 2013 Apr 18.
PubMed 23597377Kobayashi T, Nishina Y, Tomoi H, et al. Corowa-kun: Impact of a COVID-19 vaccine information chatbot on vaccine hesitancy, Japan 2021. medRxiv 2021: 2021.05.26.21257854.
de Figueiredo A, Simas C, Karafillakis E, Paterson P, Larson HJ. Mapping global trends in vaccine confidence and investigating barriers to vaccine uptake: a large-scale retrospective temporal modelling study. Lancet. 2020 Sep 26;396(10255):898-908. doi: 10.1016/S0140-6736(20)31558-0. Epub 2020 Sep 10.
PubMed 32919524Larson HJ, Smith DM, Paterson P, Cumming M, Eckersberger E, Freifeld CC, Ghinai I, Jarrett C, Paushter L, Brownstein JS, Madoff LC. Measuring vaccine confidence: analysis of data obtained by a media surveillance system used to analyse public concerns about vaccines. Lancet Infect Dis. 2013 Jul;13(7):606-613. doi: 10.1016/S1473-3099(13)70108-7. Epub 2013 May 13.
PubMed 23676442Wang Q, Yang L, Jin H, Lin L. Vaccination against COVID-19: A systematic review and meta-analysis of acceptability and its predictors. Prev Med. 2021 Sep;150:106694. doi: 10.1016/j.ypmed.2021.106694. Epub 2021 Jun 22.
PubMed 34171345Zhang J, Featherstone JD, Calabrese C, Wojcieszak M. Effects of fact-checking social media vaccine misinformation on attitudes toward vaccines. Prev Med. 2021 Apr;145:106408. doi: 10.1016/j.ypmed.2020.106408. Epub 2021 Jan 1.
PubMed 33388335Altay S, Hacquin AS, Chevallier C, Mercier H. Information delivered by a chatbot has a positive impact on COVID-19 vaccines attitudes and intentions. J Exp Psychol Appl. 2023 Mar;29(1):52-62. doi: 10.1037/xap0000400. Epub 2021 Oct 28.
PubMed 34726454Thomala LL. Penetration rate of leading social networks in Hong Kong as of 3rd quarter 2020 (Link: https://www.statista.com/statistics/412500/hk-social-network-penetration/, last accessed on August 1, 2021). Statista; 2020.
Kemp S. Digital 2021: Hong Kong (Link: https://datareportal.com/reports/digital-2021-hong-kong, last accessed on August 1, 2021). Data Reportal; 2021.
Müller J. Social network penetration in Singapore Q3 2020 (Link: https://www.statista.com/statistics/284466/singapore-social-network-penetration/, last accessed on August 1, 2021). Statista; 2020.
Huang C. Hong Kong faces uphill task to vaccinate its seniors against Covid-19 (Link: https://www.straitstimes.com/asia/east-asia/hong-kongs-uphill-push-to-vaccinate-its-seniors-against-covid-19, last accessed on August 1, 2021). The Straits Times. 2021.
Steve. Lexicon. The LINE Phenomenon in Thailand - By the Numbers (Link: https://lexiconthai.com/blog/the-line-phenomenon-in-thailand-by-the-numbers/, last accessed on August 1, 2021), 2020.
Agency T. Line in Thailand Internet Population (Link: https://www.twfdigital.com/blog/2020/04/line-user- stat-in-thailand-2020/, last accessed on August 1, 2021), 2020.
Get bad news (Link: https://www.getbadnews.com/#intro, last accessed on August 1, 2021). 2021.
Study at a glance
From the registry record, last updated by the sponsor on 6 Dec 2024. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- The Effectiveness of Conversational AI Service (Chatbot) Utilization on Vaccine Confidence
- ClinicalTrials.gov ID
- NCT05424952
- Acronym / sponsor ID
- UW 21-659
- Conditions
- Vaccination Hesitancy
- Study type
- Interventional
- Recruitment status
- Completed
- Enrolment
- 1,000 participants (actual)
- Lead sponsor
- The University of Hong KongUniversity, hospital or other
- Collaborators
- National University of Singapore, Health Intervention and Technology Assessment Program (HITAP)
- Study start
- 11 Feb 2022 (actual)
- Primary completion
- 17 Feb 2023 (actual)
- Study completion
- 17 Feb 2023 (actual)
- First posted
- 21 Jun 2022 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
The primary objective of this study is to develop and evaluate a conversational AI service (chatbot) on social media platforms to obtain accurate and up-to-date vaccine information, and assess the impact of chatbot usage on users' vaccine confidence and acceptance in Hong Kong, Singapore, and Thailand.
Detailed description
The investigators will focus on vulnerable seniors and/or children from Hong Kong, Singapore and Thailand who have refused or delayed COVID-19 vaccination. Participants will be recruited by an online panel to meet the target quota by age and sex. Participants will then be randomly assigned to the intervention group and the control group. For both intervention and control groups, evaluation questionnaires will be given out to the study participants asking questions about their demographics, including age, sex, educational level, employment status and household income levels. Participants will then answer questions regarding COVID-19 vaccine confidence, including the effectiveness and safety of vaccines, and the motivations of the policymakers who decided on the needed vaccines. Participants will be asked about COVID-19 vaccine acceptance including the intention to receive COVID-19 vaccines, make plans to receive COVID-19 vaccines, and receive at least one dose of COVID-19 vaccines. The intervention group will then be asked to use the chatbot developed by the research team for up to two weeks. The chatbot is developed under the RE-AIM framework for formative, impact, and process evaluation of the intervention. The control group will have no exposure to the chatbot.
The chatbot will be supported with data from 1) social listening analytics for monitoring local real-time discourses in the digital space on COVID-19 vaccine hesitancy and misinformation, and 2) formative, baseline, and endpoint evaluation, which will generate evidence for development and improvement/refinement.
Study design
- Primary purpose
- Health services research
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Masking
- Double blind (participant, investigator)
- Number of arms
- 2
| Arm | Type | Receives |
|---|---|---|
| Control | No intervention | –Eligible adults with unvaccinated senior parents/grandparents or children. |
| Intervention | Experimental | Other: Conversational AI Service (Chatbot)Eligible adults with unvaccinated senior parents/grandparents or children. |
Who may qualify
- Ages
- 18 years and older
- Sex
- All
- Healthy volunteers
- Accepted
- Age groups
- Adult, Older adult
Key inclusion criteria (3 listed)
- Hong Kong adult residents (English or Chinese users) with (a) unvaccinated senior parents/grandparents aged 60 (including those who received first dose after the announcement of the COVID passport on 4th of January) or (b) unvaccinated children aged below 18.
- Thailand adult residents (Thai users) with (a) unvaccinated senior parents/grandparents aged 60 or above or (b) unvaccinated children aged below 18.
- Singapore adult residents (English or Chinese users) with unvaccinated children aged between 5 to 11 years old.
Key exclusion criteria (1 listed)
- People who do not meet the inclusion criteria.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Conversational AI Service (Chatbot)WhatsApp or Messenger Chatbot for COVID-19 vaccines | Other | Intervention |
Primary outcome
Covid-19 vaccines confidence Index
Time frame: 1 week
1. "Overall, I think COVID-19 vaccines are important for children/senior parents (or grandparents)" 2. "Overall, I think COVID-19 vaccines are safe for children/parents (or grandparents)" 3. "Overall, I think COVID-19 vaccines are effective for children/parents (or grandparents)" The response is a 5-point Likert scale: (a) Strongly agree (b)Tend to agree (c) Do not know (d) Tend to disagree (e) Strongly disagree
Covid-19 vaccines acceptance
Time frame: 1 week
1. What is the vaccination status of your children/senior parents (or grandparents) as of now? 1. Is vaccinated with at least the first dose of the vaccine 2. Has made an appointment but has not been vaccinated with the first dose yet 3. Has not made an appointment but will get the vaccine. 4. Has no plan to get vaccinated anytime soon. 2. Do you want your children/senior parents (or grandparents) vaccinated against COVID-19 if vaccination is indicated and available for them? 1. Yes, definitely. 2. Unsure, but leaning towards yes. 3. Unsure, but leaning towards no. 4. No, definitely not.
Results and safety
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 6 Dec 2024.
- Results publication: PubMed 10474547Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999 Sep;89(9):1322-7. doi: 10.2105/ajph.89.9.1322.
- Results publication: PubMed 23597377Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013 Jun;103(6):e38-46. doi: 10.2105/AJPH.2013.301299. Epub 2013 Apr 18.
- Results publicationKobayashi T, Nishina Y, Tomoi H, et al. Corowa-kun: Impact of a COVID-19 vaccine information chatbot on vaccine hesitancy, Japan 2021. medRxiv 2021: 2021.05.26.21257854.
- Results publication: PubMed 32919524de Figueiredo A, Simas C, Karafillakis E, Paterson P, Larson HJ. Mapping global trends in vaccine confidence and investigating barriers to vaccine uptake: a large-scale retrospective temporal modelling study. Lancet. 2020 Sep 26;396(10255):898-908. doi: 10.1016/S0140-6736(20)31558-0. Epub 2020 Sep 10.
- Results publication: PubMed 23676442Larson HJ, Smith DM, Paterson P, Cumming M, Eckersberger E, Freifeld CC, Ghinai I, Jarrett C, Paushter L, Brownstein JS, Madoff LC. Measuring vaccine confidence: analysis of data obtained by a media surveillance system used to analyse public concerns about vaccines. Lancet Infect Dis. 2013 Jul;13(7):606-613. doi: 10.1016/S1473-3099(13)70108-7. Epub 2013 May 13.
- Results publication: PubMed 34171345Wang Q, Yang L, Jin H, Lin L. Vaccination against COVID-19: A systematic review and meta-analysis of acceptability and its predictors. Prev Med. 2021 Sep;150:106694. doi: 10.1016/j.ypmed.2021.106694. Epub 2021 Jun 22.
- Results publication: PubMed 33388335Zhang J, Featherstone JD, Calabrese C, Wojcieszak M. Effects of fact-checking social media vaccine misinformation on attitudes toward vaccines. Prev Med. 2021 Apr;145:106408. doi: 10.1016/j.ypmed.2020.106408. Epub 2021 Jan 1.
- Results publication: PubMed 34726454Altay S, Hacquin AS, Chevallier C, Mercier H. Information delivered by a chatbot has a positive impact on COVID-19 vaccines attitudes and intentions. J Exp Psychol Appl. 2023 Mar;29(1):52-62. doi: 10.1037/xap0000400. Epub 2021 Oct 28.
- Results publicationThomala LL. Penetration rate of leading social networks in Hong Kong as of 3rd quarter 2020 (Link: https://www.statista.com/statistics/412500/hk-social-network-penetration/, last accessed on August 1, 2021). Statista; 2020.
- Results publicationKemp S. Digital 2021: Hong Kong (Link: https://datareportal.com/reports/digital-2021-hong-kong, last accessed on August 1, 2021). Data Reportal; 2021.
- Results publicationMüller J. Social network penetration in Singapore Q3 2020 (Link: https://www.statista.com/statistics/284466/singapore-social-network-penetration/, last accessed on August 1, 2021). Statista; 2020.
- Results publicationHuang C. Hong Kong faces uphill task to vaccinate its seniors against Covid-19 (Link: https://www.straitstimes.com/asia/east-asia/hong-kongs-uphill-push-to-vaccinate-its-seniors-against-covid-19, last accessed on August 1, 2021). The Straits Times. 2021.
- Individual participant dataSharing planned: Yes. Individual participant data that underlie the results reported in the article, after de-identification (text, tables, figures, and appendices), will be shared. A written data-sharing request for meta-analysis should be submitted by email with a methodologically sound proposal. Proposals should be directed to kathysleung@connect.hku.hk; to gain access, data requestors will need to sign a data access agreement.
Related trials for Vaccination Hesitancy
Active, not recruiting
Conversational AI for Adult Flu Vaccination Decisions
Influenza, Human, Vaccine Hesitancy
Recruiting
Intrahospital Influenza Vaccination in Patients at High Cardiovascular Risk (VACC-UP)
Acute Coronary Syndrome, Heart Failure
Not yet recruiting
Development and Evaluation of a Digital Educational Intervention to Improve Vaccine Confidence and Communication Among Registered Nurses: Protocol for a Randomized Controlled Trial (VaxNurse-RCT).
Vaccine Hesitancy, Vaccine Acceptance
Active, not recruiting
Communication Strategies to Increase HPV Vaccinations
Papilloma Viral Infection, Vaccine Hesitancy
Not yet recruiting
Parents' Knowledge and Attitudes Towards Vaccinating Their Children
Vaccine Hesitancy
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
Joseph T Wu, PhD principal investigator
The University of Hong Kong
3 sites in 3 countries: see every site and its status.
Questions about this trial
What is this clinical trial studying?
A study testing Conversational AI Service (Chatbot) in people with Vaccination Hesitancy, run by The University of Hong Kong at 3 sites in 3 countries.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 3 inclusion and 1 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 6 Dec 2024. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 3 sites in Hong Kong, Singapore, Thailand. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Covid-19 vaccines confidence Index (time frame: 1 week). The study lists 2 primary outcomes in all. It is what the study was designed to measure, not a finding.
Where can I read the original study information?
On the ClinicalTrials.gov record for NCT05424952, which also lists 18 linked publications.
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 6 Dec 2024.