HivSMARTNCT03511131
A Pragmatic Trial of An Adaptive eHealth HIV Prevention Program for Diverse Adolescent MSM
A study testing Queer Sex Ed, Keep It Up and Young Men's Health Project in people with Hiv and Adolescent Behavior, run by Northwestern University at 1 site in United States.
Trial summary
This pragmatic trial of an HIV prevention program focuses on HIV risk-reduction in men who have sex with men (MSM) ages 13-18. The design is a three-tiered, internet-based HIV prevention intervention series that uses a sequential multiple assignment randomized trial (SMART) to track adolescent MSM reporting varying… Read more about this study
- Who is it for?
- Ages 13 to 18 years, men onlyHealthy volunteers can take part
- Conditions the study is for
- Hiv, Adolescent Behavior, Sex, Safe
- What is being tested?
- Queer Sex Ed, Keep It Up and Young Men's Health Project
- Type of treatment
- Lifestyle or therapy programme
- Could I receive a placebo?
- No, everyone receives an active treatment
- How many people
- 1,306 participants
- Where
- 1 siteUnited States
- Study dates
- 18 Apr 2018to 12 Dec 2021
- Phase
- Interventional
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 13 to 18 years
- Men only
- Healthy volunteers accepted
- Child, Adult
Who may be able to join
- identifying as male-assigned at birth
- reporting attraction to men;
- 13-18 years old
- self-reported HIV-negative at the beginning of the study (or have never been HIV tested/do not know their HIV status)
- able to read English or Spanish,
- has a usable e-mail address, textable phone number, and access to the internet or smart-phone/-device
Who cannot join
- identifying as female-assigned at birth
- reporting no attraction men
- identifying as under 13 years of age
- identifying as 19 years old or older
- self-reported HIV-positive
- unable to read English or Spanish
- unable to have access to or use email, text messaging, voice calling
- unable to have access to the internet or a smart-phone/-device
Trial locations and contacts
1 site in 1 country.
About this study
This pragmatic trial of an HIV prevention program focuses on HIV risk-reduction in men who have sex with men (MSM) ages 13-18. The design is a three-tiered, internet-based HIV prevention intervention series that uses a sequential multiple assignment randomized trial (SMART) to track adolescent MSM reporting varying degree of sexual risk.The program package includes: (1-low risk) a universally-delivered, brief, online sexual health education program designed for sexual and gender minority youth regardless of whether they are sexually active (Queer Sex Ed); (2-middle risk) a more intensive online intervention designed for diverse AMSM engaging in HIV transmission risk behaviors (Keep It Up!), and (3-high risk) the most intensive is a motivational interviewing (MI) intervention that will be delivered by MI therapists via online videochat (Young Men's Health Project).
Read the detailed description
Adolescent (ages 13-18) men who have sex with men (AMSM) experience a dramatic health disparity as they represent 2% of young people but account for almost 80% of HIV diagnoses in youth. Despite this disproportionate burden, current evidence-based HIV prevention programs focus primarily on adults and heterosexual youth. Because issues affecting sexual health decisions among AMSM are unique, interventions need to be designed to ensure appropriate content that resonates with AMSM. Prevention programs must also be responsive to minority AMSM that experience disparities in incidence or lack of access to prevention services. For example, Hispanics represent 27% of HIV infections among MSM, but Spanish speaking MSM face significant language barriers to accessing HIV services.
Implementation issues are particularly critical as traditional HIV prevention delivery channels have significant limitations for AMSM: few adolescents attend LGBT youth oriented programs, schools place many restrictions on discussions of MSM sexual health, and major questions remain as to the feasibility of enrolling parents of AMSM into HIV prevention programs. With 92% of adolescents (across all races and income levels) going online every day, eHealth interventions represent a critical modality for delivering AMSM- specific intervention material where youth "are." Combining online recruitment with intervention delivery across a range of devices can overcome many access barriers to engagement of AMSM in HIV prevention.
Unfortunately, there will be no single magic solution that will work for all AMSM and public health programmers should not continue to deliver the same fixed intervention when a participant is not responding. Alternatively, stepped-care strategies increase in intensity to meet the needs of those who do not respond to a less intense intervention. Using a Sequential Multiple Assignment Randomized Trial (SMART) design, the investigators will evaluate the impact of a package of increasingly intensive interventions that have already shown evidence of efficacy with diverse adolescent and young adult MSM. The SMART methodology is an ideal approach because SMART designs mimic treatment decisions as they are made in real-world clinical settings, components of traditional RCTs are embedded within the design, and participant data can be used post-hoc to inform decision rules in order to optimize implementation. Collectively the investigators brand this package of eHealth interventions as the SMART Program (Sexual Minority Adolescent Risk Taking). The SMART Program package includes: (1) a universally-delivered, brief, online sexual health education program designed for sexual and gender minority youth regardless of whether they are sexually active ("Queer Sex Ed") (2) a more intensive online intervention designed for diverse AMSM engaging in HIV transmission risk behaviors ("Keep It Up!"); and (3) a more intensive motivational interviewing (MI) intervention that will be delivered by MI therapists via online videochat ("Young Men's Health Project"). The investigators will evaluate the impact of the SMART Program and carefully document implementation context to inform scale out with the following aims:
Aim 1: Evaluate the impact of the SMART Program and its constituent components at reducing HIV risk among AMSM. To do this, the investigators will:
- Involve diverse AMSM (e.g., Youth Advisory Council) in developmentally adapting existing SMART Program components for AMSM ages 13-18 using the ADAPT-ITT framework.
- Culturally and linguistically adapt the SMART Program for Spanish speaking Latino AMSM in the US.
- Embed the SMART Program content into an eHealth platform that will allow access on a range of devices and accommodate updates. Perform alpha and beta testing.
- Enroll a national sample of 1,938 AMSM who are diverse in terms of race/ethnicity, age, geographic region, socioeconomic status, and sexual experience history.
- Test the effectiveness of the SMART Program at reducing HIV risk taking behaviors, increasing HIV testing, and improving prevention intentions. Consistent with a SMART design, the investigators operationalize and power the primary test of effectiveness as the first point of randomization, which tests the effectiveness of "Keep It Up!". Additional comparisons will allow the investigators to establish the response rate for "Queer Sex Ed", examine whether the more intensive "Young Men's Health Project" outperforms the less intensive "Keep It Up!" among non-responders to "Queer Sex Ed," and determine whether "Young Men's Health Project" provides added benefit to AMSM who did not respond to "Keep it Up!".
Aim 2: Test if the SMART Program has differential efficacy across important sub-groups of AMSM. Consistent with the RFA, the investigators will test intervention effects within each of the NIH designated health disparity populations (racial/ethnicity minorities, rural, low SES), and by age and language (Spanish).
Aim 3: Evaluate the delivery of the SMART Program nationally to inform scale out and determine cost-effectiveness. To reduce the science-practice gap, the investigators will utilize mixed methods to identify facilitators and barriers to the implementation of the SMART Program using a Hybrid Type 1 Effectiveness-Implementation trial design. The investigators will assess process metrics and indicators of its acceptability among AMSM and key national stakeholders, scale out feasibility, sustainability potential, and conduct a cost analysis to estimate the cost of program implementation compare to monetized benefits.
- Conditions
- Hiv, Adolescent Behavior, Sex, Safe
- Being tested
- Queer Sex Ed, Keep It Up, Keep It Up-Control, Young Men's Health Project
- Keywords
- HIV prevention, Adolescent risk-taking behaviors
- Medical subject headings
- Acquired Immunodeficiency Syndrome, Adolescent Behavior, Safe Sex
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Queer Sex EdBehavioural
Also called QSE, SMART Sex Ed
Comprehensive sexual health education program condition (Informational)
Keep It UpBehavioural
Also called KIU, SMART Squad
Culturally/situation-relevant HIV-prevention experimental condition (Motivational/behavioral)
Keep It Up-ControlBehavioural
Also called KIU-Control, SMART Sex Ed 2.0
HIV knowledge control condition, attention-matched to KIU (Informational)
Young Men's Health ProjectBehavioural
Also called YMHP, SMART Sessions
Motivational enhancement video interviewing condition (Motivational/behavioral)
| Study group | Role | What they receive |
|---|---|---|
| QSE Resp (Only follow) | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who responded to QSE, were randomized at month-6 to no additional treatment, and then followed for the rest of the study. Receives: Behavioral: Queer Sex Ed |
| QSE Resp (KIU at 6-month) | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who responded to QSE, were randomized at month-6 to receive Keep It Up (KIU), and then followed for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up |
| QSE Non-Resp, KIU-Control Resp | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up-Control (KIU-Control), responded to KIU-Control at month-6, and then were followed for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up-Control |
| QSE Non-Resp, KIU-Control Non-Resp, KIU | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up-Control (KIU-Control), did not respond to KIU-Control at month-6, and so were randomized into Keep It Up (KIU). After KIU, they were followed for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up; Behavioral: Keep It Up-Control |
| QSE Non-Resp, KIU Control Non-Resp, YMHP | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up-Control (KIU-Control), did not respond to KIU-Control at month-6, and so were randomized into Young Men's Health Project (YMHP). After YMHP, they were followed for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up-Control; Behavioral: Young Men's Health Project |
| QSE Non-Resp, KIU Resp | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up (KIU), responded to KIU at month-6, and then were followed for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up |
| QSE Non-Resp, KIU Non-Resp | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up (KIU), did not respond to KIU at month-6, and then were randomized into no treatment/just follow for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up |
| QSE Non-Resp, KIU Non-Resp, YMHP | Other | All participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up (KIU), did not respond to KIU at month-6, and then were randomized into Young Men's Health Project. After YMHP, they were followed for the rest of the study. Receives: Behavioral: Queer Sex Ed; Behavioral: Keep It Up; Behavioral: Young Men's Health Project |
What is being measured
The primary outcome is the main question the study is designed to answer.
Condomless anal sex
Changes in condomless anal sex acts from baseline to 12-months.
Measured: 12-months
Condom Use Intentions Scale
This is a multi-item scale which asks participants about their plans and abilities to use condoms in the future. It has two subscales. The first subscale (Condom Use) asks about participants' likelihood to use condoms with partners. An example item for Condom Use is: "How likely is it that you will use a condom every time you have sex?" The 11-items for this subscale are measured from very unlikely (1) to very likely (4) [averaged min value 1, averaged max value 4]. High values mean a better outcome, or likely condom use with partners. The second subscale (Self-Efficacy) asks participants' ability to use condoms. An example item for Self-Efficacy is: "How confident are you that you would be able to be sure you had condoms with you?" The 5-items for this subscale are measured from not at all confident (1) to extremely confident (7) [averaged min value 1, averaged max value 7]. High values mean a better outcome, or more confidence at using condoms. The two subscales are not combined.
Measured: 12-months
HIV Testing
Participants are asked to self-reported their history of actual getting HIV tested.
Measured: 12-months
Secondary outcomes (3)
HIV Knowledge
The brief HIV/AIDS Knowledge questionnaire assesses knowledge of transmission and prevention of HIV. Example items that are dichotomously measured as true/false, include: "A person can get HIV by sharing a glass of water with someone who has HIV," "There is a vaccine that can stop people (or adults) from getting HIV," "Using a latex condom or rubber can lower a person's chance of getting HIV," etc.
Measured: Months: 0, 3, 6, 9, 12
HIV/AIDS Motivation and Behavioral Skills
Motivation (e.g. perceived threat of HIV/STI infection, motivation to become safer), social norms (e.g., partners/friends/family members opinions about condom use), and behavioral skills (e.g., negotiating condom use) will be assessed. An example of motivation-based measures would be: "True or False: You really only need to use condoms during one night stands." An example of social norm-based measures would be: "How likely/unlikely is it that you will have sex without a condom because you are afraid of what a partner might do to you if you ask to use condoms?" An example of skills-based measures would be: "How hard would it be for you to discuss safer sex with a partner in a non-sexual setting, such as while riding in your car?" More specific behavioral skills are also measured within the The Health Protective Communication Scale. An example of this would be, "In the past 12 months, have you asked a new sex partner about the number of past sex partners (he/she) had?"
Measured: Months: 0, 3, 6, 9, 12
Condom Errors
An adaptation of the Condom Errors Questionnaire will be asked, which has been found to be predictive of condom breakage and slippage, and STI contraction. An example item from this questionnaire is: "When you used condoms during the LAST 6 MONTHS, how often was the condom package checked for visible damage before having sex?"
Measured: Months: 0, 3, 6, 9, 12
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted27 Apr 2018
- Study start18 Apr 2018
- Primary completion12 Dec 2021
- Study completion12 Dec 2021
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Publications (7)Papers the sponsor has linked to this study.
- Other trials for HivStudies of the same condition, open and under way.
- More trials run by Northwestern UniversityThe sponsor's other registered studies.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Interventional
- Phase
- Phase N/A
- Primary purpose
- Prevention
- Allocation
- Randomised
- Intervention model
- Sequential
- Masking
- Single blind
- Who is masked
- Participant
- Enrolment
- 1,306 participants (actual)
Sponsor and investigators
- Lead sponsor
- Northwestern University
- Sponsor type
- University, hospital or other
- Collaborators
- National Institute on Minority Health and Health Disparities (NIMHD)
- Responsible party
- Principal investigator, Brian Mustanski, Northwestern University
- Investigators
- Brian Mustanski, PhD, Principal investigator, Northwestern UniversityMaggie Matson, MPH, Study director, Northwestern University
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT03511131
- Sponsor's protocol ID
- 5U01MD011281
- Other IDs
- 5U01MD011281
- Acronym
- SMART
- Status last verified
- Aug 2022
- First submitted
- 29 Mar 2018
- Last updated
- 12 Aug 2022
- Results posted
- No
- Data monitoring committee
- Yes
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- Undecided
Publications
Yellin H, Wang Y, Huebner DM, Rodriguez-Diaz CE, Macapagal K, Newcomb ME, Mustanski B, Ruiz MS. An empirical test of the Information-Motivation-Behavioral Skills model of willingness and intention to use HIV pre-exposure prophylaxis among adolescent men who have sex with men. Ann Behav Med. 2025 Jan 4;59(1):kaaf070. doi: 10.1093/abm/kaaf070.
PubMed 40971723Mustanski B, Macapagal K, Li DH, Rodriguez-Diaz CE, Saber R, Matson M, Moskowitz DA, Rendina HJ, Laber E, Ryan DT, Newcomb ME. Effectiveness of the smart program: Stepped-care HIV prevention for gay and bisexual adolescent boys. Health Psychol. 2025 Mar;44(3):321-331. doi: 10.1037/hea0001471.
PubMed 39992778Sinno J, Macapagal K, Mustanski B. Social Media and Online Dating Safety Practices by Adolescent Sexual and Gender Diverse Men: Mixed-Methods Findings From the SMART Study. J Adolesc Health. 2024 Jan;74(1):113-122. doi: 10.1016/j.jadohealth.2023.07.030. Epub 2023 Oct 4.
PubMed 37791926Xavier Hall CD, Wood CV, Hurtado M, Moskowitz DA, Dyar C, Mustanski B. Identifying leaks in the STEM recruitment pipeline among sexual and gender minority US secondary students. PLoS One. 2022 Jun 3;17(6):e0268769. doi: 10.1371/journal.pone.0268769. eCollection 2022.
PubMed 35658021Moskowitz DA, Moran KO, Matson M, Alvarado-Avila A, Mustanski B. The PrEP Cascade in a National Cohort of Adolescent Men Who Have Sex With Men. J Acquir Immune Defic Syndr. 2021 Apr 15;86(5):536-543. doi: 10.1097/QAI.0000000000002613.
PubMed 33399311Mustanski B, Moskowitz DA, Moran KO, Newcomb ME, Macapagal K, Rodriguez-Diaz C, Rendina HJ, Laber EB, Li DH, Matson M, Talan AJ, Cabral C. Evaluation of a Stepped-Care eHealth HIV Prevention Program for Diverse Adolescent Men Who Have Sex With Men: Protocol for a Hybrid Type 1 Effectiveness Implementation Trial of SMART. JMIR Res Protoc. 2020 Aug 11;9(8):e19701. doi: 10.2196/19701.
PubMed 32779573Mustanski B, Moskowitz DA, Moran KO, Rendina HJ, Newcomb ME, Macapagal K. Factors Associated With HIV Testing in Teenage Men Who Have Sex With Men. Pediatrics. 2020 Mar;145(3):e20192322. doi: 10.1542/peds.2019-2322. Epub 2020 Feb 11.
PubMed 32047100
Study at a glance
From the registry record, last updated by the sponsor on 12 Aug 2022. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- A Pragmatic Trial of An Adaptive eHealth HIV Prevention Program for Diverse Adolescent MSM
- ClinicalTrials.gov ID
- NCT03511131
- Acronym / sponsor ID
- SMART / 5U01MD011281
- Conditions
- Hiv, Adolescent Behavior, Sex, Safe
- Keywords
- HIV prevention, Adolescent risk-taking behaviors
- Study type
- Interventional
- Recruitment status
- Completed
- Enrolment
- 1,306 participants (actual)
- Lead sponsor
- Northwestern UniversityUniversity, hospital or other
- Collaborators
- National Institute on Minority Health and Health Disparities (NIMHD)
- Study start
- 18 Apr 2018 (actual)
- Primary completion
- 12 Dec 2021 (actual)
- Study completion
- 12 Dec 2021 (actual)
- First posted
- 27 Apr 2018 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
This pragmatic trial of an HIV prevention program focuses on HIV risk-reduction in men who have sex with men (MSM) ages 13-18. The design is a three-tiered, internet-based HIV prevention intervention series that uses a sequential multiple assignment randomized trial (SMART) to track adolescent MSM reporting varying degree of sexual risk.The program package includes: (1-low risk) a universally-delivered, brief, online sexual health education program designed for sexual and gender minority youth regardless of whether they are sexually active (Queer Sex Ed); (2-middle risk) a more intensive online intervention designed for diverse AMSM engaging in HIV transmission risk behaviors (Keep It Up!), and (3-high risk) the most intensive is a motivational interviewing (MI) intervention that will be delivered by MI therapists via online videochat (Young Men's Health Project).
Detailed description
Adolescent (ages 13-18) men who have sex with men (AMSM) experience a dramatic health disparity as they represent 2% of young people but account for almost 80% of HIV diagnoses in youth. Despite this disproportionate burden, current evidence-based HIV prevention programs focus primarily on adults and heterosexual youth. Because issues affecting sexual health decisions among AMSM are unique, interventions need to be designed to ensure appropriate content that resonates with AMSM. Prevention programs must also be responsive to minority AMSM that experience disparities in incidence or lack of access to prevention services. For example, Hispanics represent 27% of HIV infections among MSM, but Spanish speaking MSM face significant language barriers to accessing HIV services.
Implementation issues are particularly critical as traditional HIV prevention delivery channels have significant limitations for AMSM: few adolescents attend LGBT youth oriented programs, schools place many restrictions on discussions of MSM sexual health, and major questions remain as to the feasibility of enrolling parents of AMSM into HIV prevention programs. With 92% of adolescents (across all races and income levels) going online every day, eHealth interventions represent a critical modality for delivering AMSM- specific intervention material where youth "are." Combining online recruitment with intervention delivery across a range of devices can overcome many access barriers to engagement of AMSM in HIV prevention.
Unfortunately, there will be no single magic solution that will work for all AMSM and public health programmers should not continue to deliver the same fixed intervention when a participant is not responding. Alternatively, stepped-care strategies increase in intensity to meet the needs of those who do not respond to a less intense intervention. Using a Sequential Multiple Assignment Randomized Trial (SMART) design, the investigators will evaluate the impact of a package of increasingly intensive interventions that have already shown evidence of efficacy with diverse adolescent and young adult MSM. The SMART methodology is an ideal approach because SMART designs mimic treatment decisions as they are made in real-world clinical settings, components of traditional RCTs are embedded within the design, and participant data can be used post-hoc to inform decision rules in order to optimize implementation. Collectively the investigators brand this package of eHealth interventions as the SMART Program (Sexual Minority Adolescent Risk Taking). The SMART Program package includes: (1) a universally-delivered, brief, online sexual health education program designed for sexual and gender minority youth regardless of whether they are sexually active ("Queer Sex Ed") (2) a more intensive online intervention designed for diverse AMSM engaging in HIV transmission risk behaviors ("Keep It Up!"); and (3) a more intensive motivational interviewing (MI) intervention that will be delivered by MI therapists via online videochat ("Young Men's Health Project"). The investigators will evaluate the impact of the SMART Program and carefully document implementation context to inform scale out with the following aims:
Aim 1: Evaluate the impact of the SMART Program and its constituent components at reducing HIV risk among AMSM. To do this, the investigators will:
- Involve diverse AMSM (e.g., Youth Advisory Council) in developmentally adapting existing SMART Program components for AMSM ages 13-18 using the ADAPT-ITT framework.
- Culturally and linguistically adapt the SMART Program for Spanish speaking Latino AMSM in the US.
- Embed the SMART Program content into an eHealth platform that will allow access on a range of devices and accommodate updates. Perform alpha and beta testing.
- Enroll a national sample of 1,938 AMSM who are diverse in terms of race/ethnicity, age, geographic region, socioeconomic status, and sexual experience history.
- Test the effectiveness of the SMART Program at reducing HIV risk taking behaviors, increasing HIV testing, and improving prevention intentions. Consistent with a SMART design, the investigators operationalize and power the primary test of effectiveness as the first point of randomization, which tests the effectiveness of "Keep It Up!". Additional comparisons will allow the investigators to establish the response rate for "Queer Sex Ed", examine whether the more intensive "Young Men's Health Project" outperforms the less intensive "Keep It Up!" among non-responders to "Queer Sex Ed," and determine whether "Young Men's Health Project" provides added benefit to AMSM who did not respond to "Keep it Up!".
Aim 2: Test if the SMART Program has differential efficacy across important sub-groups of AMSM. Consistent with the RFA, the investigators will test intervention effects within each of the NIH designated health disparity populations (racial/ethnicity minorities, rural, low SES), and by age and language (Spanish).
Aim 3: Evaluate the delivery of the SMART Program nationally to inform scale out and determine cost-effectiveness. To reduce the science-practice gap, the investigators will utilize mixed methods to identify facilitators and barriers to the implementation of the SMART Program using a Hybrid Type 1 Effectiveness-Implementation trial design. The investigators will assess process metrics and indicators of its acceptability among AMSM and key national stakeholders, scale out feasibility, sustainability potential, and conduct a cost analysis to estimate the cost of program implementation compare to monetized benefits.
Study design
- Primary purpose
- Prevention
- Allocation
- Randomised
- Intervention model
- Sequential
- Masking
- Single blind (participant)
- Number of arms
- 8
| Arm | Type | Receives |
|---|---|---|
| QSE Resp (Only follow) | Other | Behavioral: Queer Sex EdAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who responded to QSE, were randomized at month-6 to no additional treatment, and then followed for the rest of the study. |
| QSE Resp (KIU at 6-month) | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It UpAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who responded to QSE, were randomized at month-6 to receive Keep It Up (KIU), and then followed for the rest of the study. |
| QSE Non-Resp, KIU-Control Resp | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It Up-ControlAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up-Control (KIU-Control), responded to KIU-Control at month-6, and then were followed for the rest of the study. |
| QSE Non-Resp, KIU-Control Non-Resp, KIU | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It Up, Behavioral: Keep It Up-ControlAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up-Control (KIU-Control), did not respond to KIU-Control at month-6, and so were randomized into Keep It Up (KIU). After KIU, they were followed for the rest of the study. |
| QSE Non-Resp, KIU Control Non-Resp, YMHP | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It Up-Control, Behavioral: Young Men's Health ProjectAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up-Control (KIU-Control), did not respond to KIU-Control at month-6, and so were randomized into Young Men's Health Project (YMHP). After YMHP, they were followed for the rest of the study. |
| QSE Non-Resp, KIU Resp | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It UpAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up (KIU), responded to KIU at month-6, and then were followed for the rest of the study. |
| QSE Non-Resp, KIU Non-Resp | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It UpAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up (KIU), did not respond to KIU at month-6, and then were randomized into no treatment/just follow for the rest of the study. |
| QSE Non-Resp, KIU Non-Resp, YMHP | Other | Behavioral: Queer Sex Ed, Behavioral: Keep It Up, Behavioral: Young Men's Health ProjectAll participants enter Queer Sex Ed (QSE) and are measured at 0, 3, 6, 9, and 12-months. This arm is comprised of participants who did not respond to QSE, were randomized at month-3 to receive Keep It Up (KIU), did not respond to KIU at month-6, and then were randomized into Young Men's Health Project. After YMHP, they were followed for the rest of the study. |
Who may qualify
- Ages
- 13 to 18 years
- Sex
- Male only
- Healthy volunteers
- Accepted
- Age groups
- Child, Adult
Key inclusion criteria (6 listed)
- identifying as male-assigned at birth
- reporting attraction to men;
- 13-18 years old
- self-reported HIV-negative at the beginning of the study (or have never been HIV tested/do not know their HIV status)
- able to read English or Spanish,
Key exclusion criteria (8 listed)
- identifying as female-assigned at birth
- reporting no attraction men
- identifying as under 13 years of age
- identifying as 19 years old or older
- self-reported HIV-positive
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Queer Sex EdAlso: QSE, SMART Sex EdComprehensive sexual health education program condition (Informational) | Behavioural | QSE Non-Resp, KIU Control Non-Resp, YMHP, QSE Non-Resp, KIU Non-Resp, QSE Non-Resp, KIU Non-Resp, YMHP, QSE Non-Resp, KIU Resp, QSE Non-Resp, KIU-Control Non-Resp, KIU, QSE Non-Resp, KIU-Control Resp, QSE Resp (KIU at 6-month), QSE Resp (Only follow) |
| Keep It UpAlso: KIU, SMART SquadCulturally/situation-relevant HIV-prevention experimental condition (Motivational/behavioral) | Behavioural | QSE Non-Resp, KIU Non-Resp, QSE Non-Resp, KIU Non-Resp, YMHP, QSE Non-Resp, KIU Resp, QSE Non-Resp, KIU-Control Non-Resp, KIU, QSE Resp (KIU at 6-month) |
| Keep It Up-ControlAlso: KIU-Control, SMART Sex Ed 2.0HIV knowledge control condition, attention-matched to KIU (Informational) | Behavioural | QSE Non-Resp, KIU Control Non-Resp, YMHP, QSE Non-Resp, KIU-Control Non-Resp, KIU, QSE Non-Resp, KIU-Control Resp |
| Young Men's Health ProjectAlso: YMHP, SMART SessionsMotivational enhancement video interviewing condition (Motivational/behavioral) | Behavioural | QSE Non-Resp, KIU Control Non-Resp, YMHP, QSE Non-Resp, KIU Non-Resp, YMHP |
Primary outcome
Condomless anal sex
Time frame: 12-months
Changes in condomless anal sex acts from baseline to 12-months.
Condom Use Intentions Scale
Time frame: 12-months
This is a multi-item scale which asks participants about their plans and abilities to use condoms in the future. It has two subscales. The first subscale (Condom Use) asks about participants' likelihood to use condoms with partners. An example item for Condom Use is: "How likely is it that you will use a condom every time you have sex?" The 11-items for this subscale are measured from very unlikely (1) to very likely (4) [averaged min value 1, averaged max value 4]. High values mean a better outcome, or likely condom use with partners. The second subscale (Self-Efficacy) asks participants' ability to use condoms. An example item for Self-Efficacy is: "How confident are you that you would be able to be sure you had condoms with you?" The 5-items for this subscale are measured from not at all confident (1) to extremely confident (7) [averaged min value 1, averaged max value 7]. High values mean a better outcome, or more confidence at using condoms. The two subscales are not combined.
HIV Testing
Time frame: 12-months
Participants are asked to self-reported their history of actual getting HIV tested.
3 secondary outcomes
HIV Knowledge
Time frame: Months: 0, 3, 6, 9, 12
HIV/AIDS Motivation and Behavioral Skills
Time frame: Months: 0, 3, 6, 9, 12
Condom Errors
Time frame: Months: 0, 3, 6, 9, 12
Results and safety
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 12 Aug 2022.
- Derived from this study: PubMed 40971723Yellin H, Wang Y, Huebner DM, Rodriguez-Diaz CE, Macapagal K, Newcomb ME, Mustanski B, Ruiz MS. An empirical test of the Information-Motivation-Behavioral Skills model of willingness and intention to use HIV pre-exposure prophylaxis among adolescent men who have sex with men. Ann Behav Med. 2025 Jan 4;59(1):kaaf070. doi: 10.1093/abm/kaaf070.
- Derived from this study: PubMed 39992778Mustanski B, Macapagal K, Li DH, Rodriguez-Diaz CE, Saber R, Matson M, Moskowitz DA, Rendina HJ, Laber E, Ryan DT, Newcomb ME. Effectiveness of the smart program: Stepped-care HIV prevention for gay and bisexual adolescent boys. Health Psychol. 2025 Mar;44(3):321-331. doi: 10.1037/hea0001471.
- Derived from this study: PubMed 37791926Sinno J, Macapagal K, Mustanski B. Social Media and Online Dating Safety Practices by Adolescent Sexual and Gender Diverse Men: Mixed-Methods Findings From the SMART Study. J Adolesc Health. 2024 Jan;74(1):113-122. doi: 10.1016/j.jadohealth.2023.07.030. Epub 2023 Oct 4.
- Derived from this study: PubMed 35658021Xavier Hall CD, Wood CV, Hurtado M, Moskowitz DA, Dyar C, Mustanski B. Identifying leaks in the STEM recruitment pipeline among sexual and gender minority US secondary students. PLoS One. 2022 Jun 3;17(6):e0268769. doi: 10.1371/journal.pone.0268769. eCollection 2022.
- Derived from this study: PubMed 33399311Moskowitz DA, Moran KO, Matson M, Alvarado-Avila A, Mustanski B. The PrEP Cascade in a National Cohort of Adolescent Men Who Have Sex With Men. J Acquir Immune Defic Syndr. 2021 Apr 15;86(5):536-543. doi: 10.1097/QAI.0000000000002613.
- Derived from this study: PubMed 32779573Mustanski B, Moskowitz DA, Moran KO, Newcomb ME, Macapagal K, Rodriguez-Diaz C, Rendina HJ, Laber EB, Li DH, Matson M, Talan AJ, Cabral C. Evaluation of a Stepped-Care eHealth HIV Prevention Program for Diverse Adolescent Men Who Have Sex With Men: Protocol for a Hybrid Type 1 Effectiveness Implementation Trial of SMART. JMIR Res Protoc. 2020 Aug 11;9(8):e19701. doi: 10.2196/19701.
- Derived from this study: PubMed 32047100Mustanski B, Moskowitz DA, Moran KO, Rendina HJ, Newcomb ME, Macapagal K. Factors Associated With HIV Testing in Teenage Men Who Have Sex With Men. Pediatrics. 2020 Mar;145(3):e20192322. doi: 10.1542/peds.2019-2322. Epub 2020 Feb 11.
- Individual participant dataSharing planned: Undecided
Related trials for Hiv
Not yet recruiting
HealthMpowerment Korea: Pilot Testing the Cultural Adaptation of a Digital HIV Intervention for Men Who Have Sex With Men in South Korea
HIV Infections, HIV Prevention and Care
Not yet recruiting
Prescribe to Prevent HIV: A Hybrid Trial Helping Addiction Clinics Prevent HIV & Infections Through Safer Drug Use Support
People Who Use Opioids/People With Opioid Use Disorder (OUD)
Recruiting
Evaluating the Impact of Using the B-OK Bottles for HIV and ART Literacy in South Africa
HIV, HIV Treatment
Recruiting
Trial Phase: Syndemic Adapted Medly Uganda
Mental Health
RecruitingObservational study
Olfactory Function and Model-Based Behavior in People Living With HIV and SUD
HIV, Substance Use Disorder
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
Brian Mustanski, PhD principal investigator
Northwestern University
Maggie Matson, MPH study director
Northwestern University
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
A study testing Queer Sex Ed, Keep It Up and Young Men's Health Project in people with Hiv and Adolescent Behavior, run by Northwestern University at 1 site in United States.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 6 inclusion and 8 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 12 Aug 2022. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in United States. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Condomless anal sex (time frame: 12-months). The study lists 3 primary outcomes in all. It is what the study was designed to measure, not a finding.
Where can I read the original study information?
On the ClinicalTrials.gov record for NCT03511131, which also lists 7 linked publications.
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 12 Aug 2022.