AzTrials
AzTrials

Behavioral EconomicsPCCENCT04237883

Primary Care Clinical Excellence Incentive Study

A study testing Standard communication email, Social comparison Intervention and Leadership Training in people with Behavioral Economics and Primary Health Care, run by University of California, Los Angeles at 1 site in United States.

Completed

Finished. The study has ended and is not enrolling. Results may be posted on the official record.

Official record
Search all trials

Trial summary

As part of UCLA Health's commitment to developing a premier integrated health system built on a foundation of physician-led, team-based primary care, the Department of Medicine (DOM) recently implemented a new performance based incentive plan called the Primary Care Clinical Excellence (PCCE) Incentive Plan. Read more about this study

Who is it for?
Ages 18 years and olderHealthy volunteers can take part
What is being tested?
Standard communication email, Social comparison Intervention and Leadership Training
Could I receive a placebo?
Yes, some participants may receive a placebo
How many people
225 participants
Where
1 siteUnited States
Study dates
1 Nov 2019to 1 Jan 2021
Phase
Interventional
Are there results?
None posted in the registry

Key requirements

Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.

  • Ages 18 years and older
  • All sexes
  • Healthy volunteers accepted
  • Adult, Older adult

Who may be able to join

  • Primary care physicians within the UCLA Health Department of Medicine Primary Care Network and with the following specialties: Internal Medicine, Geriatrics, Internal Medicine/Pediatrics, or Family Medicine.
  • Clinical full-time employee level (FTE) of ≥ 40% at the beginning of the intervention period.
  • Eligible to receive performance-based financial incentive as determined by the Department of Medicine.
  • Panel size >50 patients before the first intervention email was sent
  • Patients, with at least one Health Maintenance topic open before or during at least one visit that takes place with a physician enrolled in the study between November 5, 2019 and March 3, 2020.

Who cannot join

  • Not a primary care physician within the UCLA Health Department of Medicine Primary Care Network.
  • Not a primary care physician with the following specialties: Internal Medicine, Geriatrics, Internal Medicine/Pediatrics, or Family Medicine.
  • Clinical FTE < 40%.
  • Not eligible to receive performance-based financial incentive as determined by the Department of Medicine.
  • Panel size greater than 50 patients before the first intervention email was sent.
  • Patients that are not seen by a provider enrolled in the study period.
  • Patients seen by physician in the study with no Health Maintenance topics open before or during any visit that takes place between November 5, 2019 and March 3, 2020.

Trial locations and contacts

1 site in 1 country.

United States1 site
  • UCLA Health Department of Medicine, Quality Office

    Brentwood, California, 90095

Other trials in United States

About this study

Official title: Effects of Social Comparison Performance Feedback on Primary Care Quality

As part of UCLA Health's commitment to developing a premier integrated health system built on a foundation of physician-led, team-based primary care, the Department of Medicine (DOM) recently implemented a new performance based incentive plan called the Primary Care Clinical Excellence (PCCE) Incentive Plan. This incentive plan was developed to motivate providers to improve health maintenance screening rates.

The UCLA Health DOM Quality team is leading the implementation and evaluation of this new incentive plan across our primary care network. In addition, the DOM Quality team has partnered with the UCLA Anderson School of Management to study the most efficacious ways to frame and communicate performance based incentives.

Understanding the factors that motivate physicians to deliver the highest quality primary care will provide pivotal insights into the successful implementation of performance based programs nationwide. The investigators believe that physicians who receive communication built on behavioral principles will demonstrate more motivation towards and success at meeting national primary care screening guidelines.

Read the detailed description

Currently, UCLA Health has 42 primary care clinics staffed with approximately 205 PCP's serving more than 300,000 patients. In order to improve health maintenance screening rates associated with the performance based program, the investigators will use a communication strategy that leverages behavioral principles to motivate providers to improve health maintenance screening rates.

The investigators will implement a three-arm experimental communication campaign that includes monthly messages. The communication strategy will utilize behavioral change theory (particularly social comparison and recognition) to improve physician performance in health maintenance quality metrics.

This study will primarily focus on one quality domain of the PCCE incentive program-Clinical Quality. Two further quality domains of the PCCE incentive program will serve as exploratory measures: Patient Experience and Professional Participation.

For the primary outcome measure and high-priority secondary outcome measures, the investigators will first evaluate whether the combination of arms 2 and 3 differs from arm 1 in terms of the measures listed in the Outcome Measures section. If this comparison is statistically significant, the investigators will next compare arms 1 vs 2. and then, if also significant, the investigators will compare arms 1 vs 3 and 2 vs 3. For the 1 vs 3 and 2 vs 3 comparisons, we will use a Holm-Bonferroni p-value correction. These comparisons of treatment arms will be performed at the patient level using a mixed effects regression model, including random physician and clinic effects to account for clustering of patients. Control variables include (1) patient baseline order rates (or completion rates depending on the outcome measure) in July-October 2019, (2) patient characteristics (age, gender, comorbidity, insurance plan, zip code), and (3) physician characteristics (gender, race, years practiced, years at UCLA Health). Unless otherwise specified, p-values less than 0.05 will be considered statistically significant.

Being tested
Standard communication email, Social comparison Intervention, Leadership Training
Keywords
Behavioral Economics, Primary Health Care, Health Maintenance, Physician Reimbursement
Medical subject headings
Diabetes Mellitus

What participants receive

What participants receive. In a randomised study each person is assigned to one group by chance.

  • Standard communication emailBehavioural

    This is the base communication that all physicians will receive.

  • Social comparison InterventionBehavioural

    The social comparison is added onto the standard communication email to provide some peer comparison between the physicians.

  • Leadership TrainingBehavioural

    Clinic and Physician leads will be provided with a clinic leadership training seminars in leadership, quality improvement, and support from the Quality Improvement team at UCLA Health.

Study groups in NCT04237883
Study groupRoleWhat they receive
Arm 1: Standard Communication ArmPlacebo comparatorMonthly email communication: Monthly standard communication via email informing physicians of their health maintenance completion rate over the prior three-month period. The email will also include a link to the performance dashboard, a link to a FAQ page that outlines their incentive plan, a link to helpful resources such as care guidelines, key tips from top performers, the quality measure on which they are performing the best, and the two quality measures that they could improve on the most.
Receives: Behavioral: Standard communication email
Arm 2: Arm 1 Message + Social Comparison InterventionExperimentalMonthly email communication as in Arm 1 Social comparison: In addition to the information given in Arm 1 email messaging, physicians in this arm will receive a list of the names of the top 25 performers from the prior month, and a high performer benchmark. Each physician in this group will receive a personalized message and subject line based on where in the performance distribution they fall (categories: top 25 performers, high performers, nearly high performers, and low performers). Message content will incorporate language utilizing principles of social comparison theory.
Receives: Behavioral: Standard communication email; Behavioral: Social comparison Intervention
Arm 3: Arm 2 Interventions + Leadership trainingExperimentalMonthly email communication as in Arm 1 and Arm 2. Social comparison as in Arm 2. Quality improvement leadership training: Physician leads and clinic managers within clinics randomized to Group 3 will receive an in-person quality improvement and primary care clinic performance training, using the principles of quality improvement, self-determination theory and social comparison. Clinic leaders will be trained on how to guide these conversations, formulate their own performance/quality improvement goals, design effective strategies to reach these goals, and track their clinic's progress. Check-in emails and calls will be provided on a monthly basis to follow up on clinic-based quality improvement efforts and share key take-aways from the new Primary Care Clinical Excellence Recognition Program. This program aims to support a positive and collaborative culture of clinical excellence by recognizing and sharing best practices from high performing physicians and clinical teams.
Receives: Behavioral: Standard communication email; Behavioral: Social comparison Intervention; Behavioral: Leadership Training

What is being measured

The primary outcome is the main question the study is designed to answer.

  1. Aggregate Focus Quality Measure order rates at the first visit

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will consider all Focus Quality Measures open at his/her first visit to the PCP, and calculate the percent of these measures ordered within 7 days following his/her first visit.

    Focus Quality Measures include: Diabetes HGB A1C, Diabetes Eye Exam, Diabetes Foot Exam, Diabetes Nephropathy Monitoring, Colon Cancer Screening, Breast Cancer screening, Cervical Cancer Screening, chlamydia screening, and HPV depending on primary care specialty. These Focus Measures are based on the USPSTF primary care recommendations.

    [Note: The original intent was to run the study over an eight month period - from November 1, 2019 through June 30, 2020 - but was cut short due to the COVID-19 pandemic. Our revised time frame includes (1) four full cycles (months) of the intervention (11/05/2019-03/03/2020) and four months prior to the experiment as a baseline period]

    Measured: 9 months

Secondary outcomes (19)
  1. Aggregate Focus Quality Measure completion rates measured at the patient level

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will consider all Focus Quality Measures that are open between November 5, 2019 and March 3, 2020. We will calculate the percentage of these measures completed between November 5, 2019 and March 10, 2020 as well as the percentage completed between November 5, 2019 and July 3, 2020.

    Measured: 13 months

  2. Individual Focus Quality Measure order status at the first visit

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, for each Focus Quality Measure open at his/her first visit to the PCP, we will assess whether the open measure is ordered within 7 days following his/her first visit.

    Measured: 9 months

  3. Individual Focus Quality Measure completion status at the patient level

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, for each Focus Quality Measure open between November 5, 2019 to March 3, 2020, we will assess whether the measure is completed (1) between November 5, 2019 and March 10, 2020 as well as (2) between November 5, 2019 and July 3, 2020.

    Measured: 13 months

  4. Complementary Health Maintenance order rate at the first visit

    As measured by aggregate order rates for Complementary Health Maintenance Measures within seven days after each patient's first visit. Complementary Measures (Abdominal Aortic Aneurysm Screening, Osteoporosis Screening, Hepatitis C Screening, HIV Screening, Pneumococcal Vaccination, Tetanus Vaccination, Tdap Vaccination During Pregnancy, Shingles Vaccination, Meningitis Vaccination, Measles Mumps Rubella Vaccination, Polio Vaccination, Hepatitis A Vaccination, Hepatitis B vaccination, Pneumococcal Vaccination for Patients with Diabetes, Statin for Primary ASCVD Prevention, Aspirin for Secondary ASCVD Prevention, and Annual Wellness Visit) are based on USPSTF primary care recommendations regarding disease management, infectious disease screening, and standard vaccinations.

    Measured: 9 months

  5. Complementary Health Maintenance completion rate at the patient level

    As measured by patient level aggregate performance Complementary Health Maintenance Measures (1) between November 5, 2019 and March 10, 2020 as well as (2) between November 5, 2019 and July 3, 2020.

    Measured: 13 months

  6. Physician Burnout

    Physicians will be surveyed to evaluate their level of burnout throughout the study period.

    Measured: 9 months

  7. Physician Satisfaction

    Physicians will be surveyed for their satisfaction throughout the study period.

    Measured: 9 months

  8. Physician Experience

    Physicians will be surveyed regarding their provider experience throughout the study period.

    Measured: 1 year

  9. Physician Incentive Payouts

    Payment of performance based financial incentive to physicians throughout the study period.

    Measured: 1 year

  10. Patient Satisfaction

    Physician performance in patient satisfaction surveys throughout the study period.

    Measured: 1 year

  11. Profesional Participation

    Physician performance in professional participation will be based on provider/physician surveys throughout the study period.

    Measured: 1 year

  12. Aggregate Focus Quality Measure order rates measured at the patient level

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will consider all Focus Quality Measures that are open between November 5, 2019 and March 3, 2020, and calculate the percentage of these measures ordered between November 5, 2019 and March 10, 2020.

    Measured: 9 months

  13. Aggregate Health Maintenance (HM) order rates measured at the patient level

    HM order rate is determined by the aggregate order rate of measures within the primary care Health Maintenance module of EPIC EHR ("Focus Quality Measures") and other Quality Measures that are not in the Health Maintenance module ("Complementary Measures"). Both the Focus Quality Measures and Complementary Measures are based on USPSTF primary care recommendations regarding disease management, infectious disease screening, cancer screening, and standard vaccinations.

    Measured: 9 months

  14. Aggregate Health Maintenance (HM) completion rates measured at the patient level

    HM completion rate is determined by the aggregate completion rate of variables within the primary care Health Maintenance module of EPIC EHR ("Focus Quality Measures") and other Quality Measures that are not in the Health Maintenance module ("Complementary Measures").

    Measured: 13 months

  15. Individual Focus Quality Measure order status at the patient level

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, for each Focus Quality Measure open between November 5, 2019 to March 3, 2020, we will assess whether the measure is ordered between November 5, 2019 and March 10, 2020.

    Measured: 9 months

  16. The proportion of patients in the panel who visited a given physician

    For each primary care physician, we assign patients to their panel using an attribution model. This model assigns patients to a physician if they have been seen by that physician within the last 3 years. Additional patient attribution logic includes: 1) the physician with a preventive/wellness visit in the prior 1 year is attributed first, 2) if there is no preventive/wellness visit in the prior 1 year, the physician with the largest number of visits is attributed, and 3) if there is a tie in either the preventive/wellness visit or number of visit scenario, the physician with the most recent visit is attributed. Once patients are assigned using the above attribution model, patients who have at least one visit with their attributed physician from November 5, 2019 to March 3, 2020 will be included in our evaluation.

    Measured: 6 months

  17. New Patients

    For each physician, we will identify the number of new patients they have from November 5, 2019 to March 3, 2020.

    Measured: 6 months

  18. Number of Visits

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will measure the total number of times he/she visits the PCP from November 5, 2019 to March 3, 2020.

    Measured: 6 months

  19. Number of Open Tests

    For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will measure the number of open measures he/she has at the first visit as well as the total number of open measures he/she has from November 5, 2019 to March 3, 2020.

    Measured: 6 months

Timeline

From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.

  1. First posted23 Jan 2020
  2. Study start1 Nov 2019
  3. Primary completion1 Nov 2020
  4. Study completion1 Jan 2021

Resources

More details

For doctors and researchers: how the study is designed, who runs it, and its registry IDs.

Study design
Study type
Interventional
Phase
Phase N/A
Primary purpose
Health services research
Allocation
Randomised
Intervention model
Parallel groups
Model description
Parallel cluster randomized trial. Groups will be clustered at the clinic level taking into consideration total Clinical FTE, Primary Care network group, and baseline HM completion rates.
Masking
Single blind
Who is masked
Participant
Enrolment
225 participants (actual)
IDs, dates and publications
ClinicalTrials.gov ID
NCT04237883
Sponsor's protocol ID
12345
Acronym
PCCE
Status last verified
Jan 2021
First submitted
25 Dec 2019
Last updated
26 Jan 2021
Results posted
No
Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
Individual data sharing
No: There is no IPD sharing plan for this study.

Questions about this trial

What is this clinical trial studying?

A study testing Standard communication email, Social comparison Intervention and Leadership Training in people with Behavioral Economics and Primary Health Care, run by University of California, Los Angeles at 1 site in United States.

The full registered description is in the About this study section and the official record.

Who may be eligible to take part?

The sponsor lists 5 inclusion and 7 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.

Is this clinical trial currently recruiting?

The record says: finished, as of the sponsor's last update on 26 Jan 2021. Status can change between updates, so confirm with the study contact before making plans.

Where is the study taking place?

The record lists 1 site in United States. Whether a site is taking part right now should be confirmed with that site. See every site.

What are the possible benefits and risks?

They depend on the study and the treatment, and no study can promise a benefit. Some participants in this study may receive a placebo. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.

Are results available for this study?

The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.

How can a doctor refer a patient or contact the research team?

The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.

What does the primary outcome measure?

Aggregate Focus Quality Measure order rates at the first visit (time frame: 9 months). It is what the study was designed to measure, not a finding.

Where can I read the original study information?
Does a listing mean the treatment is approved or proven to work?

No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.

How often is this information updated?

AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 26 Jan 2021.

Free account

Keep searching with a free account

You’ve used your 3 free searches for this session. Log in or create a free AzTrials account to keep searching clinical trials and save the ones you want to follow.

Create a free accountLog in