Family Champions Project

Efforts to conduct CQI are in the early stages of development in the field of Healthy Marriage and Relationship Education (HMRE). The Office of Family Assistance (OFA) has required HMRE grantees to conduct CQI as part of project activities since funding began for them in 2006. However, HMRE grantees have likely not bought into the CQI Process given the absence of user-friendly conceptual frameworks to guide CQI efforts and empirical evidence to demonstrate they improve implementation of project activities and, in turn, enhance participant outcomes that might be attributed to them.

The CQI Process used in this study was developed by Dr. Theodore C. Jurkiewicz and then enhanced after starting work at MER, and it begins by forming a CQI-Team. The CQI-Team is a collaboration between practitioners with the authority to make implementation decisions about the FCP and evaluators at MER who handle data analyses and reporting.

The CQI Team carries out a multistep plan that is repeated each program year to fully implement FCP educational services over time by using a series of indicators to track performance trends for various outputs from a different perspective in each step. Percentage of target enrollment, percentage of target population that reflect eligibility characteristics, hours of dosage received by participants, response rates to participant surveys that measure outcomes among other indicators and outputs are tracked for monthly and quarterly enrollment cohorts in each program year and presented in CQI Reports that take the perspective associated with each of the steps. The CQI Team discusses findings presented by evaluators for overall performance trends in bi-weekly reports for the 1st step and performance trends by site in quarterly reports presented twice per year for steps 2 and 3. Then, members of the CQI-Team collaborate with front line service staff to develop interventions for any performance trend with an output that seems likely to fall short of standards by the end of the program year. Effects of interventions on outputs are reported by site in step 4.

Ultimately, successful performance interventions designed and implemented by the CQI Team in collaboration with front-line service staff should improve the outputs associated with FCP services over time, and the most immediate impact should be evident in participant retention rates. Interventions that lead to higher enrollment and then improved attendance should lead to a higher incidence of complete program status (active, complete, not in program), which means FCP services are being delivered to more participants in larger doses. Larger doses of services delivered to participants after performance interventions which means the CQI Team is facilitating progress to meet performance standards because participants receive the amounts of FCP services intended for them.

What is more, higher retention rates over time should lead to improved short-term outcomes for participants. Participants who receive larger doses of FCP services after performance interventions should acquire more knowledge in educational sessions than those who receive smaller doses. However, rigorous measures of participant knowledge are not available because it was not possible to get full access to proprietary curricula to develop them. Consequently, participant attitudinal changes will be the only focus for measuring short-term outcomes in this study. Attitudes change more quickly in healthy and productive ways after merely exposing participants to new ways of thinking about parenting, handling finances, or accessing employment with curriculum content in the FCP.

Finally, FCP services cannot determine participant outcomes but only contribute to them amongst a host of other factors, which makes it difficult for a descriptive study to link behavioral change to CQI efforts. Healthier and more productive behaviors take time to emerge, develop, and hopefully replace old behaviors because they are subject to a host of other influences on FCP participants. What is more, low-income individuals in the FCP target population, especially those who are parents, experience changing life circumstances more often than those from wealthier households that make them more vulnerable to a host of risk-related factors, such as unstable employment, tenuous housing situations, or limited sources of support that are available from family and friends. Changing life circumstances for low-income individuals make it more difficult for FCP services to have a positive, lasting impact on their behavior.

In sum, immediate effects of successful performance interventions that result from the CQI Process should be evident in retention rates for FCP services over time because they are being delivered to more participants in larger doses, as indicated by more hours of attendance in TYRO Leadership and Core Communication workshops and higher workshop completion rates. Higher retention rates mean more participants acquire more knowledge from curriculum content to influence their attitudes about partner relationships.