Impact Evaluation Projects

Policy context: In 2015, DOL instructed states to use their RESEA grants to implement programs that would require new UI claimants to undergo an eligibility review to confirm that they are compliant with state UI work-search requirements and receive services that would help them connect to available jobs. Missouri was among many states that adopted DOL’s recommendations.

Research design: Conduct an RCT impact study that randomly assigns RESEA-eligible UI claimants into three groups: (1) program group A (required to attend an RESEA session in week 2 of their UI claim); (2) program group B (required to attend an RESEA session in week 6 of their UI claim); and (3) control group (no requirements). Use Missouri administrative data to estimate the impacts of the RESEA program on participant UI spells, UI benefit amounts collected, employment rates, and earnings. Of particular interest is to identify the relative value of requiring a one-time meeting early in participants’ claims versus later in their claims. The study also includes an implementation study that uses information from stakeholder interviews, document reviews, and program observations to examine how Missouri RESEA was implemented and the processes used for delivering services. 

Policy impact. The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meet the CLEAR high or moderate causal evidence rating requirement set by DOL. The current study will produce evidence that meet the high causal evidence CLEAR criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the Missouri RESEA program. In addition, this study will establish the relative value of providing RESEA services to participants early in their UI claims versus later in their UI claims (i.e., before and after most of them had time to engage in meaningful search activities).

Policy context: In 2015, DOL instructed states to use their RESEA grants to implement programs that would require new UI claimants to undergo an eligibility review to confirm that they are compliant with state UI work-search requirements and receive services that would help them connect to available jobs.  

Research design. Conduct an RCT impact study of the Colorado RESEA program which randomly assigns RESEA-eligible claimants to a treatment group (required to participate in RESEA) and a control group (no RESEA requirements). The study will use Colorado administrative data to measure the impacts of the program on (i) total earnings in the 18-month period following program entry; and (ii) the total benefit amount collected before UI exit.  

Policy impact. The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meet the CLEAR high or moderate causal evidence rating requirement set by DOL. The current study will produce evidence that meet the high causal evidence CLEAR criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the Colorado RESEA program. 

Policy context: In 2015, DOL instructed states to use their RESEA grants to implement programs that would require new UI claimants to undergo an eligibility review to confirm that they are compliant with state UI work-search requirements and receive services that would help them connect to available jobs. Kansas was among many states that adopted DOL’s recommendations.

Research design. Conduct an RCT impact study that randomly assigns RESEA-eligible UI claimants into two groups: (1) RESEA group to participate in RESEA and (2) control group (no requirements). Using Kansas administrative data, the study will estimate the impacts of the RESEA program on participant UI and reemployment outcomes. In addition, the study will identify the relative value of offering services remotely and allowing self-scheduling of RESEA meetings. The study also includes an implementation assessment to examine how the Kansas RESEA was implemented and the processes used for delivering services. 

Policy impact. The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meets the CLEAR high or moderate causal evidence rating requirement set by DOL. The current study will produce evidence that meets the CLEAR high causal evidence criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the Kansas RESEA program.

Policy context: PowerCorpsPHL uses a work-based, classroom, and socio-emotional learning model to address the underutilized talents of Philadelphia’s disconnected youth adults (ages 18 – 28). The program engages this youth in AmeriCorps service and prepares them for career-track and employment and post-secondary education success in the green jobs sector.

Research design: The study includes an outcomes assessment study which relies on participant-level data to assess program success in recruiting its target population and providing services to participants and examine whether program participation is associated with improved labor market outcomes. The study also uses Unified Judicial System of Pennsylvania data to assess if program participation is associated with reduced engagement in criminal activities. The study also includes a quasi-experimental impact evaluation, which matches program participants with observationally similar individuals who lived in the same areas as did program participants and sought state employment and training services during the same period. Using Pennsylvania UI wage records, the study examined if program participants had improved employment and earnings outcomes following program entry compared with similar individuals who did not participate in the program.

Policy impact:  Preliminary findings from the outcomes study show that the program was effective in serving its target population, achieving high retention rates, and helping participants obtain industry credentials. Program participation is also associated with reduced future involvement with the criminal justice system. Preliminary quasi-experimental impact study results indicate that the program increased the likelihood that participants would engage in paid employment and increased job retention; there were also short-term impacts on earnings. Results from this study will inform decisions about providing additional program funding to expand program capacity.

Click here for the PowerCorpsPHL Impact Evaluation full report.

Click here for the PowerCorps PHL evaluation infographic.

Policy context: In 2015, DOL instructed states to use their RESEA grants to implement programs that would require new UI claimants to undergo an eligibility review to confirm that they are compliant with state UI work-search requirements and receive services that would help them connect to available jobs. North Carolina was among many states that adopted DOL’s recommendations.

Research design. Conduct an RCT impact study that randomly assigns RESEA-eligible UI claimants into the RESEA group (required to participate in the program) or the control group (exempt from program requirements). Use North Carolina administrative data to estimate the impacts of the program on UI spells, UI benefit amounts collected, employment rates, and earnings. Also, conduct an implementation study that uses information from stakeholder interviews, document reviews, and program observations to examine how North Carolina RESEA was implemented during the period of random assignment and the processes used for delivering services. 

Policy impact. The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meet the CLEAR high or moderate causal evidence rating requirement set by DOL. The current study will produce evidence that meet the high causal evidence CLEAR criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the North Carolina RESEA program. 

Policy context: In 2015, DOL instructed states to use their RESEA grants to implement programs that would require new UI claimants to undergo an eligibility review to confirm that they are compliant with state UI work-search requirements and receive services that would help them connect to available jobs. Iowa was among the first states to implement a program that met these requirements; however, while most states implemented RESEA programs that required participants to attend a one-time meeting, Iowa required participants to attend weekly RESEA meetings throughout their UI spells.

Research design: Conduct an RCT impact study that randomly assigns RCM/RESEA-eligible UI claimants into the program group (required to receive services) or the control group (no program requirements). Use Iowa administrative data to estimate the impacts of the RESEA program on participant UI spells, UI benefit amounts collected, employment rates, and earnings. The study also includes an implementation study that uses information from stakeholder interviews, document reviews, and program observations to examine how Iowa RCM/RESEA was implemented and the processes used for delivering services. 

Policy impact: The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meet the CLEAR high or moderate causal evidence rating requirement set by DOL. The current study will produce evidence that meet the high causal evidence CLEAR criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the Iowa RCM/RESEA program. This study will also identify the impact of requiring participants to attend meetings throughout their UI spells relative to the usual practice of requiring a one-time meeting.

Policy context: In 2015, DOL instructed states to use their RESEA grants to implement programs that would require new UI claimants to undergo an eligibility review to confirm that they are compliant with state UI work-search requirements and receive services that would help them connect to available jobs. Wisconsin was among the first states to implement a program that met these requirements.

Research design: Conduct an RCT impact study that randomly assigns RESEA-eligible UI claimants into three groups: (1) RESEA group (required to attend a one-time RESEA session); (2) RESEA+ group (required to attend an initial and a follow-up RESEA session); and (3) control group (no requirements). Use Wisconsin administrative data to estimate the impacts of the RESEA program on participant UI spells, UI benefit amounts collected, employment rates, and earnings. Of particular interest is to identify the relative value of requiring a one-time meeting or multiple meetings. The study also includes an implementation study that uses information from stakeholder interviews, document reviews, and program observations to examine how Wisconsin RESEA was implemented and the processes used for delivering services. 

Policy impact: The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meet the CLEAR high or moderate causal evidence rating requirement set by DOL. The current study will produce evidence that meet the high causal evidence CLEAR criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the Wisconsin RESEA program. In addition, this study will establish the relative value of requiring participants to attend a follow-up meeting after their initial meeting relative to the standard practice of requiring participants to attend a one-time meeting. 

Click here for Wisconsin RESEA Seond Annual Report.

Click here for second Annual Report infographic.

Policy context: In 2005, the U.S. Department of Labor (DOL) offered grants to states to implement the Reemployment and Eligibility Assessment (REA) program, which required new UI claimants to undergo an eligibility review to confirm compliance with work search requirements. Nevada was among the first states to implement REA but, in addition to the eligibility review, the Nevada REA program provided claimants with job counseling. In 2015, following promising evidence on the effects of the Nevada program, DOL instructed states to use their Federal RESEA grants to implement programs that required new UI claimants to both undergo an eligibility review and receive job counseling.

Research design: Conduct an RCT impact study that randomly assigns RESEA-eligible UI claimants into the program group (required to participate in the RESEA program) or into the control group (exempt from program requirements). Use Nevada administrative data to estimate the impacts of the program on UI spells, UI benefit amounts collected, employment rates, and earnings. Also, conduct an implementation study that uses information form stakeholder interviews, document reviews, and program observations to examine how Nevada RESEA was implemented and the methods and processes used for delivering services. 

Policy impact: The Bipartisan Budget Act of 2018 authorized the permanent and nationwide implementation of the RESEA program and encouraged states to conduct evaluations to build evidence that meet the high or moderate causal evidence rating requirement of DOL’s Clearinghouse for Labor Evaluation and Research (CLEAR). The current study will produce evidence that meet the high causal evidence CLEAR criteria, thereby contributing to the portfolio of evidence-based practices in this policy area and justifying continued Federal funding for the Nevada RESEA program.

Click here for the Nevada RESEA Interim Report.

Click here for the Interim Report infographic.