Examples of Evaluations

While by no means exhaustive, the following list provides links to examples of evaluations TAACCCT third-party evaluators may find helpful. Neither the U.S. Department of Labor nor Abt Associates endorses these materials or their authors. Some materials are publicly available and hyperlinks have been provided. Others must be purchased either directly from the publisher or from a bookseller, or can be downloaded via journal access databases.

A resource that TAACCCT evaluators may find helpful is the www.CareerPathways.org website. The website is a repository for  information on the programs, research questions, and reports released by the Administration for Children and Families’ (ACF) Office of Planning, Research and Evaluation. It highlights evaluation reports from three initiatives supported by the federal government: the Health Profession Opportunity Grants (HPOG) program evaluations, the Pathways for Advancing Careers and Education (PACE) project, and the Career Pathways Intermediate Outcomes (CPIO) study.

Disclaimer: Neither Abt Associates, nor its TAACCCT evaluation partners, is responsible for the contents of any “off-site” web page referenced from this server or from private, third-party, pop-up, or browser-integrated software or applications. You are subject to that site’s privacy policy when you leave the TAACCCT Evaluation website. We are not responsible for Section 508 compliance (accessibility) on other websites.

 

Examples of Evaluations

Document Title/Link Description Author/Institute
Building Career Pathways for Adult Learners: An Evaluation of Progress in Illinois Minnesota and Wisconsin After Eight Years of Shifting Gears This report presents findings from an implementation evaluation of the Shifting Gears initiative. The report also presents analyses of adult basic education bridge program outputs and participant outcomes and summarizes findings from the outcomes studies conducted by Minnesota and Wisconsin. Brandon Robert and Derek Price (Brandon Roberts + Associates, LLC and DVP-Praxis, Ltd)
CLEAR: Clearinghouse for Labor Research and Evaluation CLEAR identifies and summarizes many types of research and evaluations. CLEAR also assesses the strength of causal evidence in studies that look at the effectiveness of particular policies and programs. CLEAR reviews studies in a variety of labor-related topic areas. U.S. Department of Labor's Clearinghouse for Labor Evaluation and Research
COURSES TO EMPLOYMENT: Partnering to Create Paths to Education and Careers This report summarizes results of outcomes study on the six programs in the Course to Employment initiative. Maureen Conway, Amy Blair, Matt Helmer (The Aspen Institute)
Design Options of the Search for Employment The document explores the potential for rigorous impact evaluations of alternative job search strategies. The project developed recommendations for potential research design options and analytic methods that could be used in an evaluation of job search strategies. Abt Associates, various authors
Fighting for Reliable Evidence This book documents the historical background of randomized experiments in program evaluation. Judith M. Gueron and Howard Rolston
Formative Evaluation of Job Clubs Operated by Faith- and Community-based Organizations: Findings from Site Visits and Options for Future Evaluation This implementation report describes the key characteristics of job clubs being offered by a range of faith- and community-based organizations and documents how they differ from and are similar to the job clubs operated by publicly-funded workforce agencies. John Trutko, Carolyn O’Brien, and Stephen Wandner (Capital Research Corporation, Inc.); Burt Barnow (George Washington University)
Health Profession Opportunity Grants (HPOG) Impact Study Design Report This report describes the research design of the HPOG Impact Study (HPOG-Impact), a randomized control trial, one of the initiatives in ACF's HPOG research portfolio. Laura R. Peck, Alan Werner, Alyssa Rulf Fountain, Jennifer Lewis Buell, Stephen H. Bell, Eleanor Harvill, Hiren Nisar, David Judkins, Gretchen Locke (Abt Associates)
How I-BEST Works: Findings from a Field Study of Washington State’s Integrated Basic Education and Skills Training Program This report documents findings from an implementation study of the Washington State I-BEST program. John Wachen, Davis Jenkins, and Michelle Van Noy with Kristen Kulongoski, Suma Kurien, Amanda Richards, Laurel Sipes, Madeline Weiss, and Matthew Zeidenberg (Community College Research Center Columbia University)
Interim Outcome Study Report. National Implementation Evaluation of the Health Profession Opportunity Grants (HPOG) to Serve TANF Recipients and Other Low-Income Individuals This report is part of the HPOG National Implementation Evaluation (NIE) and provides interim results on the key outcomes of HPOG healthcare training completion and employment, as well as on participants’ pre-training activities and receipt of support services and employment assistance. Pamela Loprest with Allison Stolte (The Urban Institute)
Implementation Analysis of High Growth Job Training Initiative (HGJTI) Programs This implementation report documents the U.S. Department of Labor’s High Growth Job Training Initiative and describes the structure and implementation of projects being implemented by selected grantees. Demetra Smith Nightingale, Lauren Eyster, John Trukto, Carolyn O’Brien, Kate Chambers (Urban Institute Center on Labor, Human Services, and Population)
Implementation Evaluation of the Community-Based Job Training Grant (CBJTG) Program This implementation report provides a comprehensive picture of the CBJTG-funded initiatives, innovations developed, implementation successes and challenges to date, and trends and patterns across projects. Lauren Eyster, Teresa Derrick-Mills, John Trutko, Jessica Compton, Alexandra Stanczyk, Demetra Smith Nightingale (Urban Institute Center on Labor, Human Services, and Population)
Initial Results of Illinois’ Shifting Gears Pilot Demonstration Evaluation This report provides initial findings from a mixed methods evaluation (implementation research and outcomes analysis) of Illinois’ Shifting Gears initiative. Debra D. Bragg, Timothy Harmon, Catherine L. Kirby, Sujung Kim (The Office of Community College Research and Leadership University of Illinois at Urbana-Champaign)
Opening Doors: More Guidance – Better Results? Three-year effects of an enhanced student services program at two community colleges This study examines the impact of the Opening Doors program at Lorain County Community College and Owens Community College in Ohio using a randomized control trial. Susan Scrivener and Michael Weiss (MDRC)
Serving Community College Students on Probation: Four-year findings from Chaffey College’s Opening Doors Program This study examines the impact of the two-semester Enhanced Opening Doors program at Chaffey Community College near Los Angeles, California using a randomized control trial. Michael Weiss, Thomas Brock, Colleen Sommo, Timothy Rudd Mary Clair Turner. (MDRC)
The First Year of Accelerating Opportunity: Implementation Findings from the States and Colleges This report documents initial findings of an implementation study of the Accelerating Opportunity initiative in Illinois, Kansas, Kentucky, North Carolina, and Louisiana. Theresa Anderson, Lauren Eyster, Robert I. Lerman (Urban Institute); Carol Clymer, Maureen Conway, Marcela Montes (The Aspen Institute)
Washington State's Integrated Basic Education and Skills Training Program (I-BEST): New Evidence of Effectiveness This study uses a quasi-experimental design to estimate the impact of Washington’s I-BEST program. It uses multivariate regression analysis, propensity score matching, and differences-in-differences. Matthew Zeidenberg, Sung-Woo Cho & Davis Jenkins (Community College Research Center Columbia University)