Document Tag: evaluation
Completion Grants: A Multi-Method Examination of Institutional Practice (2021)
Public universities are intent on increasing degree completion for many reasons. A stronger policy focus on completion and interest in removing students’ financial hurdles has led to a rapid proliferation of completion grant programs. This paper reports on a mixed method implementation study of completion grant programs at seven broad- and open-access universities. Drawing on case studies of completion grant programs and student surveys, we examine the work of the administrators and professionals who create and implement these programs. As it can diminish program efficacy and increase inequality, we pay particular attention to administrative burden for staff and students. We consider how the implementation of completion grant programs vary and how these variations are associated with administrative burden. We also analyze the drivers of variation in that administrative burden, and describe model elements for administering completion grants that aim to minimize administrative burden and maximize efficacy.
Impact of Transportation Supports on Students’ Academic Outcomes: A Quasi-Experimental Study of the U-Pass at Rio Hondo College (2021)
For many students, transportation presents a barrier to college completion. In 2020–21, the average commuter student could expect to spend nearly one-fifth of their total living expenses on transportation costs.1 Transportation programs have the potential to offer students some relief—and help them reach college graduation—yet more rigorous research on these programs’ benefits is needed. This brief provides results from a quasi-experimental study on the impact of transportation supports on short- and longer-term academic outcomes for community college students at Rio Hondo College. Established in 2016 as a partnership between the Los Angeles County Metropolitan Transportation Agency (LA Metro) and participating area colleges and universities, including Rio Hondo College, the Universal College Student Transit Pass (U-Pass) provides college students with deeply discounted transit fares. Findings from this study suggest that transportation supports like U-Pass offer a promising strategy for increasing the likelihood that students will: •remain enrolled one semester and one year later; •complete a greater number of credits; and, •earn a credential. While more research on similar programs is needed, these findings suggest that free- and reduced-cost transit fares could play a critical role in helping students earn college credentials.
A First Look at the Impacts of the College Housing Assistance Program at Tacoma Community College (2021)
Affording living expenses presents a major barrier to degree completion for many community college students. Food, affordable housing, transportation, and childcare are central conditions for learning. Yet with stagnant incomes, rising tuition and living costs, and insufficient support from financial aid and the social safety net, approximately one in two community college students struggle to afford these basic needs.1 Additionally, as many as one in five experience homelessness.2 The College Housing Assistance Program (CHAP), operated by the Tacoma Housing Authority (THA) and Tacoma Community College (TCC), is at the forefront of the nationwide fight to ameliorate homelessness among college students.3 CHAP is one of the country’s first partnerships between a housing authority and a community college and offers a unique model. In contrast to other programs such as student-run shelters, rapid-rehousing, and college-owned affordable apartments, CHAP utilizes government-subsidized housing assistance to provide housing to homeless and near-homeless community college students. This report offers the initial lessons learned from the first external evaluation of CHAP. Successful program implementation is crucial to providing benefits for students, and can be especially challenging in housing programs. We therefore focus on how students experienced the program, where they faced barriers, and where they found support. It is too early in the evaluation process to draw conclusions about the program’s efficacy; these are short-term insights.
From the (Academic) middle to the top: an evaluation of the AVID/TOPS college access program (2018)
Despite overall increases in college-going, college enrollment rates
remain inequitable. Many programs attempt to address these persistent racial/ethnic and social class disparities in college attendance by
intervening in the high school curriculum. Advancement Via
Individual Determination (AVID) is among the longest standing and
prevalent of these college access programs. In this paper, we present
findings from a multi-year evaluation and cost analysis of the AVID/
TOPS program – an enhanced AVID model – in place in Madison
Metropolitan School District (Wisconsin). Taken together, the evaluation’s findings characterize AVID/TOPS as a promising program
model that is associated with an increased likelihood for college
readiness and matriculation, particularly for student groups underrepresented in higher education. We also report on the resources and
costs required to implement the program, and show that the program’s benefits appear to exceed its costs.
Houston Food Scholarship Program Report (2020)
This report describes program implementation and impact of one of the nation’s first food
scholarship programs: the Houston Food Scholarship (HFS), a partnership between Houston
Community College and the Houston Food Bank. The food scholarship was first distributed in
January 2018, and this report examines its early stages, as well as rigorously estimating impacts
through spring 2019.
Improving the Productivity of Education Experiments (2012)
Given scarce resources for evaluation, we recommend
that education researchers more frequently conduct
comprehensive randomized trials that generate evidence
on how, why, and under what conditions interventions
succeed or fail in producing effects. Recent experience
evaluating a randomized need-based financial
aid intervention highlights some of our arguments and
guides our outline of the circumstances under which
the examination of mechanisms and heterogeneous impacts
is particularly important. Comprehensive experiments
can enhance research productivity by increasing
the number of theories both tested and generated and
can advance policy and practice by exploring the conditions
under which interventions will bemost successful
in scale up. Paradoxically,while the emphasis on average
treatment effects is typically associated with efficiencyminded
economists, we argue that the approach is often
inefficient from the standpoints of science and policy.
Meal Vouchers Matter for Academic Attainment: A Community College Field Experiment (2023)
Given growing awareness of the high prevalence of food insecurity among college students, higher education leaders are
implementing various food interventions on their campuses. However, there is little research on the efficacy and impact of
these initiatives. Using data from a field randomized control trial, we find that a relatively modest financial investment in
campus meal cards coupled with proactive outreach by an existing campus office improved community college students’
academic attainment outcomes. Students who were invited to participate in the meal voucher program attempted and
completed more credits during their first year of college and were more likely to graduate in 2 years than otherwise similar
peers, indicating that a campus meal program can promote college success.