2022-2025 Grant: Update and Simplify the VR ROI Model

New Return on Investment Models (ROI) for the Public Vocational Rehabilitation (VR) Program: Develop an Enhanced and Simplified ROI Model

This NIDILRR Field Initiated Development Grant number 90IFDV0028 was awarded to the George Washington University Center for Rehabilitation Counseling, Research, and Education for the period September 1, 2022 – August 31, 2025.

• North Carolina Division of Services for the Blind and Division of Rehabilitation Services.
• Consultants from the University of Richmond (professor emeritus), University of Virginia Department of Economics, Stoneybrook University Department of Economics, University of Chicago Harris School of Business, University of Montana Rural Institute

Develop VR-ROI models that help VR agencies provide efficient and effective services to persons with disabilities. The proposed models will provide guidance about the mix of services that provide superior outcomes and enable VR agencies to examine data across subgroups (i.e., race, geography).

Goal 1: Update Data. Our refined VR-ROI model uses agency data for individuals who applied for VR services between 2017 to 2021; i.e., after revised WIOA common performance measures were integrated into program data collection. Updated data allow investigation of correlations between common performance data elements and long-term employment outcomes, as well as COVID-impacted service provision and outcomes.

Goal 2: Measures of Service Intensity. Our post-WIOA model will include measures to account for VR-delivered service intensity, such as expenditures, service units, and variation between vendor and in-house provided services.

Goal 3: Simplified VR-ROI Model. We will explore the econometric characteristics of a simplified and more accessible version of the VR-ROI model that can be used by VR agencies across the country. This will put VR agencies in a better position to make timely decisions for enhancing services for their consumers with disabilities.

Goal 4: Knowledge Translation. We will use community-based participatory research methods with stakeholder groups to solicit input on model development and relevant products for understanding and utilizing VR-ROI models to improve VR services.

• Uses readily available administrative data on:
• • Characteristics of VR program participants
  • VR services provided.
  • Employment and earnings from state UI program records
• Conducts longitudinal analyses with up to 3 years of pre-VR employment data and at least 5 years of post-application data.
• Employs state-of-the-science statistical controls to ensure that the outcomes are the result of VR rather than other factors.

• Estimates employment & earnings impacts at the individual level
• Examines the impact of specific types of VR services on participants’ employment and earnings.
• Examines the impact of VR on employment and earnings for individuals with different kinds of disabling conditions.
• Estimates quarterly and annual rates of return (ROR) for specific populations as well as agency wide.

• Project input from stakeholder focus groups and Advisory Council meetings
• Meetings with staff from partner agencies to discuss approach and review results
• Presentations at Economic & Vocational Rehabilitation meetings
• Publications in Economic & Vocational Rehabilitation journals

2014-2021 Grant: The VR ROI Model

Estimating Return on Investment in State Vocational Rehabilitation Programs

This NIDILRR Disability and Rehabilitation Research Project grant number 90DP007001 was awarded to the University of Richmond for the period October 1, 2014 – September 30, 2019 and extended through 2021.

New Return on Investment Models (ROI) for the Public Vocational Rehabilitation (VR) Program: Develop an Enhanced and Simplified ROI Model

This NIDILRR Field Initiated Development Grant number 90IFDV0028 was awarded to the George Washington University Center for Rehabilitation Counseling, Research, and Education for the period September 1, 2022 – August 31, 2025.

• The Virginia Department of Aging and Rehabilitative Services and George Washington University.
• State Vocational Rehabilitation (VR) agencies in Delaware (general), Kentucky (general), Maryland (combined), North Carolina (general and blind), Texas (general and blind), and Virginia (general and blind).
• Consultants from the University of Virginia Department of Economics.

Goal 1: Refine and test the ROI model.  Further refine and test the VR-ROI model developed under a previous NIDILRR development grant using a larger, more heterogeneous set of state agencies and a more recent cohort of applicants for VR services (July 1, 2011 – June 30, 2012).

Goal 2: Training.  Provide training to interested state VR agencies and other stakeholders in the use of the ROI model and the Estimator to be developed through this project.

Goal 3: Dissemination. Disseminate project information nationally to VR audiences, other stakeholders, and economics & VR researchers. Nine agencies across five states partnered in this grant.

• Using readily available administrative data from a variety of sources (state VR agency client data systems, state Unemployment Insurance program wage records, Federal civilian employment records, and Social Security disability benefits data)
• Examining the impact of VR on employment and earnings for individuals with different disabling conditions (e.g., mental illness, intellectual disability, learning disabilities, physical impairments, blindness and vision impairments)
• Examining the impact of specific types of VR services on participants’ employment and earnings
• Starting to estimate VR’s impact when services begin, not when they end (i.e., applicant cohorts rather than closure cohorts)
• Conducting longitudinal analyses that include up to three years of pre-VR employment data and at least five years of post-application data
• Examining services provided over multiple VR cases
• Estimating annual rates of return for specific populations as well as agency-wide
• Employing statistical controls to ensure that the observed employment outcomes result from the provision of VR services rather than other factors

• Policy Brief, Speaker’s Kit, Introductory Webinar, Social Media, Journal Articles and Presentations
• Develop website: vrroi.org

• Continuous project input from stakeholder focus groups, Advisory Council meetings, and Learning Community feedback sessions
• Meetings with staff from partner agencies to discuss approach and review results
• Presentations at Economic & Vocational Rehabilitation meetings
• Publications in Economic & Vocational Rehabilitation journals

2010-2013 Grant: Developing Models for Assessing ROI

Enhancing Outcome-Based Performance Measures for the Public Vocational Rehabilitation Program:  Developing Models for Assessing Return on Investment

This NIDILRR Field Initiated Development Grant number 90IF000301 was awarded to the University of Richmond for three years (October 2010 – September 2013) and extended through 2015. Co-Principal Investigators David H. Dean and Robert M. Schmidt.

• The Virginia Department of Rehabilitative Services
• State Vocational Rehabilitation (VR) agencies in Maryland (combined), Oklahoma (combined), and Virginia (general and blind).
• Consultants from the University of Virginia Department of Economics, Florida State University Department of Economics, Virginia Commonwealth University Performance Management Group, University of Massachusetts – Boston Institute for Community Inclusion.

Goal 1: ROI model development and testing.  Identifying the necessary components for a sound ROI model for VR, using Virginia data to develop VR-specific outcome models, and validating these models with other state VR agencies, including the Virginia Department for the Blind and Vision Impaired, the Maryland Division of Rehabilitation Services, and the Oklahoma Department of Rehabilitation Services, using data from those states’ administrative records.

Goal 2: Model interagency agreements.  Development of model interagency agreements and protocols for accessing employment and earnings data from existing state administrative records and from SSA, testing those models with the partner states, and providing technical assistance in their use.

Goal 3: Guidance Documents.  Development and testing of guidance documents, and provision of technical assistance to partner state VR agencies, to conduct ROI analyses with their own states’ administrative data.

• Planned products include exemplars, tools, and guidance that other State VR agencies can use to develop and implement their own long-term outcome evaluation and ROI programs.

• Continuous project input from stakeholder focus groups, Advisory Council meetings, and Learning Community feedback sessions
• Meetings with staff from partner agencies to discuss approach and review results
• Presentations at Economic & Vocational Rehabilitation meetings
• Publications in Economic & Vocational Rehabilitation journals