ETAs Performance Measurement System: EMILE and Performance Accountability Disability Program Navigat

1
ETAs Performance Measurement SystemEMILE and
Performance AccountabilityDisability Program
Navigator 2nd Annual TrainingChicago,
IllinoisNovember 15-17
Office of Performance and Technology Employment
and Training Administration
2
Todays Objectives

• Overview and introduction to ETA's Management
  Information and Longitudinal Evaluation (EMILE)
  reporting system
• Update on Whats Next with regard to EMILE and
  Common Measures
• Discussion of the barriers (perceived and real)
  to serving individuals with disabilities in an
  environment that is increasingly focused on
  performance and accountability

3
Workforce System Performance Improving
Performance Results

• Reporting performance is a fundamental element of
  improving customer services and good public
  administration
• Establishing common measures and standardizing
  customer data collection improves the
  comparability of performance results
• A single, streamlined reporting structure enables
  consistent measurement and understanding of
  program performance results
• Ensuring the accuracy and timeliness of
  performance results is necessary for
  demonstrating system integrity and value

4
Workforce System Performance Current Performance
Environment

• Different program performance measures create
  confusion among our customers and stakeholders
  who want to know about results
• Conflicting administrative requirements create
  barriers to service integration and performance
  measurement across programs
• States and grantees currently submit 21different
  reports and forms for ETA funded programs
• Lack of consistent information on services to
  employers to ensure a competitive workforce
• Outside oversight agencies, including OIG and
  GAO, have questioned the comparability and
  reliability of program data

5
Without common performance measures, ETAs 2003
budget submission explained that
Workforce System Performance Current Performance
Environment
In 8 Adult programs There were 4 different ways
to describe putting people into a job There
were 4 different ways to describe staying in a
job and There were 3 different ways to describe
earnings (4 of the programs didnt talk about
earnings).
Huh?
In 5 Youth programs There were 3 different ways
to describe getting a diploma.
6
Quick Refresher The Common Measures

• ADULT MEASURES
• Entered Employment
• Employment Retention
• Earnings Increase
• Efficiency

• YOUTH MEASURES
• Placement in Employment or Education
• Attainment of Degree or Certificate
• Literacy/Numeracy Gains
• Efficiency

• Although they will be an integral part of ETAs
  performance accountability system, the common
  measures provide only part of the information
  necessary to effectively oversee and describe
  results of the system. Additional data is needed
  (e.g., services to employers and jobseekers,
  client characteristics).

7
ETA Management Information Longitudinal
Evaluation (EMILE) Reporting System

• Eliminate and replace 12 separate and conflicting
  program reporting requirements with one reporting
  system
• Implement standardized data collection and report
  submission procedures for all ETA programs
• Provide management information that is timely,
  reliable, and useful, all in one report
• Focus on common results that have meaning to our
  customers employment for adults and skills for
  youth
• Support the establishment of a demand-driven
  system by collecting information on employers
  served
• Utilize performance data to encourage effective
  program design, high performance, and strategic
  partnerships with business

8
EMILE Reporting SystemCovered Programs

• Employment Service
• Veterans Employment and Training Service
• WIA Adult, Dislocated Worker, and Youth
• National Emergency Grants
• Trade Adjustment Assistance
• National Farm Worker Jobs Program
• Indian and Native American Program
• Senior Community Service Employment Program
• Other ETA-funded training and employment grants
  (H1-B and Youthful Offender Grants)

9
EMILE Reporting SystemMain Features

• Individual Record Layouts
• Standardized data collection on types of
  employers served and services provided to them
• Standardized data collection on participants
• Common definitions, formats and reporting
  instructions plus data unique to individual
  programs
• Individual records submitted on a quarterly basis
• This record includes data necessary to calculate
  outcomes for the common measures
• Quarterly Performance Report
• Common report format across ETA programs
• Includes common measures plus program-specific
  indicators of performance

10
Federal Register Notice Focus of Comments

• Is the proposed collection of information
  necessary for the proper performance of the
  functions of the agency?
• Is ETAs estimate of the reporting burden
  accurate?
• Are there ways ETA can enhance the quality,
  utility, and clarity of the information to be
  collected?
• Can you suggest ways to minimize the burden of
  collecting information, including the use of
  appropriate technologies to collect the
  information?
• What capability does the grantees have to submit
  universal records (as proposed) versus a
  statistically valid sample of individual records?
• Does the collection of types of disability have
  practical utility for enhancing services to
  persons with a disability in the One Stop?

11
Comment AreaCollection of Disability Information

• If a person indicates that he/she has a
  disability, that person would be given the
  opportunity to voluntarily disclose whether
  he/she has any one ore more of the following
  types of disability that substantially limits one
  or more major life activities

12

• Specific learning disability
• Orthopedic impairment
• Hearing impairment
• Mental/Emotional / Psychological impairment
• Visual impairment
• Drug addiction or alcoholism
• Speech impairment
• Other types of disability
• Cognitive impairment

13
EMILE Reporting System Where Do We Go From Here?
Sept 14, 2004
60-day public comment period for the proposed
EMILE reporting system ended. PROTECH works with
national and regional offices to reconcile public
comments. After comments are reconciled, ETA
re-posts in the Federal Register, and submits
EMILE reporting system to OMB for approval, which
opens a 30 day public comment period. Develop
a Transition Plan with the input of system
partners and stakeholders. ETA issues TEGL
announcing new reporting system.
Fall 2004
Winter 2005
Spring 2005
14
Questions or Comments?

• Questions about EMILE, common measures policies,
  and other data collection and reporting issues?
  The following DOL-ETA resources are available
• Regional Office Contacts
• Performance specialists
• Regional Federal Project Officers
• ETAs Division of Disability and Workforce
  Programs
• http//www.doleta.gov/disability/contacts.cfm

15

• ETAs Office of Performance and Technology
• ETAperforms_at_dol.gov or 202-693-3031
• Amanda Ahlstrand (ahlstrand.amanda_at_dol.gov)
• Brian Pasternak (pasternak.brian_at_dol.gov)
• Karen Staha (staha.karen_at_dol.gov)