Welcome to the Common Measures Webinar

1
Welcometo the Common Measures Webinar
Press 6 to mute your telephone Please do not put
your phone on HOLD In the chat box, please
enter and send us your MWA or organization name,
email address, and the names of everyone
participating at your location. Thanks!! Well
get started soon!
2
AGENDA

• Webinar Housekeeping
• Introductions
• Common Measures TEGL 17-05
• DLEG-BWP PI 05-41
• Performance Measures
• VAPIS
• MIS Changes

3

TEGL 17-05
4
Establishing Common Measures

• Effort led by OMB as part of Presidents
  Management Agenda
• Linking performance to budget
• Supporting effective programs
• Comparing similar programs across agencies
• Includes six federal departments

5
The Common Measures

• Adult Measures
• Entered Employment
• Employment Retention
• Average Earnings

Average Earnings become effective PY 2006
for PY 2005, the measure is an Earnings Change.
6
The Common Measures

• Youth Measures
• Placement in Employment or Education
• Attainment of a Degree or Certificate
• Literacy or Numeracy Gains

7
Common Measures Benefits

• Focus on the core purposes of the workforce
  system
• Break down barriers to integration
• Resolve questions regarding consistency and
  reliability of data
• Reduce confusion

8
PY 2005 Accountability

• Accountable for specific Common Measures
• Entered Employment Rate
• (WIA, W-P, VETS, Trade)
• Employment Retention Rate
• (WIA, W-P, VETS, Trade)

9
PY 2005 Accountability

• Accountable for specific WIA statutory
  performance measures
• Adult, DW, and OY Average Earnings
  Gain/Replacement (WIA, W-P, VETS, Trade)
• Adult and DW Employment and Credential
• OY Entered Employment, Retention, Earnings,
  Credential
• YY Retention, Skill Attainment, Diploma
  Attainment
• Customer Satisfaction (Participants and
  Employers)

10
PY 2005 Accountability

• Accountable for reporting on specific Common
  Measures
• Youth Attainment of Degree/ Certificate
• Youth Placement in Employment/ Education

11
PY 2005 Accountability

• Reporting recommended for Youth Literacy/Numeracy
• Required beginning in PY 2006
• WIA performance accountability for PY 2005 still
  consists of the 17 measures
• With some changed definitions

12
Program Reporting

• In general, individuals who are eligible for a
  program and receive any service should be
  reported in
• participant counts

13
Youth Program Design Implication 1Long-Term
Participation

• Common Measure outcomes are unlikely to be met
  unless youth participate for extended periods

14
Youth Program Design Implication 2Network of
Services

• Since long-term participation is needed to
  achieve outcomes, now more than ever, WIA youth
  must have access to a network of services, not a
  single program or provider

15
Youth Program Design Implication 3Assessment

• Youth friendly assessments
• Tell youth why they are being tested and how the
  test will be used
• Do not retest too soon
• Consider other assessments
• Remove the high-stake test pressure

16
QUESTIONS
17
DLEG BWP PI 05-41
18

• Definition
• of a
• Participant

19

• Required
• Data
• to Record
• Participant
• Counts

20

• Services
• That
• Commence
• Participation

21

• Definition
• of an
• Exiter

22

• Services
• That
• Extend the
• Exit Date

23

• Services
• That Do Not
• Commence
• Participation
• or
• Extend Exit

24
QUESTIONS
25
Performance Measures
26
Adult Common Measures

• Entered Employment Rate
• Employment Retention Rate
• Average Earnings

27
Programs Covered

• WIA Adult
• WIA Dislocated Worker
• Trade Act
• Wagner-Peyser
• VETS

28
Entered Employment Rate

• Definition For those not employed at
  participation, the percentage employed in the 1st
  quarter after exit

29
Entered Employment Rate

• Calculation Of those not employed at
  participation
• Number employed in 1st quarter after exit
• Number who exit during the quarter

30
Highlights of Adult Entered Employment Rate

• Excludes Adults employed at participation
• Employment at participation is based on
  information collected from the individual

31
Highlights of Adult Entered Employment Rate

• Those who received a notice of termination or the
  employer has filed a WARN or similar notice are
  considered not employed
• Transitioning Service Members (expected to retire
  within 12 months) are considered not employed

32
Employment Retention Rate

• Definition For those employed in the 1st quarter
  after exit, the percentage employed in the 2nd
  and 3rd quarter after exit
• Calculation Of those employed in the first
  quarter after exit
• Number employed in the 2nd and 3rd quarter after
  exit
• Number who exit during the quarter

33
Highlights of Adult Employment Retention Rate

• Includes all those employed in the 1st quarter
  after exit regardless of employment status at
  participation
• Positive outcome requires employment in two
  post-exit quarters (does not have to be with the
  same employer)

34
PY 2006 Average Earnings

• Definition For those employed in the 1st, 2nd,
  and 3rd quarter after exit, average six-month
  earnings in the 2nd and 3rd quarter after exit

35
PY 2006 Average Earnings

• Calculation
• Of those employed in the 1st, 2nd and 3rd
  quarters after exit
• Earning from the 2nd and 3rd quarter after exit
• Number who exit during the quarter

36
Highlights of Adult Average Earnings

• Includes those employed in 1st, 2nd, and 3rd
  quarter after exit
• Only allowable data source is wage records

37
Highlights of Adult Average Earnings

• Those whose employment was determined based on
  supplemental data are excluded from the earnings
  measure
• WIA programs will use the current Adult Earnings
  Change measure for PY 2005

38
QUESTIONS
39
Youth Common Measures

• Placement in Employment or Education
• Attainment of Degree or Certificate
• Literacy/Numeracy Gains

40
Program Covered

• WIA Youth

41
Placement in Employment or Education

• Definition Of those not in post-secondary
  education, employment, or the military at
  participation, the percentage in employment, the
  military or enrolled in post-secondary education
  and/or advance training/occupational skills
  training in the 1st quarter after exit.

42
Placement in Employment or Education

• Calculation
• Of those not employed, in the military, or in
  post-secondary education at participation
• Number of youth employed, in the military, or
  enrolled in post-secondary education and/or
  advanced training or occupational skills training
  in the 1st quarter after exit
• Number of exiters

43
Highlights of Youth Placement in Employment or
Education

• Excludes youth in employment, the military, or
  post-secondary education at participation
• Employment, military, and education status at
  participation is based on information collected
  from the individual
• Employment and military status in the 1st quarter
  after exit is based on wage records (supplemental
  data allowed)

44
Highlights of Youth Placement in Employment or
Education

• Education status in the 1st quarter after exit is
  based on administrative records
• Youth in secondary school at exit are included,
  consistent with ETAs vision to ensure youth
  successfully complete their secondary education

45
Defining Specific Terms

• Post-Secondary Education
• A program at an accredited degree-granting
  institution leading to an academic degree.

46
Defining Specific Terms

• Advanced
• Training/Occupational
• Skills Training

47
Attainment of Degree or Certificate

• Definition Of those enrolled in education at or
  during participation, the percentage who attained
  a diploma, GED, or certificate by the end of the
  3rd quarter after exit.

48
Attainment of Degree or Certificate

• Calculation
• Of those enrolled in education at participation
  or any time during the program
• Number or youth who attained a diploma, GED, or
  certificate by the end of the 3rd quarter after
  exit
• Number of exiters

49
Highlights of Youth Attainment of Degree or
Certificate

• Youth in secondary school at exit are included,
  which is consistent with ETAs vision to ensure
  youth successfully complete their secondary
  education

50
Highlights of Youth Attainment of Degree or
Certificate

• Diplomas, GEDs, or certificates can be obtained
  during participation or at any point by the end
  of the 3rd quarter after exit
• Work readiness certificates will not be accepted
  for this measure

51
Defining Specific Terms

• Education
• Participation in secondary or post-secondary
  school, adult education programs, or any other
  organized program of study leading to a degree or
  certificate

52
Defining Specific Terms

• Diploma
• Any credential accepted by the State educational
  agency as equivalent to a HS diploma also
  includes post-secondary degrees

53
Defining Specific Terms

• Certificate
• Awarded in recognition of an individuals
  attainment of technical or occupational skills.
• Does not include work readiness certificates or
  certificates awarded by local boards.

54
Literacy/Numeracy Gains

• Definition Of those out-of-school youth who are
  basic skills deficient, the percentage who
  increase one or more education functioning levels
  within one year of participation.

55
Literacy/Numeracy Gains

• Calculation
• Of those out-of-school youth who are basic
  skills deficient
• Number of Youth participants who increase one or
  more educational functioning levels

Number of youth who completed a year of
participation (based on date of 1st youth service)
Number of youth who exit before completing a year
of participation
56
Highlights of Literacy Numeracy Gains

• Only common measure that is not exit-based
• Excludes in-school youth and out-of-school youth
  who are not basic skills deficient
• Includes individuals with learning disabilities

57
Highlights of Literacy /Numeracy Gains

• A positive outcome means the youth must advance
  one or more ABE or ESL functioning levels
• Gains can occur in literacy or numeracy
• Educational levels are consistent with Department
  of Educations National Reporting System (NRS)
• Reporting begins July 1, 2006

58
About the Assessments

• The same standardized assessment must be used for
  
• pre- and post-testing

59
About the Assessments

• If a youth continues to be basic skills deficient
  after the first 12 months of participation, they
  should continue to receive training in literacy
  and/or numeracy skills

60
About the Assessments

• All out-of-school youth must be assessed in basic
  reading, writing, and math

61
About the Assessments

• Pre-testing must occur within 60 days of the
  first youth program service can use pre-test
  from up to six months prior to date of first
  youth service

62
About the Assessments

• Must use one of the assessment tools listed in
  Attachment C of TEGL 17-05

63
About the Assessments

• Youth should be post-tested by the end of one
  year of participation and compared to pre-test
  results obtained during the initial assessment

64
About the Assessments

• Youth should be post-tested and included in the
  measure at the completion of the 2nd year if they
  complete two years in the program

65
Exclusions from Common Measures

• A participant in any of the following categories,
  may be excluded
• Institutionalized
• Health/Medical or Family care
• Deceased
• Reserve Forces Called to Active Duty
• Relocated to a Mandated Program
• Invalid or Missing Social Security Number

66
WIA Program Accountability

• MWAs will continue to be held accountable for all
  current (17) WIA performance measures
• WIA Adult performance measures will utilize the
  Adult Common Measures definitions

67
QUESTIONS
68
V A P I S
VALUE ADDED PERFORMANCE IMPROVEMENT SYSTEM
69
VAPIS

• Provides adjusted performance data for the State
  and local areas.
• Predicts local area performance.
• Provides data to support identification of local
  area strengths and weaknesses, leading to system
  improvements.

70
Programs Included

• WIA Adult
• WIA Dislocated Worker
• Wagner-Peyser

71
Common Measures

• Entered Employment Rate
• Employment Retention Rate
• Average Earnings

72
Quarterly VAPIS Report by Program Measure

• Actual and Adjusted performance results.
• Prediction of future performance results.
• Measure of Value Added by local area.

73
QUESTIONS
74
(No Transcript)
75
Common Terminology

• Participant Enrollment Registrant
• Activity Service Transaction

76
Participant Counts
For new participants in Wagner-Peyser, the
system will create a new participant in WIA.
77
Participant Counts
For new participants in WIA, the system will
create a new participant in Wagner-Peyser.
78
Participant Counts
For new participants in Trade, the system will
create a new participant in Wager-Peyser and WIA.
79
Wagner-Peyser Changes
The activity Assigned to Case Management will
now require a manual End Date entry.
80
Wagner-Peyser Changes

• Exit information will be available for User Input
• All records will now have an Exit Date

81
WIA Changes
The pre-registration screen will be altered to
capture Employment Status, Education Status, UI
Claim Data and Migrant Worker
82
WIA Changes
A new section for Youth Assessment data will be
added to the system
83
WIA Changes
A temporary Exit Date will be added for User
input
84
Estimated Activity End Dates

• All activities that have Manual End Dates will
  have the Estimated End Date pre-filled by the
  system

85
Reports

• A new report will be created to list those
  individuals who are approaching the 90-day Exit
  limit.

86
Conversion of Data
All WIA pre-registration, pending Trade and
Wagner-Peyser records that are 91-days old or
more will be Exited
87
Conversion of Data
All other records will be checked to determine
if they can be considered a concurrent
participation
88
Conversion of Data
All records 90-days old or less will have a new
display page showing concurrent participation and
other information pertaining to when the record
will be Exited
89
Open Record Display Information 1
Latest Reg. Date 01/01/2006 Has Activities Y Latest Act End Date 03/04/2006

Wagner-Peyser? Y WIA Y TAA? N

Latest Gap Date 06/07/2006 Latest Future Svc ----- When Exit Will Occur 06/08/2006
90
Open Record Display Information 2
Latest Reg. Date 01/01/2006 Has Activities Y Latest Act End Date 03/04/2006

Wagner-Peyser? Y WIA Y TAA? N

Latest Gap Date Latest Future Svc ---- When Exit Will Occur 06/05/2006
91
Open Record Display Information 3
Latest Reg. Date 01/01/2006 Has Activities Y Latest Act End Date

Wagner-Peyser? Y WIA Y TAA? N

Latest Gap Date Latest Future Svc ----- When Exit Will Occur
92
Exited Record Display Information
Latest Reg. Date 01/01/2006 Has Activities Y Latest Act End Date 03/04/2006

Wagner-Peyser? Y WIA Y TAA? N

Latest Gap Date Latest Future Svc Exit Date 03/04/2006
93
Exit from the System
The system will now Exit all Records
94
Exit from the System
The Exit will occur 90-days after the latest
Activity has Ended and there are no GAPs or
Future Services planned.
95
Exit from the System
For concurrently enrolled participants, all
records will have the same Exit Date.
96
Exit from the System
For concurrently enrolled participants, if an
Exclusionary Exit reason is recorded in any of
the programs, that reason will be used for all of
the programs.
97
Questions
98
www.michigan.gov/bwptraining
99
For More Information and Q AsPlease Visit

• www. Michigan.gov/bwptraining
• Common Measures

100
(No Transcript)