The ED 524B, Grant Performance Report Grants To Reduce Alcohol Abuse

1
The ED 524B, Grant Performance Report Grants To
Reduce Alcohol Abuse

• Dr. Anne DAgostino
• Compass Consulting Group, LLC

2
Overview of Session

• Introductions
• The Data Quality Initiative
• The Government Performance Results Act (GPRA)
• GPRA indicators for GRAA
• Reporting GPRA data for GRAA

3
The Government Performance Results Act (GPRA)

• A law passed in 1993 that requires federally
  funded agencies to develop and implement an
  accountability system based on performance
  measurement.
• Requires all federally funded programs to
• Outline long-term and annual performance goals
  that include outcomes,
• Develop indicators to assess performance goals,
• Collect and analyze data on the indicators, and
• Report progress toward achieving performance
  goals based on the data collected and analyzed.

4
GPRA continued

• Expected outcomes
• Increased accountability for the expenditures of
  public funds.
• Improved congressional decision-making through
  more objective information on the effectiveness
  of federal programs.
• Promotion of a new governmental focus on results,
  service delivery and customer satisfaction.
• Above excerpted from Demonstrating Results, An
  Introduction to Government Performance and
  Results Act, Spring 1999

5
GPRA continued

• Information on GPRA indicators is collected via
  the Annual Performance Report (APR) completed and
  returned by you (i.e., program grantees)
• Project impacts, as assessed via individual
  project evaluations using control/comparison
  groups, are also collected via the APR
• Together this information may be used by Congress
  to determine future program funding

6
GPRA continued

• Program offices usually fund multiple grantees.
  Therefore, GPRA data need to be reported in a
  systematic and standardized manner to allow the
  program office to
• aggregate grantee-level data to the program level
  for GPRA reporting.
• make judgments about data quality.
• show program progress from year to year.

7
GPRA for Grants to Reduce Alcohol Abuse (GRAA)

• Program Purpose To provide resources for Local
  Education Agencies (LEA) to develop and implement
  innovative and effective alcohol abuse prevention
  programs for secondary school students.
• Program Goal To help reduce alcohol abuse among
  secondary school students.
• Objective 1 Support the implementation of
  research-based alcohol abuse prevention programs
  in secondary schools.

8
GPRA for GRAA continued

• The three GPRA measures developed to assess the
  outcomes for GRAA. They include
• The percentage of grantees whose target students
  show a measurable decrease in binge drinking.
• The percentage of grantees that show a measurable
  increase in the percentage of target students who
  believe that alcohol abuse is harmful to their
  health.
• The percentage of grantees that show a measurable
  increase in the percentage of target students who
  disapprove of alcohol abuse.

9
Reporting on GPRA Indicators

• Report GPRA data as directed in the 524B/APR
  guidance document.
• In general, the goal for GPRA reporting is for
  grantees to provide consistent data by
• using the same instrument and/or survey items
  throughout the life of a project
• reporting unduplicated and aggregated counts
  across all of their model programs, sites, grade
  levels, etc. and
• reporting the total number of students surveyed
  as well as the total number of students who
  respond.

10
Definitions for GPRA Reporting

• Baseline data Total of all data collected before
  implementation or as close as possible to the
  first day of implementation each year.
• Year-end data Total of all data collected at the
  end of implementation each year.
• The numbers for baseline and year-end should be
  an unduplicated aggregate, combining data for all
  of the programs, schools, or grade levels
  involved in program implementation.

11
Definitions for GPRA Reporting continued

• GPRA 1 For grantees in cohorts 2004 and 2005,
  binge drinking has been defined as the
  consumption of five or more drinks in one sitting
  within either a 2-week or 30-day period of time.
• GPRAs 1 and 2 The definition used for measuring
  alcohol abuse should be valid and reliable for
  measuring the behavior as substantiated by and
  referenced in the literature.

12
Definitions for GPRA Reporting continued

• GPRA 2 Students who believe that alcohol abuse
  is harmful to their health
• GPRA 3 Students who disapprove of alcohol abuse
• Research has shown that perception of harm to
  peers can be used as a valid proxy for an
  adolescents perception of harm to self.
• Remember to measure consistently through the life
  of your project.

13
GPRA DATA ON THE 524B

• Enter the Project Objective.
• Performance Measure Enter the text of the GPRA
  measure for which data is being provided.
  Baseline data should be entered in 1.a.Year-end
  data should be entered in 1.b.
• Measure Type Type GPRA in this box.

14
GPRA DATA ON THE 524B continued

• Target This section should be left blank for
  GPRA measures and completed for project measures
  only.
• Actual Performance Data
• Raw Number--Enter the number of students served
  by the grant providing survey responses
  indicating that they engage in binge drinking
  (GPRA 1), their belief that alcohol abuse is
  harmful to their health (GPRA 2), or disapproval
  of alcohol abuse (GPRA 3).
• Ratio--Enter the raw number from the previous box
  as the numerator and the total number of students
  responding as the denominator. These numbers
  should be unduplicated and aggregated.
• --The calculation of percentage is optional.

15
GPRA DATA ON THE 524B continued

• Explanation of progress Include a description
  of evaluation methods and additional data or
  qualitative detail, where appropriate, to help
  interpret findings. This should include the
  following
• What instrument and items were used?
• What data was collected? When and from whom?
• If relevant, include the use of
  comparison/control groups, reporting data
  separately for different intervention groups.
• What was the response rate (i.e., the number of
  students completing a survey divided by the total
  number of students surveyed)?
• How many responses for the item(s) of interest
  were missing?

16
GPRA DATA ON THE 524B continued

• How were data analyzed? If relevant, include
  weighting and numbers for each response category.
  
• Describe preliminary findings or outcomes that
  demonstrate progress towards each GPRA or project
  performance measure.
• Describe how performance data demonstrate that it
  has met or is making progress towards meeting
  each project objective.
• If expected data were not attained or progress
  not made, provide an explanation with steps and
  schedules for addressing the problem or issue.
• Describe how data were used to make improvements
  to the original project plan (e.g., project
  activities and milestones) that are consistent
  with approved objectives and scope of work.

17
EXAMPLE FOR ENTERING GPRA DATA ON THE 524B

• Sample scenario
• Springfield School District has an alcohol abuse
  reduction grant, which targets all 9th-12th
  graders in the district. During the previous
  spring semester, the Communities That Care survey
  had been administered to all 9th-12th graders
  (n3,368) of the 2,797 students who returned a
  completed survey, 826 students responded that
  they had, at some point in the last two weeks,
  consumed five or more drinks in a row. In March
  of the first year of implementation (year 1), the
  same survey was administered to 3,432 students
  of the 2,929 students who returned a completed
  survey, 754 students responded that they had, at
  some point in the last two weeks, consumed five
  or more drinks in a row.

18
EXAMPLE FOR ENTERING GPRA DATA ON THE 524B
continued
Analysis and instructions, for both baseline and
year-end data

• Project Objective Type Reduce the percentage of
  target students who engage in binge drinking
• Performance Measure Type The percentage of
  target students who consumed more than 5 drinks
  in a row in the past 2 weeks or 30 days,
  etc.--baseline or --year-end
• Measure type Type GPRA

19
EXAMPLE FOR ENTERING GPRA DATA ON THE 524B
continued

• Target Leave this blank for GPRA measures.
• Actual performance data For raw number, type
  the number of binge drinking students. For
  ratio, type the number of binge drinking
  students over the total number of students
  completing the survey. If you choose to calculate
  the , enter the percentage of binge drinking
  students by dividing the numerator by the
  denominator, multiplying by 100, and entering the
  result.

20
EXAMPLE FOR ENTERING GPRA DATA ON THE 524B
continued

• Explanation of progress See example below.
• Springfield School District has an alcohol abuse
  reduction grant, which targets all 9th-12th
  graders in the district. During the previous
  spring semester, the Communities That Care
  survey was administered to all 9th 12th graders
  (n3,368). The item for binge drinking defined it
  as five or more drinks in a row at some point in
  the last two weeks. 2,797 students turned in a
  completed survey for a response rate of 83.05
  826 responded that they had engaged in binge
  drinking. In March of the first year of
  implementation (year 1), the same survey was
  administered to 3,432 students. 2,929 students
  responded (85.34) of which 754 students
  responded that they had engaged in binge
  drinking. Note Also include explanation of the
  methods used to collect the data and the validity
  of the data. Describe what efforts are in place
  to improve data for this measure.

21
Discussion

• Any questions?