Looking at SPNS Evaluation Guidelines for Grantees from the National Technical Assistance Center

1
Looking at SPNS EvaluationGuidelines for
Grantees from the National Technical Assistance
Center

• National American Indian/Alaska Native HIV/AIDS
  Technical Assistance Center
• THE UNIVERSITY OF OKLAHOMA
• School of Social Work

2
HRSA HAB Special Projects of National
Significance

• SPNS defined
• Research Evaluation Branch of
• the Ryan White CARE Act
• Funded under Part F of RW CARE Act
• not under Titles I - IV

3
SPNS GOAL

• TO DEVELOP INNOVATIVE MODELS OF CARE FOR
  DISSEMINATION TO RYAN WHITE HIV/AIDS PROGRAMS
• IMPROVEMENT OF CARE UNDER
• TITLE I, TITLE II, TITLE III, AND TITLE IV

4
National Projects at Local Levels

• Each SPNS project is of national significance
  since it contributes to a national initiative and
  national goal
• SPNS projects (having evaluation data skills)
  become leadership programs at local, state and
  national levels
• Having a SPNS grant is a luxury that allows
  thoughtful program development
• not available through most other funding sources

5
Justification for HIV/AIDS service delivery

• To demonstrate that these new innovative models
  of HIV/AIDS care will produce beneficial results
  for clients within the context of community-based
  service delivery
• Community-based service delivery is believed to
  be most responsive to oppressed communities
• Seeking a quality, not quantity, strategy
• Goal is to demonstrate in real world program

6
Work Product

• Evaluation findings targeted to RW Care providers
  
• (especially for Indian or Native communities)
• In order of preference
• Articles published in referred journal
• Book and monograph chapters
• Popular professional media

7
Five HRSA Evaluation Questions

• We place all evaluation issues in the context of
  the five evaluation questions identified by HRSA
  SPNS
• Extent of identifying underserved (hidden)
  populations
• Extent of removing barriers to care
• Extent of using best models of care for diverse
  populations
• Extent of providing quality care
• Extent of adapting to diverse changing funding
  sources for care

8
SPECIAL POPULATION FOCUS

• SPNS has a long commitment to special populations
  in need that are underserved through traditional
  Ryan White programs
• Models of care need to be culturally responsive
  to unique and diverse populations
• ethnic, cultural, sexual orientation, gender,
  disenfranchisement due to substance use, other
  subcultures

9
EVALATION FOCUS

• PROCESS
• Focus on implementation of grant
• Includes summative evaluation
• Most important lessons learned
• OUTCOMES
• May be qualitative or quantitative
• Does not include process measures such as
  increase the quantity of services provided

10
How to do PROCESS

• Keep a log of activities (called a chronology)
• Good for accountability purposes and reports to
  funding source
• Events not recorded will be forgotten
• especially under pressure of writing reports

11
Outcome Evaluation

• More difficult to measure
• Looks at the effects of providing a service
• At a client or system level
• Measured at different levels (identified in logic
  model)
• Initial
• Intermediate
• Long-term

12
Limitations of the Initiative

• Models must address issues of HIV/AIDS care not
  prevention
• Congressional mandate with HRSA funding not CDC
  funding
• High-risk populations may be accessed for case
  finding of individuals who are infected but not
  in HIV/AIDS primary medical care
• must have reasonable reason to assume that
  high-risk individuals are HIV infected or AIDS
  status

13
Role of TA Center

• University of Oklahoma NNAAPC
• Facilitate communication among initiative
  partners
• TA is provided for the purpose of improving
  evaluation findings
• Clarifying service delivery model
• Examining unique innovative features of models
• Program support services (data processing, etc.)
• Assist as partner in dissemination efforts

14
Initiative Coordination Communication

• Web page www.ou.edu/hiv
• E-mail broadcast list
• Conference calls (every two weeks after Norman
  meeting)
• Facilitating meetings among grantees at national
  professional meetings

15
Purpose of Site Visits

• These are working meetings with objectives for
  clarifying model development issues
• Substantial emphasis on logic model development
  (and review)
• Examination of client flow processes to identify
  data collection points
• Review of measurement issues, including
  instruments and variables
• HRSA will have contract compliance issues (e.g.,
  IRB, funding issues, etc.)

16
Initial Steps

• Review intervention model
• Assist in development of client flow chart
• With data collection points
• Refine LOGIC MODEL
• Approval from HRSA Grants Management Office
• For satisfaction of condition of award
• Blue print for next five years of grant
• Accountability standards for eval program staff
• Foundation for IRB protocol

17
Dissemination

• Information on initiative web site
• Facilitate panel presentations at national
  professional meetings (both academic and
  professional)
• Assist with popular press articles
• Assist in writing academic papers
• Co-author academic papers
• Provide monograph article opportunities