Board Member Training 2006 Session 1: Continuing Competence Session 2: Impact of Technology

1
Board Member Training 2006Session 1
Continuing CompetenceSession 2 Impact of
Technology
Expect the Unexpected Are We Clearly Prepared?

• Steven K. Bryant, PhD and
• William D. Hogan, ME
• Applied Measurement Professionals, Inc.

Council on Licensure, Enforcement and Regulation
2006 Annual Conference
Alexandria, Virginia
2
About Us.

• Steven K. Bryant, PhD
• Founder and President, AMP (1982-2002)
• CEO, Natl Board for Respiratory Care (1974-2002)
• William D. Hogan, ME
• Vice President, Marketing and Business Products
• AMP, 1993-Present

3
NBRC and State Regulation

• Use of Entry Level Exam by States
• State Licensure Liaison Group
• National RC Disciplinary Database
• Mandatory Continuing Competency Program, 2002

4
AMP and Technology

• Examination Development/Research
• Real Estate Program
• National Network of AMP Assessment Centers

5
Consistent with.

• CLEAR Guidelines, Modules 4 6
• NOCA/NCCA Standards

6
Continuing Competence

• Luck is where preparation meets opportunity.

7
Continuing Competence

• Complete Situational Exercises

8
CLEAR Definition..

• Success on licensure exams
• Minimally competent at the time of testing

9
Continuing Competence..

• What about the future after licensure?
• What are our responsibilities?

10
Continuing competency programs

• Attempt to address future
• Various options
• Re-examination (same/different)
• Self-assessment
• Portfolio review
• Continuing education
• Others

11
Re-Examination

• Not professionally/politically OK
• May not be valid for current job
• Makes money for agencies
• Extra development expense

12
Self-Assessment

• Difficult to supervise
• Not secure
• Who really did it?
• May not be job-related

13
Portfolio Reviews

• Similar problems to self-assessment
• References are all good
• May not be job-related

14
Continuing Education

• Readily available
• Acceptable
• Lesser of other evils
• Professional associations love it

15
Continuing Competence

• Continuing education has become the face of
  continued competenceare they really the same?

16
Continuing Competence

• Probably not!!
• Validity evidence lacking
• Exams can measure job performance
• CE most preferred anyway

17
NOCA/NCCA Standards

• .a process that documents or contributes to
  the continued competence of the certified
  occupation..

18
Respiratory care.

• 48 states regulate the profession---all provide
  for completion of CE to satisfy continuing
  competency requirements

19
NBRC Mandatory CCP

• Re-examination
• Pass higher level exam
• Complete CE compatible with states

20
Difficulties with imposing CCP

• Post-voluntary credentialing
• Post-licensure
• Two different worlds!

21
Continuing Competence

• What Board Members really need to know
• CC is difficult to document
• Most often method used is CE
• CE Programs offered by many
• Administrative pitfalls to avoid

22
Administrative Pitfalls

• Approval of CE Programs
• Using what exists
• Lead time required
• Verification of completion

23
Continuing Competence

• The controversy continues!!

24
Continuing Competence

• Review Situational Exercises

25
Speaker Contact Information

• Thank You!
• Steven K. Bryant, PhD and William D. Hogan, ME
• Applied Measurement Professionals, Inc.
• 8310 Nieman Rd.
• Lenexa, KS 66214
• 913-541-0400
• www.goAMP.com
• sbryant or whogan_at_goAMP.com

26
CLEAR Board Training --Session Two

• The Impact of Technology on Board Meetings,
  Examination Development and Administration

27
Impact of Technology

• Technology is a wonderful thing----when it
  works!!

28
Impact of Technology

• Technology Assisted Meetings
• Focused Displays
• Agendas/Background Info
• Virtual Meetings

29
Sample of NBRC Board Book

• AGENDA
• Board of Trustees
• National Board for Respiratory Care, Inc.
• Saturday, May 6, 2006
• 900 am 300 pm
• Merrick I II
• The Colonnade Hotel
• Coral Gables, FL
• Call to Order/Secretarys Roll Call
• Introduction/Welcome of New Board Members and
  Guests
• 3. Approval of Minutes of November 12, 2005
  Meeting
• 4. Officer Reports (optional except President)
• a. President
• b. Vice President
• c. Secretary
• d. Treasurer
• 5. Public Advisors Report
• 6. Executive Committee Report
• Examination Committee Reports

30
Use of Technology During Meetings

• Laptops for note taking
• Power Point and other aids
• Internet Connections
• Demonstrations
• Video Contacts

31
Virtual Meetings

• Phone and computer may be needed
• Individual review of materials
• Committee meetings
• Board meetings

32
Sample item
33
Technology and Examinations

• Steps in Examination Development
• Job analysis/test specs
• Item development/test assembly
• Minimum passing level
• Validation/pre-testing

34
Technology and Examinations

• Job Analysis/Role Delineation
• Survey-based
• Committee-based
• Content set by law
• Transportability

35
Technology and Examinations

• Test Specifications
• More Important Job Duties
• Tasks/KSAs

36
Technology and Examinations

• Test Development
• Items linked to tasks/KSAs
• Series of structured reviews
• Cueing

37
Technology and Examinations

• Setting the MPL
• Angoff, Nedelsky, Others
• Panel of Experts
• State vs. National

38
Technology and Examinations

• Validation/Pre-testing
• Content
• Predictive
• Pre-test Item Stats
• Not Mentioned in CLEAR Guidelines

39
Technology and Examinations

• Costs of Testing
• Test for 1 vs. 10,000
• Administration Using CBT

40
Technology and Examinations

• Job analysis research
• Test development/items reviews
• Final test reviews
• Post-test statistics

41
Technology and Examinations

• Computer-based testing simply replaces a test
  booklet and answer sheet with a computer---
• Real Impact of Technology
• Instant Results/Quick Re-tests
• Enhanced Security

42
Technology and Examinations

• High-Stakes Testing vs.
• Web-tests/self assessments

43
Some CBT Pitfalls

• Need Integrated System
• Reliance on ATGs
• False Sense of Security
• Human Intervention Important
• Proctor Training
• Examination Storage

44
Impact of Technology

• Technology is a wonderful thing----
• when it works!!

45
Impact of Technology

• Review Technology-Related
• Situational Exercises

46
Speaker Contact Information

• Thank You!
• Steven K. Bryant, PhD and William D. Hogan, ME
• Applied Measurement Professionals, Inc.
• 8310 Nieman Rd.
• Lenexa, KS 66214
• 913-541-0400
• www.goAMP.com
• sbryant or whogan_at_goAMP.com