DREEM QUESTIONAIRE COULD NOT PREVIEW RESIDENCY ADMISSION GRADES IN AN OSCE

1
DREEM QUESTIONAIRE COULD NOT PREVIEW RESIDENCY
ADMISSION GRADES IN AN OSCE BASED TEST
UNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINE

• Maria do Patrocinio Tenorio Nunes
• Thelma S. Okay
• Júlio Cesar de Oliveira
• Cristina H. F. Fonseca Guedes
• Joaquim Edson Vieira

São Paulo BRAZIL
2
UNIVERSITY OF SÃO PAULO SCHOOL OF MEDICINE
São Paulo BRAZIL
OSCE Performance as a Residency Admission
Test - to provide selection for Residency
programs to a public Hospital in Brazil.
3
-600 Graduated Doctors around the country From
60 different Schools 21 different
States -264 positions as a Resident -21
Residency Training Programs
Photos OSMAR BUSTOS CREMESP
4
Applying Test (Two phase tests)
Phase 1 - Writing test (3.000 candidates)
Phase 2 OSCE Based Test (600 candidates) 2
stations for Internal Medicine, Surgery,
Pediatrics, Gynecology-Obstetrics and Social
Medicine (each)
E2
PHASE 2 Selection Process
5
INTRODUCTION

• DREEM indicates the schools learning and
  teaching climate
• One could expect to see some correlation between
  schools climate and OSCE performance

6
OBJECTIVE

• Correlation between DREEM score and OSCE
  performance in a Residency Admission Test

7
CASUISTIC and METHODS

• 50 items DREEM questionnaire
• 314 recently graduated physicians
• Performance on Observed Structured Clinical
  Examination OSCE
• Comparison (correlation) between OSCE and DREEM
  score at the same population

8
STATISTICAL ANALYSIS

• Statistical analysis Pearson Correlations test
• (DREEM scores X OSCE grades)

9
Observer
Actress patient
RESULTS
Candidate
10
Domain of DREEM questionnaire OSCE GRADE
Students Perception of Learning Internal Medicine
Students Perception of Teachers Surgery
Students Academic Self Perceptions Pediatrics
Students Perception of Atmosphere Gynecology-Obstetrics
Students Social Self Perceptions Social Medicine
Dundee score Dundee

30,3 63,2
Dundee 65,8
48.0
28,8 65,4
Dundee 65,8
61.4
21,4 66,9
Dundee 64,3
68.7
31,9 66,43
Dundee 68,6
60.85
18,1 64,51
Dundee 65,4
45.35
11
Domain of DREEM questionnaire Perception X OSCE score (Pearsons coefficient)
Students Perception of Learning Internal Medicine r 0,24
Students Perception of Teachers Surgery r 0,16
Students Academic Self Perceptions Pediatrics r 0,16
Students Perception of Atmosphere Gynecology-Obstetrics r 0,21
Students Social Self Perceptions Social Medicine r -0,016
12
Perceptions Correlation (Pearsons coefficient Students Perception of Learning Students Perception of Teachers Students Academic Self Perceptions Students Perception of Atmosphere Students Social Self Perceptions
Students Perception of Learning r 0,66 r 0,71 r 0,73 r 0,64
Students Perception of Teachers r 0,60 r 0,72 r 0,56
Students Academic Self Perceptions r 0,78 r 0,71
Students Perception of Atmosphere r 0,70
13
DISCUSSION

• Perceptions reached a good correlation
• DREEM scores have not been corelated to an
  expected performance

14
CONCLUSION

• Students perception of schools climate seems
  not to have influenced clinical examination
  performance for Residency admission
• It should be considered
• the selection particularity of the test
• candidates from many different schools