Programme for International Student Assessment PISA 2000 Presentation to the National Education Foru

1
Programme for InternationalStudent
Assessment(PISA 2000)Presentation to the
National Education ForumApril 13, 2002Dr John
Cresswell
2
PISA 2000

• How well prepared are young people to deal with
  the challenges they will meet in the future?
• What skills do young people have that will help
  them adapt to change in their lives?
• Are some ways of organising schools and school
  learning more effective than others?
• What influence does the quality of school
  resources have on students learning?
• To what extent is student performance dependent
  on their home backgrounds?

3
Assessment in PISA

• Mixture of multiple-choice test items and
  questions requiring the student to construct
  their own responses. The items are organised in
  groups based on a stimulus.
• Students answered a background questionnaire
  which took 20-30 minutes to complete.
• School principals completed a 30-minute
  questionnaire asking about their schools.

4
Skills assessed in PISA

• Core domains
• Reading literacy
• Mathematical literacy
• Scientific literacy
• Other domains
• Self-regulated learning
• Self-concept in relation to learning
• Attitudes towards school
• Familiarity with computers

5
Reading literacy

• the ability to understand, use and reflect
• on written texts in order to achieve ones
• goals, to develop ones knowledge and
• potential, and to participate effectively in
• society

6
Mathematical literacy

• the capacity to identify, understand and
• engage in mathematics, and to make
• well-founded judgement about the role
• that mathematics plays in an individuals
• current and future private life,
• occupational life, social life with peers
• and relatives, and life as a constructive,
• concerned and reflective citizen

7
Scientific literacy

• the capacity to use scientific knowledge,
• to identify questions and to draw
• evidence-based conclusions in order to
• understand and help make decisions
• about the natural world and the changes
• made to it through human activity

8
PISA 2000

• Each domain defined, in terms of knowledge and
  skills needed in adult life, not merely in terms
  of mastery of the school curriculum.
• Emphasis is placed on the mastery of processes,
  the understanding of concepts and the ability to
  function in various situations related to real
  life.

9
Countries participating in PISA
10
(No Transcript)
11
17
35
29
29
40
34
23
Number of schools participating in PISA
24
12
Participating schools in Australia
13
PISA participants

• Age-based sample 15-year-olds
• 265 000 students altogether
• About 6200 students in Australia
• Testing took place between July and August 2000

14
Results
15
Comparative results in reading literacy
16
Comparative results in mathematical literacy
17
Comparative results in scientific literacy
18
Results summary - mean scores

• Australia OECD Lowest Highest
• Reading 528 500 422 546
• Maths 533 500 387 557
• Science 528 500 422 552

19
Results summary - countries in relation to
Australia

• Reading literacy
• Higher Finland
• Equivalent Canada, Ireland, Japan, Korea, NZ,
  Sweden, UK, USA

20
Results summary - countries in relation to
Australia

• Reading literacy
• Higher Finland
• Equivalent Canada, Ireland, Japan, Korea, NZ,
  Sweden, UK, USA
• Mathematical literacy
• Higher Japan
• Equivalent Belgium, Canada, Finland, Korea,
  Liechtenstein, NZ, Switzerland, UK

21
Results summary - countries in relation to
Australia

• Reading literacy
• Higher Finland
• Equivalent Canada, Ireland, Japan, Korea, NZ,
  Sweden, UK, USA
• Mathematical literacy
• Higher Japan
• Equivalent Belgium, Canada, Finland, Korea,
  Liechtenstein, NZ, Switzerland, UK
• Scientific literacy
• Higher Japan, Korea
• Equivalent Austria, Canada, Finland, Ireland,
  NZ, UK

22
Another perspective - reading proficiency levels
23
(No Transcript)
24
Comparative results in reading literacyAustralia
n states
25
Comparative results in mathematical
literacyAustralian states
26
Comparative results in scientific
literacyAustralian states
27
Reading proficiency levels Australian states
28
Results summary - mean scores for subgroups in
Australia

• Indig. non-Indig. LBOTE ESB
• Reading 448 531 506 535
• Maths 449 535 522 537
• Science 448 529 497 534

29
Results summary - mean scores for subgroups in
Australia

• Boys Girls
• Reading 513 546
• Maths 539 527
• Science 526 529

30
Engagement with reading is important in relation
to reading achievement in Australia
31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
(No Transcript)
38
PISA 2000 - the schools
39
(No Transcript)
40
Areas of concern

• Gender differences in reading achievement (girls
  higher than boys) - difficulties in dealing with
  continuous texts
• Relatively low achievement of Indigenous students
  (but nevertheless some good performances - 40 at
  Level 3 or higher)
• The difference in reading performance between
  students according to their socioeconomic
  backgrounds
• Australian students relatively low engagement
  with reading, especially boys

41
Reading
42
Reading
Scientific literacy
43
PISA Reports and Databases

• The international report and the entire database
  can be downloaded from the OECD website
  www.pisa.oecd.org
• The database page also has a user friendly
  interface to allow calculations to be done
• The national report can be downloaded from the
  ACER website www.acer.edu.au

44
PISA 2003

• New domain - problem-solving
• Mathematical literacy is the major domain
• Field trial May/June 2002
• Main study - mid 2003
• LSAY sample to be based on PISA

45
With particular thanks to

• The schools, teachers and students that took
  part
• The National Advisory Committee
• Dr Jan Lokan