??????? Learning Oriented Assessment

1
???????Learning Oriented Assessment
?????? The Hong Kong Institute of
Education Centre for Assessment Research
Development, Assessment Project ??? Magdalena
M. C. Mok HKIEd, January 2006
2
Purpose of Sharing Today ?????

• 1. What is Learning Oriented Assessment?
• ???????
• 2. How to implement it through the Assessment
  Project?
• ????????????????
• 3. Questions Answers

3
????? Purposes of Assessment
4
????? Purposes of Assessment
5
??????????? What is meant by Learning Oriented
Assessment (LOA)?
6
???????
1. ????????
2. ???????
7
Learning Oriented Assessment
??????

• 1. Assessment For Learning
• Assessment that
• enables the teacher to give feedback about a
  students learning
• gives feedback which informs teachers teaching
• enables students to obtain feedback for
  self-monitoring and self-regulation
• 2. Assessment As Learning
• Assessment as part of learning of a
  self-directed learner

• 1.????????
• ?????????????????????????
• ???????,????????????
• ?????????,????????,?????????????
• 2.???????
• ??????????????????

8
??????? ????,????? Learning Oriented
Assessment Provide feedback Enhance
Metacognition
9
Feedback Metacognition
??????

• Feedback is the most crucial factor for learning
  (Source Inside the Black Box by Black and
  Wiliam,1997)
• Metacognition is one of the four most important
  factors affecting learning (Source American
  Psychological Association, 1997)

• ????????????? (???? Black Wiliam, ????, 1997)
• ?????????????????????? (???? American
  Psychological Association, 1997)

10
Key Factors Contributing to Learning
?????????

• Cognitive and Metacognitive Factors
• Motivational and Affective Factors
• Developmental and Social
• Individual Differences

• ????????
• ???????
• ???????
• ??????

Source American Psychological Association (1997)
11
Feedback that Facilitate Learning
?????????

• Indicates what the learner is able to do
• Shows expectation of what the learner can do at
  that level
• Indicates progress
• Includes all domains of development
• Identifies areas for improvement
• Presented in simple and comprehensible language
• Timely

• ???????
• ???????,?????????????????????
• ????
• ???????
• ????????
• ???????
• ??

Source Adapted from Rowe, K. (2005)
12

• Cognitive Metacognitive Factors
• 1. Nature of the learning process
• 2. Goals of the learning process
• 3. Construction of knowledge
• 4. Strategic thinking
• 5. Thinking about thinking
• 6. Context of learning
• Motivational and Affective Factors
• 7. Motivational and emotional influences on
  learning
• 8. Intrinsic motivation to learn
• 9. Effects of motivation on effort

• ????????
• 1. ???????
• 2. ???????
• 3. ?????
• 4. ?????
• 5. ??????
• 6. ?????
• ???????
• 7. ???????????
• 8. ???????
• 9. ??????????

13

• Developmental and Social
• 10. Developmental influences on learning
• 11. Social influences on learning
• Individual Differences
• 12. Individual difference in learning
• 13. Learning and diversity
• 14. Standards and assessment

• ???????
• 10. ??????????
• 11. ??????????
• ????
• 12. ????????
• 13. ??????
• 14. ?????

14
Metacognition
???
??? Self
15
Lets Try!
16
??????????? What are the elements of
self-directed learning?
17
Metacognitive Skills
?????

• Orienting/Planning
• Executing
• Monitoring/testing/diagnosing
• Adjusting/correcting
• Evaluating/Reflecting
• Sources Brown (1987) Vernunt Verloop (1999)
  Weinstein Maer, 1986 Rozendall, Minnaert,
  Boekaerts (2005)

• ?? / ??
• ??
• ?? / ?? / ??
• ?? / ??
• ?? / ??
• Sources Brown (1987) Vernunt Verloop (1999)
  Weinstein Maer, 1986 Rozendall, Minnaert,
  Boekaerts (2005)

18
Self-Directed Learning Domains Variables???????
1. Prior

• Academic self-confidence
• Motivation
• Attributions
• Education Aim

7. 2nd Order Feedback
2. Plan

• Change in self-knowledge
• Cognition
• Meta-cognition
• Motivation

• Goal setting
• Planning

6. 1st Orider Feedback

• Change in learning strategy and behaviour

3. Action
5. Outcome

• Initiation
• Inquisitive Mind
• Information Processing
• Strategic Help Seeking
• (Benefits, Costs, Bahavior)
• Management of Learning Env

4. Monitor

• Self-monitoring

Mok Cheng, 1999
19
??????? ????? What are the learning strategies?
20
Task Choose the Right Strategies
?????????

• 14 self-regulated learning strategies (Zimmerman
  Martinez-Pons, 1986, 1988 Nota, Soresi,
  Zimmerman, 2004, p. 200)
• 1. Self-evaluation
• 2. Organising and transforming
• 3. Goal-setting planning
• 4. Seeking information
• 5. Keeping records monitoring
• 6. Environmental structuring
• 7. Self-consequences
• 8. Rehearsing memorizing
• 9-11. Seeking assistance (peers, teachers,
  adults)
• 12-14. Reviewing records (tests, notes,
  textbooks)
• 15. Other

14????????? (Zimmerman Martinez-Pons, 1986,
1988 Nota, Soresi, Zimmerman, 2004, p. 200) 1.
???? 2. ????? 3.????? 4.???? 5.????? 6.???? 7.????
???? 8.????? 9-11.?? (????????) 12-14.????
(????????) 15.??
21
Organising Transforming
?????

• Organising
• Clustering, outlining, selecting the main ideas,
  mind mapping
• examine the schema and choose what is relevant to
  the task
• Elaboration
• paraphrase, summarise, creating analogies, use of
  metaphors
• Build schemata
• build internal connection
• integrate with prior knowledge

• ??
• ??, ???????,????, ???????
• ??????????
• ??
• ????,????,??????
• ?????????
• ?????
• ??????

22
Strategy Resource management
??????

• Time management
• Energy management
• Environment
• Effort regulation
• Help seeking
• Peer-learning
• Anxiety control

• ????
• ????
• ????
• ?????
• ????
• ????
• ????

23
Self-regulation
????

• CONTROL
• Motivational (Pintrich, 1989 Wigfield Eccles,
  2000)
• Task value, interest
• Self-ability/efficacy
• Attribution
• Emotional (Minnaert, 1999 Pintrich Schunk,
  1996 Tobias, 1985)
• Volition, Persistence
• Anxiety control
• Action (Boekaerts, 1997 Heckhausen, 1991 Juhl
  Goschke, 1994)
• Effort
• Correction / Change

• ??
• ?? (Pintrich, 1989 Wigfield Eccles, 2000)
• ?????
• ???????
• ??
• ?? (Minnaert, 1999 Pintrich Schunk, 1996
  Tobias, 1985)
• ?????
• ?????????
• ?? (Boekaerts, 1997 Heckhausen, 1991 Juhl
  Goschke, 1994)
• ??
• ?????

24
(No Transcript)
25
??????????? Why is self-directed learning
important?
26
Why is Self-directed Learning important?
???????????

• Rapid changes mandated competence for
  self-directed learning
• Competent self-directed learners tend to be
  better academic achievers

• ??????,???????????
• ???????????,?????

27
????????????

• ??? ??? ??? ???
• ???? RGC??
• ????????????

28
The sample
????

• 14,846 students from Hong Kong
• 7,238 males and 7,521 females
• 23 secondary schools
• Secondary 1, 2, 3, 4, and 6

• 14,846 ??????
• 7,238 ???,?? 7,521 ???
• 23 ???
• ?? 1, 2, 3, 4, ? 6 ??

29
Chinese ??
English ??
Math ??
10 groups 3, 4, 5, 6, 7, 8, 9, 10, 11, 12
30
??????? Attribution Achievement
31
(No Transcript)
32

• Ability Failure
• Females gt Males
• Decreases with increasing achievement

?
Female

• ????????
• ????,????????????
• ???????

?
Male

• Ability Success
• Females lt Males
• Increases with increasing achievement

• ????????
• ????,?????????????
• ???????

?
Male
?
Female
33

• Effort Failure
• Females Males
• No great difference across achievement groups

?
Female

• ????????
• ?????,???????????
• ?????????????

?
Male

• Effort Success
• Females gt Males
• Increases with increasing achievement

?
Female

• ????????
• ?????,???????????????
• ??????,??????????????

?
Male
34

• Strategy Failure
• Females gt Males
• No great difference across achievement groups

?
Female

• ??????????
• ??????,???????????????

?
Male

• Strategy Success
• Females gt Males
• Increases with increasing achievement (Note Group
  12)

?
Female

• ??????????
• ??????,???????????????
• ??????,??????????????

?
Male
35
???,?? ????,? ?????
???,?? ??????
???,?? ???????? ?????
???,?? ??????
36
Academic Help Seeking Costs, Benefits,
Frequency???? ??, ??, ??
Costs ??
Benefits ??
Frequency ??
37
Costs ??
Male ?
Female ?
Almost for all achievement groups, males saw more
costs in seeking help than did females ???????????
????
38
Benefits ??
Female ?
Male ?
Almost for all achievement groups, males saw
less benefit in seeking help than did
females ???????????????
39
Frequency ??
Female ?
Male ?
For all achievement groups, males reported fewer
incidents in seeking help than did
females ???????????
40
?????,??? ???????? ???,?????? ???,??????? ????????
?!
?????, ????, ?????? ???????!
41
??
??
??
??
??
??
42
??
??
???

• ?????,??????????????
• ?????????????????????????????????????????,???????,
  ???????
• ????????
• ????????????????,??????

??
43
The Primary Sample
????

• 1253 primary pupils (603 boys and 615 girls)
• From 10 Hong Kong primary schools
• Each school has 2 Year-5 and 2 Year-3 classes in
  the study

• 1253 ????? (603???? 615???)
• 10?????
• ?????????????????????

44
Sources of Knowledge ???????

• Where else can you learn other than from school?
• ??????,????????????????

45
1. ???????????,????????
2. ?????????,??????????? 3. ????????,???????????
4. ???????,??????????????? 5. ??????,???????????
?,??????? 6. ????????????,?????????? 7. ?????????
?????? 8. ????,????????????????
9. ???????,???????????????????
10. ????????????????????
46
1. Mary likes to discus with classmates and share
what she learned.
2. Tom seeks help from others when met with
difficulties in learing. 3. Cindy takes notes of
what the teacher says in class. 4. Fanny makes
notes of what she does not understand when
reading. 5. John asks himself questions and
tries to solve them while studying. 6. Peter sets
up a timetable and studies according to the
timetable. 7. Louise sets up learning goals for
herself. 8. Nicole revises what she cannot do in
tests. 9. Danny thinks about the application of
what she learns in real life. 10. Mike finds a
quiet and undisturbed environment to study.
47
Number of Resources Named (Free response)???????
48
Types of Resources Named (Free response)
49
(No Transcript)
50
(No Transcript)
51

• All strategies considered useful by most of the
  pupils
• ????????????
• Relatively, the most useful strategies are
• ???????????????
• 10. ????????????????
• 2. ?????????,???????
• 6. ??????????,?????????
• Relatively, the least useful strategies are
• ?????????????????
• 4. ?????,????????????
• 5. ??????,?????????,??????
• 9. ?????,?????????????????

52
Results
??

• Knowledge Variance at student and class levels
  (not school)
• Knowledge Deployment Grade 5 more than grade 3
• Usefulness Deployment Girls more than boys
• Deployment increased with perceived usefulness
• Usefulness and deployment All variance at
  student level (rather than class or school)

• ??????,?????????(????)
• ???????????????
• ?????????????
• ?????,?????
• ?????????,?????? (????????)

53
(No Transcript)
54
????????????????? What would you like your
student to be?
55
??????? ???????? How to implement Learning
Oriented Assessment?
56
(No Transcript)
57
?????? ???
Implementing Learning Oriented Assessment
?????? ??? Learner, Teacher Learning
58
Principles
??

• 1. The primary purpose of assessment is to
  improve student learning
• 2. Assessment for other purposes supports student
  learning
• 3. Assessment systems are fair to all students
• 4. Professional collaboration and development
  support assessment
• 5. The broad community participates in assessment
  development
• 6. Communication about assessment is regular and
  clear
• 7. Assessment systems are regularly reviewed and
  improved

• 1. ????????????
• 2. ????????????????
• 3. ????????????
• 4. ??????????
• 5. ??????????
• 6. ?????????????
• 7. ???????????

Source National Forum on Assessment
(1995).Principles and indicators for student
assessment systems. Cambridge, MA.
59
Planning for LOA
????????

• ??????????????
• ???????
• ????????????
• ????????
• ???
• ???????
• ????

• Strategic - Guided by vision and clear purpose
• Align with teaching curriculum
• Learner- Learning-Focussed Plan
• Frequent but spaced
• Developmental
• Generate information for improvement
• Clear expectation

60
Planning for LOA
????????

• LOA is more than formative assessment
• 1. Set learning assessment goal at the
  beginning
• 2. Activate prior knowledge
• 3. Model active learning and encourage reflection
• 4. Provide scaffold for interactive learning
  groups reflection, learning, challenge,
  evaluate, critique, create
• Source Rozendall, Minnaert, Boekaerts (2005).
  Interactive Learning Group System

• ???????????????????
• 1. ?????????
• 2. ??????
• 3.??????????,????
• 4.??????????????????????????
• Source Rozendall, Minnaert, Boekaerts (2005).
  Interactive Learning Group System

61
(No Transcript)
62
????? Build Metacognition
KWL?????? KWL strategy used in reading
comprehension
63
????Self Monitoring
64
????? , ???????, ?????????????? Experience
sharing by Principal Leung at the Training Course
for Aspiring Principals
65
?????
Experience sharing by Principal Leung ????? ,
???????, ??????????????
Changes in Assessment

• ???????????????????
• ???
• ????????
• ??????????

• From norming to diagnosis and treatment
• Developmental
• Sum of the parts is greater than the whole
  module tests
• Each student compares with himself/herself

66
Experience sharing by Principal Leung ????? ,
???????, ??????????????

• ?TOC ??
• ???????
• ??????
• ??????????????????????????,?????????????
• ???????????
• ???????????,????????,??????
• ???????????????

67
?????
Experience sharing by Principal Leung ????? ,
???????, ??????????????

• ??????
• ????????

68
?????
Experience sharing by Principal Leung ????? ,
???????, ??????????????

• ?????????????????
• ??????????????(10)
• ?????????,????????????,???????????
• ??????????????????
• ????????????,????????????
• ??????????,?????????

69
Experience sharing by Principal Leung ????? ,
???????, ??????????????
Student Reactions
?????/?????

• From anxiety, rejection to embracing
• Admire self improvement
• More motivated and more effective

• ?????????
• ???????
• ??????????

70
???????Learning Oriented Assessment
Thank You!

• Learning Oriented Assessment involves
• Orienting/Planning
• Executing
• Monitoring/testing/diagnosing
• Adjusting/correcting
• Evaluating/Reflecting
• Through Learning Oriented Assessment
• Teachers know (Assessment For Learning)
• Where students are in the learning
• What to do to support learning
• Students know (Assessment As Learning)
• Where they are in their learning
• Where they are heading
• How to get there
• Students become self-directed

Without data, you are just another person with an
opinion