2004 International Conference of NTNTC GIMS and RDC TechnologyBased Testing and StandardBased Assess

1
2004 International Conference of NTNTC GIMS and
RDC Technology-Based Testing and Standard-Based
AssessmentIntroduction to Education in Japan
Web-based Learning EnvironmentWeb??????????
(e-Learning)Instructional Design Eiji
MurakiProfessor, Department of Educational
Informatics, Tohoku University
2
IT Revolution????????IT??

• ITInformation Technology
• Developed at CERN, Internet started as a tool for
  communication among scientists
• IT is our current condition surrounded us
• IT requires us to communicate in new ways
• IT is the technological innovation, but we need
  to develop some new ideological foundations to
  live in this IT world
• How do we live happily in this IT age?

3
Emergence of e-Learning

• Since 1990s
• Virtual University? Online Education
• Kenneth C. Green
• American Higher Educational Institutions
• e-Learning course
• 1999 46.5
• 2000 55.5
• 2001 59.0
• 2002 62.5
• Outbreaking period 1995-1997

4
The definition of e-Learning

• e-Learning is learning in which students do and
  learn by trial and error through practice on the
  virtual environment created by multimedia and
  computer networks, aided by rich informational
  resources, knowledge support, and feedback(?????
  e????????????????)?
• Closed virtual learning enviroment

5
Background of e-Learning(USA)???(?????????????e??
?????????)

• Advancement of IT technology and Spread of
  Internet
• Mutual communication
• Development of multimedia function
• Basic communication is inexpensive
• Increased adult population for higher education
  Adult working population
• Economic merits by academic degreesTechnical
  occupations, Occupational education
• Emergence of commercialized universities and
  Commercialization of traditional universities
• Improved Course Management SystemWebCT,
  BlackBoard, TopClass, LearningSpace, etc.
• Emergence of media specialistsInstructional
  Designer with other specialists (Teaching
  Faculty, Graphic Designer, Media Editor, Computer
  Specialist, Content Specialist, etc).
• Internationalized curriculum

6
Current e-Learning Situation

• Leading market principle and Lack of research on
  e-Learning educational process
• Poor evaluation process
• Difficulties of face-to-face communication,
  Socializational factor of educational process
• Business education, workshopWeb-based Training
  (WBT)?Corporate University, and Technical
  knowledge
• Suitable for education of working adults, but is
  it suitable for academic graduate education
• Is it impossible to construct individualized
  e-Learning?

7
Transition of Views on Learners

• Physiological Psychology
• Behaviorism
• Neo-Behaviorism
• Cognitive Psychology
• Constructionism

8
Instructional Design

• The systematic and reflective process of
  translating principles of learning and
  instruction into plans for instructional
  materials, activities, information resources, and
  evaluation.

9
Teaching vs. Instruction

• Teaching
• Learning experiences that are facilitated by a
  human being not a videotape, textbook, or
  computer program, but a live teacher.
• Instruction
• All learning experiences in which the
  instructional support is conveyed by teaching and
  other forms of mediation.
• A live teacher is not essential to all
  instruction.

10
Instructional Design Process

• Perform an instructional analysis to determine
  where were going.
• Develop an instructional strategy to determine
  how well get there.
• How will we know when we have arrived? (What
  should our tests look like? How will we evaluate
  and revise the instructional materials?)

11
Instructional Design Process

• Analysis ??
• Learning contexts, Learners, Learning task
• Write test items
• Strategy ??
• Determine
• Organizational strategies, Delivery strategies,
  Management strategies
• Write and produce instruction
• Evaluation ?????
• Conduct formative evaluation
• Revise instruction

12
Teacher-centered?? Learnercentered

• EvaluationFeedback
• Diagnostic test
• Computer-adaptive test
• Cognitive Science
• Constructivism

13
Formative Evaluation?????

• Norm-referenced test vs. Criterion-referenced
  test
• Formative test vs. Summative test
• ??assessment vs. ??diagnostic test
• B. S. Bloom?Mastery Learning Theory ????????

14
Classification of Computer-Based Testingby
Bunderson et al. (1989)

• Computerized Testing CT
• Computerized Adaptive Testing CAT
• Continuous Measurement CM
• Intelligent Measurement IM

15

• ??????????Computer-based Testing
• e-Testing
• ?????
• Formative Evaluation

16
Merits of CBT

• ?????????????????????????Multimedia capability -
  New Item Types
• ?????????New Psychological Constructs
• ???????????????????New types of questions
  simulation of real life or game-like testing
• ??????Cognitive diagnostic?a profile of the
  strengths and weaknesses

17
Current CBT

• Most of test items are Multiple Choice or
  True-False??????(dichotomous response item)
• ???????(Test Security)??????(very expensive)
• Technical difficulties for individual
  identification of test takers ???????????????part
  icularly on the Internet
• But no problem for formative evaluation
  ??????????????????
• It is very suitable for e-Testing for e-Learning.

18
New CBT item types

• ?????Performance-oriented
• ???????Interactive responses
• ???????????Real situations or simulated reality
• ???????Higher cognitive function
• New constructs
• ?????Graded scoring

19
??????(International Standardization)e-Learning
?e-Testing

• Hardware
• Software
• Environment
• Identification
• Test security

20
Automatic Essay Scoring for CM IM??????

• Standardization of Scoring Process ??????????
• Human raters?????Scoring practice??????????prone
  to make errors??????
• ????????? Scoring process is explainable.
• ???(??????????)???? rater reliability
• ???? essay scoring e-rater, PEG??