Title: 2004 International Conference of NTNTC GIMS and RDC TechnologyBased Testing and StandardBased Assess
12004 International Conference of NTNTC GIMS and
RDC Technology-Based Testing and Standard-Based
AssessmentIntroduction to Education in Japan
Web-based Learning EnvironmentWeb??????????
(e-Learning)Instructional Design Eiji
MurakiProfessor, Department of Educational
Informatics, Tohoku University
2IT Revolution????????IT??
- ITInformation Technology
- Developed at CERN, Internet started as a tool for
communication among scientists - IT is our current condition surrounded us
- IT requires us to communicate in new ways
- IT is the technological innovation, but we need
to develop some new ideological foundations to
live in this IT world - How do we live happily in this IT age?
3Emergence of e-Learning
- Since 1990s
- Virtual University? Online Education
- Kenneth C. Green
- American Higher Educational Institutions
- e-Learning course
- 1999 46.5
- 2000 55.5
- 2001 59.0
- 2002 62.5
- Outbreaking period 1995-1997
4The definition of e-Learning
- e-Learning is learning in which students do and
learn by trial and error through practice on the
virtual environment created by multimedia and
computer networks, aided by rich informational
resources, knowledge support, and feedback(?????
e????????????????)? - Closed virtual learning enviroment
5Background of e-Learning(USA)???(?????????????e??
?????????)
- Advancement of IT technology and Spread of
Internet - Mutual communication
- Development of multimedia function
- Basic communication is inexpensive
- Increased adult population for higher education
Adult working population - Economic merits by academic degreesTechnical
occupations, Occupational education - Emergence of commercialized universities and
Commercialization of traditional universities - Improved Course Management SystemWebCT,
BlackBoard, TopClass, LearningSpace, etc. - Emergence of media specialistsInstructional
Designer with other specialists (Teaching
Faculty, Graphic Designer, Media Editor, Computer
Specialist, Content Specialist, etc). - Internationalized curriculum
6Current e-Learning Situation
- Leading market principle and Lack of research on
e-Learning educational process - Poor evaluation process
- Difficulties of face-to-face communication,
Socializational factor of educational process - Business education, workshopWeb-based Training
(WBT)?Corporate University, and Technical
knowledge - Suitable for education of working adults, but is
it suitable for academic graduate education - Is it impossible to construct individualized
e-Learning?
7Transition of Views on Learners
- Physiological Psychology
- Behaviorism
- Neo-Behaviorism
- Cognitive Psychology
- Constructionism
8Instructional Design
- The systematic and reflective process of
translating principles of learning and
instruction into plans for instructional
materials, activities, information resources, and
evaluation.
9Teaching vs. Instruction
- Teaching
- Learning experiences that are facilitated by a
human being not a videotape, textbook, or
computer program, but a live teacher. - Instruction
- All learning experiences in which the
instructional support is conveyed by teaching and
other forms of mediation. - A live teacher is not essential to all
instruction.
10Instructional Design Process
- Perform an instructional analysis to determine
where were going. - Develop an instructional strategy to determine
how well get there. - How will we know when we have arrived? (What
should our tests look like? How will we evaluate
and revise the instructional materials?)
11Instructional Design Process
- Analysis ??
- Learning contexts, Learners, Learning task
- Write test items
- Strategy ??
- Determine
- Organizational strategies, Delivery strategies,
Management strategies - Write and produce instruction
- Evaluation ?????
- Conduct formative evaluation
- Revise instruction
12Teacher-centered?? Learnercentered
- EvaluationFeedback
- Diagnostic test
- Computer-adaptive test
- Cognitive Science
- Constructivism
-
13Formative Evaluation?????
- Norm-referenced test vs. Criterion-referenced
test - Formative test vs. Summative test
- ??assessment vs. ??diagnostic test
- B. S. Bloom?Mastery Learning Theory ????????
14Classification of Computer-Based Testingby
Bunderson et al. (1989)
- Computerized Testing CT
- Computerized Adaptive Testing CAT
- Continuous Measurement CM
- Intelligent Measurement IM
15- ??????????Computer-based Testing
-
- e-Testing
- ?????
- Formative Evaluation
16Merits of CBT
- ?????????????????????????Multimedia capability -
New Item Types - ?????????New Psychological Constructs
- ???????????????????New types of questions
simulation of real life or game-like testing - ??????Cognitive diagnostic?a profile of the
strengths and weaknesses
17Current CBT
- Most of test items are Multiple Choice or
True-False??????(dichotomous response item) - ???????(Test Security)??????(very expensive)
- Technical difficulties for individual
identification of test takers ???????????????part
icularly on the Internet - But no problem for formative evaluation
?????????????????? - It is very suitable for e-Testing for e-Learning.
18New CBT item types
- ?????Performance-oriented
- ???????Interactive responses
- ???????????Real situations or simulated reality
- ???????Higher cognitive function
- New constructs
- ?????Graded scoring
19??????(International Standardization)e-Learning
?e-Testing
- Hardware
- Software
- Environment
- Identification
- Test security
20Automatic Essay Scoring for CM IM??????
- Standardization of Scoring Process ??????????
- Human raters?????Scoring practice??????????prone
to make errors?????? - ????????? Scoring process is explainable.
- ???(??????????)???? rater reliability
- ???? essay scoring e-rater, PEG??