Aims for e3an consultants

1
Aims for e3an consultants

• to generate 50 questions per consultant
• with answers / feedback / metadata
• validated using the e3an tool
• peer reviewed
• to give good theme coverage.
• to hit the submission deadline.

2
Theme Leaders

• Each theme has a theme leader.
• Theme leaders get a bit of extra money
• ... or produce less questions.
• Theme leaders are responsible for the operation
  of the theme team
• ... and the successful delivery of the questions
  to e3an.

3
Agreeing the subtopics

• Teams agree the subtopics
• ... and the levels for each subtopic

4
Balance of questions

• Teams decide
• how many questions per ticked box are
  appropriate.
• balance of question types between exam / mcq etc.
• (the pilot balance was 21 mcqexam)
• approach to any theme-specific issue such as
  notation.
• balance of difficulty (threshold / good /
  excellent)

5
Assigning the questions

• Teams divide the questions amongst the
  consultants.
• Theme leader keeps a record of who is going to do
  what.
• Try to arrange a half day get-together to discuss
  the theme and sort out the questions if at all
  possible.

6
Generating the questions - 1

• Consultants then generate
• questions
• metadata
• model solutions (exam type)
• feedback (multiple choice)
• other notes

7
Generating the questions - 2

• Questions must
• be entered using Word templates
• have diagrams in acceptable format
• follow the e3an guidelines
• be complete and correct

8
More on questions

• Can be based on existing questions, adapted for
  e3an.
• A 3 part exam question would become 3 linked
  questions in e3an preferably at increasing
  levels of difficulty.
• Generate 5 alternatives for mcqs.
• Can use other types of question.

9
Quality Question validation

• e3an has a validation tool which ensures that
  questions
• are complete
• are compatible with the database
• will go through the QTI converter
• have no font / symbol problems
• Consultants must check each question with the
  validation tool.

10
Quality Peer review - 1

• All questions must be peer reviewed to ensure
  that they are
• clear and unambiguous
• correct
• complete (answers, metadata etc)

11
Quality Peer review 2

• The most effective way to handle peer review is
  for the team to get together to review each
  other's work.
• Failing this, the team should try to get together
  in subgroups for the review.
• Theme leaders must make sure that peer review
  happens and is recorded.

12
The end of the road

• Deadline 9 September 2002
• Delivery CD or Zip according to format in the
  e3an guidelines.