eCoLoRe Report on selflearner Evaluation Pilot Tests Primary Materials

1
eCoLoReReport on self-learnerEvaluation
Pilot Tests(Primary Materials)

• Uwe ReinkeFachrichtung 4.6"Angewandte
  Sprachwissenschaft sowie Übersetzen und
  Dolmetschen", Universität des Saarlandes,
  Saarbrücken

2
Evaluation Pilot Tests Setup (I)

• Three-month pilot evaluation of primary
  materials(January 04 - March 04)
• Aim obtain first reactions from potential end
  users
• BDÜ hired two translation students from German
  universities not involved in eCoLoRe
• Students are not familiar with TM software, but
  are sufficiently computer-literate and
  computer-curious
• Typical representatives of the self-learner
  target group
• University background may also enable them to
  evaluate the didactic suitability of the material
  in various classroom scenarios.

3
Evaluation Pilot Tests Setup (II)

• 21 English-German translation kits covering
  various translation scenarios for different file
  formats created from eCoLoRe primary material
• Background material provided
• written instructions describing the task and
  providing background information on particular
  file formats (online help, presentations,
  spreadsheats etc.)
• background material on TM tools and localisation
  process
• individual introductions to Déjà Vu X
• German translations of English source texts to be
  worked on included as support material (to
  prevent the test to become an exercise in
  translation and to put the focus on evaluation)

4
Evaluation Pilot Tests Initial Problems

• Background knowledge (e.g. distinction between
  TM and TDB, difficulties to understand the
  process)
• Problems with the software
• due to lacking information in the online help
• due to lack of background knowledge
• Difficulties to understand the task

5
Evaluation Pilot Tests Deliverables

• Final written report in English
• Short monthly interim reports
• Students have been briefed to distinguish as
  thoroughly as possible between problems related
  to the TM software and issues related to the
  nature and design of the eCoLoRe material
• Reports will be made available in the Partners
  Area of the eCoLoRe website