Understanding and Setting New Scores - PowerPoint PPT Presentation


PPT – Understanding and Setting New Scores PowerPoint presentation | free to download - id: 3554-MTY2M


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation

Understanding and Setting New Scores


If you're comparing total scores, CBT and PBT TOEFL do not measure Speaking, but ... Final scores to be posted on our Web site. ... – PowerPoint PPT presentation

Number of Views:112
Avg rating:3.0/5.0
Slides: 15
Provided by: jbau
Learn more at: http://www.ets.org


Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Understanding and Setting New Scores

Understanding and Setting New Scores
iBT TOEFL Scores
  • The score report universities receive will
  • Four skill scores
  • Reading 0 - 30
  • Listening 0 - 30
  • Speaking 0 - 30
  • Writing 0 - 30
  • A total score 0 120

Setting New TOEFL Scores
  • An opportunity to think more about English
    language needs requirements
  • Are all skills equally important for success in
    your program? If not, do your score
    requirements reflect this?
  • Students with the same total score can have
    different abilities
  • Consider using
  • skill scores instead of total scores
  • skill scores and total scores

Understanding Setting New Scores
  • Rubrics for Writing Speaking
  • Speaking and Writing samples
  • Score comparisons
  • Percentile data
  • English language competency descriptors
  • Results from standard setting studies
  • Standard setting on your own campus

Score Comparisons iBT, CBT, PBT
  • Based on a field test of 3,000 test takers in 30
  • Approx 80 of TOEFL volume comes from these 30
  • Test takers took TOEFL iBT and TOEFL CBT
  • Score comparisons for CBT and PBT (paper-based
    test) established in 1998

Using Score Comparisons iBT, CBT, PBT
  • Score-to-score and range-to-range comparisons
  • Reading
  • Listening
  • Writing
  • Reading, Listening Writing only total
  • Total score (all four skills)

Setting Speaking Scores
  • No Speaking section on TOEFL CBT
  • Standard setting panel of ITA experts
  • Professional judgment, not statistically
  • Minimally acceptable level of speaking for lowest
    level of contact with undergraduates 23
  • TSE 50 score equivalent 26

Using Score Comparisons iBT, CBT, PBT
  • Score comparisons can be useful for understanding
  • but differences in the tests can make it
    difficult to establish exact comparisons.

Using Score Comparisons iBT, CBT, PBT
  • Remember
  • If youre comparing total scores, CBT and PBT
    TOEFL do not measure Speaking, but iBT does.
  • Using skill scores or skill scores and a total
    score will give you more information about your
    applicant. Use the whole profile.
  • ETS encourages you not to set a rigid cut score

Percentile Data
  • Based on field test
  • Should be used with caution
  • Sample size
  • Motivation performance
  • Unfamiliarity with the test, communicative
    competence integrated tasks
  • Addition of Speaking
  • Participants had lower ability level than general
    TOEFL population
  • New data from operational test to be published
    after first year

English Language Competency Descriptors
  • Based on 2,300 students who took the new iBT test
    and responded to questions about their English
    language ability in each skill
  • Competency descriptors tell us what a student can
    do, and has difficulty with, in English

Results from ETS Standard Setting Studies
  • Panels at 5 universities recommended scores based
    on seeing the new test and reviewing examinee
  • Results to be published after decision makers
    discuss recommendations and set final scores.
    Final scores to be posted on our Web site.
  • Schools similar to those in the study may wish to
    adopt similar scores.

Panel Recommendations NOT FINAL SCORES
Standard Setting at Your Institution
  • The best way to ensure your language requirements
    match your institution
  • Over 2 days, a panel of college or university
    faculty and staff work view the test and student
    responses to it.
  • The panel recommends the level of English just
    high enough to cope with studies at your school.
About PowerShow.com