Analyzing Student Achievement Data to Improve Student Performance

1
Analyzing Student Achievement Data to Improve
Student Performance
Scott Bushman, Instructional Technology
Coordinator
2
Bexley City School District

• Mission
• Building a Community of Learners into a
  Community of Leaders
• Vision
• Bexley City Schools value a safe, warm, and
  nurturing environment. Experiences will be based
  on a deep and abiding respect for individuals.
• Educational experiences will foster a respect for
  diversity and an understanding of individual
  differences and cultures.
• High quality will exist throughout. Students,
  staff, parents and other community members will
  be included in the process to implement
  continuous improvement and research supported
  best practices.
• Use of data will drive decision making.

3
District Data Needs

• NCA Transition Guided our focus
• SIF compliance (Play well with other Systems)
• Link to student information system
• Single source of data entry
• Family management capabilities

4
District Data Needs

• Record, sort, organize and retrieve individual
  student performance data
• Disaggregate student level data
• NCLB
• Store multiple years of
• Student achievement data
• Avoid annual dump of data
• All NCA accreditation levels
• require data analysis

5
District Data Needs

• District control
• Can design our own assessment
• Parent communication
• District, building, grade, individual teacher and
  student level
• Any type of Cut Score (raw, scale, etc.)
• Automatically groups into district
• defined levels of achievement

6
District Data Needs

• Available district wide
• Exchange data between schools
• Easily accessed by
• Teachers
• Students
• Parents
• Administrators
• Export data into a
• variety of formats

7
Data Flow Chart
8
Value-Added ReportsSOAR vs. ODE Model (A
Comparison Guide)
9
(No Transcript)
10
(No Transcript)
11
(No Transcript)
12
(No Transcript)
13
(No Transcript)
14
(No Transcript)
15
(No Transcript)
16
Battelle for Kids
17
Battelle for Kids
18
Battelle for Kids

• Ohio Value Added Project
• 3 Years of Student Achievement Data
• Creates statistical trajectory to predict a
  years worth of growth
• Analysis by Content, Building Student
• Capacity building 18 DVAS
• Train the Trainer Module
• Web Site - http//www.battelleforkids.org/

19
(No Transcript)
20

21

22

23

24
(No Transcript)
25
Educators Workroom Ohio Department of Education
26
Educators Workroom Ohio Department of Education
27
Educators Workroom Ohio Department of Education
28
Educators Workroom Ohio Department of Education
29
Educators Workroom Ohio Department of Education
30
ODE OAT OGT Item Analysis(Microsoft Excel)
31
Using D3A2
32
Support Materials
33
D3A2 Tools
34
Ohio Assessment Test Scores(My Student Results)
35
Ohio Assessment Test Scores(Item Analysis)
36
Ohio Assessment Test Scores(Item Analysis -
Benchmark)
37
Ohio Assessment Test Scores(Item Analysis -
Student)
38
D3A2 - Resource Exchange
39
D3A2 - Resource Exchange
40
D3A2 - Resource Exchange
41
D3A2 - Resource Exchange
42
Using Pearson Inform
43
(No Transcript)
44
Creating Uniform Language
45
(No Transcript)
46
(No Transcript)
47
(No Transcript)
48
Employability
49
(No Transcript)
50
Establish Standards
Gifted ID
51
Reports that Aggregate Disaggregate Data
52
(No Transcript)
53
Comparing 2 Assessments

• State Test (OAT) identifies more students at the
  Advanced and Accelerated Levels.
• Below Basic and Basics Students are about the
  same.
• Is Terra Nova over identifying the gifted
  students?
• Are Basic and
• Below Basic Students
• the same for both tests?

54
(No Transcript)
55
Analyzing Concepts

• Are the same students weak in all areas of
  mathematic concepts
• Computation is the strongest
• What do we need to do to move more students to
  advanced level in Algebra?
• Measurement and
• Geometry are areas of
• concern

56
(No Transcript)
57
Disaggregated Data

• 50 of Black African American Students are Below
  Standard.
• Only 10 of Black African American Students are
  above standard.
• Next step Examine Math concept level
• for Black African
• American Students

58
Locally Developed Assessments
59
(No Transcript)
60
Click on Bar
61
Classroom Analysis for Local Assessments

• Word Choice is a strength
• Voice is area to focus on next
• How do these scores compare to other classes?

62
Individual Student Report
63
(No Transcript)
64
Intervention Groups
65
(No Transcript)
66
(No Transcript)
67
(No Transcript)
68
Analysis of Intervention Group

• Measurement Geometry need most attention
• Could this be a curriculum alignment issue?
• Could it be an instructional practices issue?

69
(No Transcript)
70
(No Transcript)
71
Analysis of Sp. Ed. Students within Intervention
Group

• Data Analysis is of most concern.
• More difficulty with abstract areas (Data
  Analysis and Algebra)

72
Drill Down to Student Names
73
Student Credentialing
74
(No Transcript)
75
(No Transcript)
76
Academic Intervention Plan
77
School Improvement and Progress Monitoring Cycle
State Assessments
Locally Deployed Assessments
Early Literacy Tests
National Assessments
Data Warehouse Performance Analysis -- Using
Multiple Sources to Provide a Complete Picture
Identify Intervention Groups
Define and Implement AIPs
Analyze Results
Monitor Progress
Support for Informed Decision-Making and
Improved Student Achievement
78
School Improvement and Progress Monitoring Cycle
State Assessments
Locally Deployed Assessments
Early Literacy Tests
National Assessments
Data Warehouse Performance Analysis -- Using
Multiple Sources to Provide a Complete Picture
Identify Intervention Groups
Define and Implement AIPs
Analyze Results
Monitor Progress
Support for Informed Decision-Making and
Improved Student Achievement
79
Export Class Report to Plan
80
Academic Intervention Plans(AIPs) within Pearson
Inform

• Selected Performance History -- Overall and by
  Concept
• Intervention History participation in prior
  intervention activities
• Designation of new intervention activities to be
  assigned
• List of concepts to be targeted
• Designation of suggestions for parents
• Follow-up
• Teacher Comments
• Required Signatures

AIPs
81
PDF Print Out
82
Professional Development
83
Professional Development

• Data Analysis Support Staff
• DVAS (District Value Added Specialists)
• Formative Assessment Training Class
• Feedback to Inform Instruction Training Class
• Data Analysis needs at each building
• Data Analysis needs for specific Departments /
  Areas
• Creating Locally Developed Assessments
• Embedding Data Analysis within Existing and New
  Intervention Plans

84
Resources

• Pearson School Systems Inform Centerpoint
• Web Site - http//www.pearsonschoolsystems.com
• Battelle for Kids Value Added
• Web Site - http//www.battelleforkids.org/
• D3A2 Data Driven Decisions for Academic
  Achievement for Ohio Schools
• Web Site - http//www.d3a2.org/about.asp
• Ohio Department of Education
• Web Site - http//www.ode.state.oh.us

85
Questions Answers

• Scott Bushman
• Email scott.bushman_at_bexleyschools.org