Software Development at the IEA Data Processing Center

1
Software Development at the IEAData Processing
Center

• Report to the General AssemblyHelsinki, October
  2005

2
Software Development at the DPC

• Enhancement of existing software
• Data entry program (WinDEM)
• Within-School-Sampling Software (WinW3S)
• New software
• Online Data Collection Program (SurveySystem)
• Preliminary version presented last GA
• International Database Analyzer (IDB Analyzer)
• Adressing last year GA request

3
SurveySystem

• International version of instruments is available
• Program reflects the structure of an
  international study
• Culture/language
• Questionnaire
• Section
• Question
• Question part
• Translation and editing tool
• Publishes Web-based questionnaires

4
Selection of culture / language
5
Translation Study level
6
Translation Questionnaire level
7
Translation Question
8
Translation Part of a question
9
Web Preview (Original)
10
Web preview (Thai)
11
Web Preview (Hebrew)
12
Applications of the SurveySystem

• SITES technical try-out
• PIRLS Curriculum Questionnaire
• SITES Field Trial
• Citizenship Survey in Germany

13
Analyzing TIMSS or PIRLS Data

• Complex design
• Hierarchical data structure
• Schools
• Classes with teachers
• Students
• Many files (TIMSS1999 and TIMSS2003 -gt800 files)
• Many variables (Up to 450 per file)
• Special statistical routines necessary
• Complex sample
• Booklet design
• SPSS Programs were prepared to do proper analyses.

14
Analyzing the International Database with SPSS -A
Challenge
15
IDB Analyzer

• Allows straight forward analyses of IEA Data
  (TIMSS and PIRLS)
• Grapical User Interface in SPSS environment
• No editing of syntax
• Capabilities
• Combines countries
• Combines data from different levels (students,
  teachers, schools)
• Selection of variables
• Calculates correct standard errors
• Sampling errors
• Imputation errors

16
Starting the IDB Analyzer

• The modules for merging data and the analysis
  module will be started separately
• Both modules can be started either directly from
  the Windows Program menu or alternatively from
  the SPSS Utilities Menu

17
Merge Data Module

• Objective Preparing the data for analysis
• Window 1
• Allows to specify the type of data to be analyzed
  (study, cycle, population)
• Allows to combine data from different countries
• Window 2
• Allows to select and merge different data levels
  (school data, teacher data, and student data)
• Allows to graphically select the analysis
  variables needed
• Automatically pre-selects necessary
  identification variables and weights

18
Merge Module Overview Window 1
Data source selection
Study type, cycle, and population
Country selection
Selected countries
19
Merge Module Overview Window 2
Available file types
Variables available for analysis
Selected variables
Sort function
Search function
Save file
20
After merging
the merged file will be active in SPSS
the syntax window will list the merge script
21
Analysis Module Overview
Data source
Type of Analysis (selecting the macros)
Available variables for selected parameter
Parameter section
Search function
22
Analysis Module Running Analysis
Selecting the parameters (here selecting math PV
as dependent variable)
Weight variables have been pre-defined
23
Analysis result Output Window
Original SPSS report
24
Analysis result Syntax Window
Contains whole analysis syntax allows to re-run
the analysis
25
Thank you