The implementation of tools to support the data quality of the survey frame

1
The implementation of tools to support the data
quality of the survey frame
Mario Ménard
November 2008
2
Outline

• Data sources to populate and maintain the survey
  frame
• Quality Assurance Survey
• Interceptor Module
• Survey Frame Assessment Tool

3
Data Sources used to maintain the frame

• Legal name, business address, main activity
  description, geographical location, size measures
  etc.

• Data collection centers transmit survey feedback
  to the Register

• Interception of legal name, business status and
  NAICS changes

Canadian Revenue Agency (CRA)
Survey Feedback

• 99 of businesses have only one operating entity

Central Survey Frame Business Register

• Identification of inactive businesses

• Review the validity of the survey feedback

Profilers and Frame Analysts
NAICS Coding

• Updates business structure and its
  characteristics

• 400 000 new businesses each year
• 45 are coded automatically based on the
  description provided at the time of registration
• 55 requires manual intervention

• Review the updates performed on business
  structures and its characteristics

• of misclassified businesses

4
Quality Assurance Survey

• QAS measures the number of inactive businesses
  and the quality of NAICS coding for units on the
  BR
• Monthly sample of 600 businesses
• Allows small constant surveys conducted by a few
  individuals
• Reduces QAS interviewer re-training and ensures
  survey consistency from month to month
• Provides timely, relevant measurements
• Gives an indication of the inactive units and
  coding quality over time
• Units eligible for selection exclude very large
  and complex businesses and recently surveyed units

5
Quality Assurance Survey Resultsfrom June 2007 -
July 2008
6
Quality Assurance Survey Resultsfrom June 2007 -
July 2008
7
Interceptor Module

• Intercepts requests for updates received from the
  data collection centres
• The following events are intercepted
• Classification changes
• Legal name changes
• Business Status changes
• Survey program managers have the choice to decide
  if they want to use this module
• After 35 days in the interceptor module, requests
  for updates are processed automatically to avoid
  the accumulation of events

8
Number and status of update requests received in
the Interceptor ModuleFrom January 2008 to
September 2008
9
Survey Frame Assessment Tool

• Indicates changes on the survey frame from one
  period to the other
• Easily accesses the details of the changes
• Analysis performed just before the release of the
  monthly Generic Survey Universe File
• Identifies the largest contributors to the change
  from one period to the another
• Measures the quality of work being performed by
  the people making updates to the frame
• Provides constructive feedback and a good
  indication of additional training that may be
  required

10
Survey Frame Assessment Tool
Number of additional establishments and their
revenue contribution by type of updates between
the June 1st and July 1st G-SUF, 2008
11
Survey Frame Assessment Tool
Number of additional establishments and their
revenue contribution by type of updates between
the June 1st and July 1st G-SUF, 2008
12
Survey Frame Assessment Tool
Number of additional establishments and their
revenue contribution by type of updates between
the June 1st and July 1st G-SUF, 2008
13
Survey Frame Assessment Tool
Example of the detailed regarding each update
that contributed to the changes in the GSUF from
June 1st and July 1st G-SUF, 2008
14
Questions
Thank you