Frames Evaluation of CNEAF Surveys with the Manufacturing Sector of the 2002 Economic Census

1
Frames Evaluation of CNEAF Surveys with the
Manufacturing Sector of the 2002 Economic Census

• Vicki Haitot and Richard Hough
• US Census Bureau
• April 28, 2005

2
Overview

• Purpose of Frame Evaluations
• Three Completed Evaluations
• Two Step Matching Process
• General Conclusions
• Frames Evaluation Results Coverage by
  Establishment Counts
• Frames Evaluation Results Coverage by Volume
• Summary of Results
• Next Steps
• Question for committee

3
Purpose of Frame Evaluation

• Evaluate coverage of EIA frames
• Identify differences between the frames
• Identify characteristics of missing
  establishments

4
Three Completed Evaluations

• EIA-5 Quarterly Coal Consumption and Quality
  Report, Coke Plants
• Collects data on coke and breeze production
• Survey coverage is all U.S. Coke Plants

5
Three Completed Evaluations Cont.

• EIA-63a, Annual Solar Thermal Collector
  Manufacturing Survey
• Collects information on shipments of solar
  thermal collectors
• The frame includes manufacturers, importers, and
  exporters

6
Three Completed Evaluations Cont.

• EIA-63b, Annual Photovoltaic Module and Cell
  Manufacturing Survey
• Collects information on shipments of photovoltaic
  modules and cells
• The frame includes manufacturers, importers, and
  exporters

7
Two Step Matching Process

• Step 1 Match EIA reporting units to Census
  Bureaus Business Register
• - To determine if manufacturing details will
  be available for comparison

8
Two Step Matching Process Cont.

• Step 2 Match Manufacturing units on EIA Frames
  to Manufacturing Establishments from
• 2002 Economic Census
• Current Industrial Report MA334Q

9
General Conclusions

• There were seven manufacturing establishments
  that reported to the Economic Census and were not
  included in the EIA frames
• These seven establishments were small relative to
  estimates published by the Economic Census

10
General Conclusions Cont.

• EIA frames include non-manufacturing units. Based
  on our analysis, the coverage of manufacturing
  establishments within the frames is sufficient.

11
Frames Evaluation Results Coverage by
Establishment Counts

• Measured as the ratio of the total number of
  matched establishments on EIAs frames with the
  total number of in-scope manufacturing
  establishments on the frame for the 2002 Economic
  Census or the CIR.

12
Frames Evaluation Results Coverage by
Establishment Counts Cont.

• The Solar Thermal Collector Survey matched 10 out
  of 13 establishments for a 0.77 coverage rate
• Missing one establishment in each of CA, NV and
  TX
• For each of the 3 establishments, Solar Thermal
  Collectors were not the primary product
  manufactured

13
Frames Evaluation Results Coverage by
Establishment Counts Cont.

• The Photovoltaic Cells/Modules Survey matched 11
  out of 12 establishments for a 0.92 coverage rate
• Missing one establishment in CA
• Matched 9 out of 9 establishments that reported
  manufacturing Photovoltaic Modules
• Matched 7 out of 8 establishments that reported
  manufacturing Solar/Photovoltaic Cells

14
Frames Evaluation Results Coverage by
Establishment Counts Cont.

• The Coal Coke Survey matched 19 out of 23
  establishments for a 0.83 coverage rate
• Missing two establishments in MI, one in IN and
  one in PA

15
Frames Evaluation Results Coverage by Volume

• Measured as the ratio of the total product value
  or shipments for matched establishments with the
  total of in-scope manufacturing establishments on
  the frame for the Economic Census or the CIR.

16
Frames Evaluation Results Coverage by Volume
Cont.

• The Solar Thermal Collector Survey had a coverage
  rate of 0.94, measured as a ratio of product
  value.
• The Photovoltaic Module/Cells Survey had a
  coverage rate of 1.00 for Photovoltaic Modules,
  measured as a ratio of product value.
• The coverage rate for solar cells is unavailable
  due to Census Bureau disclosure policy

17
Frames Evaluation Results Coverage by Volume
Cont.

• The Coal Coke Survey had a coverage rate of 0.98,
  measured as a ratio of product shipments in short
  tons.

18
Summary of Results
19
Next Steps

• Evaluations of the EIA-3, Quarterly Coal
  Consumption and Quality Report, Manufacturing
  Plants, and the EIA-860, Annual Electric
  Generator Report

20
Question

• Should EIA consider conducting these evaluations
  every 5 years with the Economic Census?