Title: Seminar on New Frontiers for Statistical Data Collection WP 30 Moving to common survey tools and processes
1Seminar on New Frontiers for Statistical Data
CollectionWP 30 Moving to common survey tools
and processes the ABS experience
- Jenine Borowik, Adrian Bugg, Brent Ross
2Outline
- ABS experience progressive convergence of data
collection tools and methods - ABS 2017 directions
- Risks and issues
- Conclusion
3Major ABS Change
- 1960s
- - Integration of Economic Statistics
- Integration of Household Statistics
- 1995
- Analysis Unit Established
- ABS Website
- 1st Confidentialised unit record file
1992 National Project Centres 1990s Increased
use of Adm Data
2011 Future Organisation Structure
1968-69 Economic Census
Information Management Transformation
1990
2000
2002 Business Statistics Innovation Program
1964 1st Mainframe
ABS 2017
1992 Lotus Notes/WDBs
4- Individual collection methods and systems for
- Progressive convergence of tools and methods
- Household surveys
- Business surveys
- Population Census
- Others
- cottage industries
- CAPI / CATI
- Paper and scanning
- Establishment of ESDC (100-400 office based
interviewers) - Single field interviewer workforce (300-900 field
based interviewers) - Administrative Data Acquisition Unit
- Integrated Collection and Dissemination Division
5ABS experience
- Existing purpose built capability
- Specialised
- Inflexible and vulnerable
- High cost to maintain and change
- Slow to change
- Cycle of leap and legacy
6The Challenges
Riding the big data wave
New competitors changing expectations
Increasing cost difficulty of acquiring data
Competition for skilled resources - low
unemployment
Reducing budget
Rapid changes in the environment
7Where are we headed?
- Over the next 5 years we will transform the way
the ABS manages information from collection to
dissemination - Providing a better evidence base for use by
Governments and the community
8ABS 2017 Program Goals
- Reduce the cost and time of doing business
- Grow the business through new statistical
products and services - Deliver the first large scale digital Census
(2016) on time, to budget and quality - while delivering Business As Usual.
9How will we get there?
- Through large scale Innovation across the whole
ABS - We will
- radically transform the way we acquire, collate,
use, reuse and disseminate statistical
information - By
- industrialising, modernising and reengineering
our business processes - reengineering our statistical infrastructure and
the way we manage information - developing capability needed to meet future needs
- collaborating with other international NSIs
- focussing on a limited number of centralised
projects, including the digital Census for 2016
101. Business Process Reengineering
- Change the way we acquire and process data
emphasis on e-collect for Census 2016, business
and household surveys, including web and hand
held devices - Increase our access to and use of large
administrative datasets - Integrate and join data from a range of sources
112. Reengineering Statistical Infrastructure
- New Core Information Management Infrastructure
tools - metadata driven systems based on agreed standards
- One ABS data warehouse to store, manage data from
all sources - On-line data that can be queried
- Management of statistical workflows
- International collaboration to build next
generation statistical tools
12Expected Changes in our statistical cycle
13(No Transcript)
14Collection Futures for Census, Household
Business Surveys
Household Surveys
Business Surveys
Population Census
15ABS 2017 Infrastructure
ABS 2017 Strategy
Line of business - silo / legacy
Enterprise Solution
Line of business - utilising core infrastructure
Enterprise Ready
Candidate for future upgrade
Minimise -where enterprise is undesirable
(business case doesn't exist)
Freeze, Minimise investment
16Functional Areas Level of Development
Address Register Enterprise Solution
CAI Data Capture Enterprise Solution
Contact Services Enterprise Solution
eForm Application Enterprise Solution
eForm Data Load Enterprise Solution
eForm Platform Enterprise Solution
Event and Operation Management Enterprise Ready
Frame Create, Maintenance and Sample Select Enterprise Solution
Knowledge Services Enterprise Ready
Paper Forms Data Capture RFT and implementation Enterprise Solution.
Provider Management Enterprise Ready
Provider Portal Enterprise Solution
Provider Portal Web Services Mix of Enterprise Ready and Enterprise Solution
Questionnaire Development Enterprise Solution
Spreadsheet Data Capture Enterprise Solution
Workforce Portal Enterprise Solution
Workforce Portal Web Services Mix of Enterprise Ready and Enterprise Solution
Workload Management Enterprise Ready
17Risks and issues
- New stovepipes with standard tools
- Future organisational structure Operations
Division - Dont want to build if we dont need to
- Standards versus flexibility
- Cultural change and resistance
- Achieving the savings
- One size may not fit all
- Trade offs will need to occur in some business
areas - We cant resolve all problems
-
18Thank you
- Further information
- Jenine Borowik jenine.borowik_at_abs.gov.au
- Adrian Bugg adrian.bugg_at_abs.gov.au