Research Methods in MIS: Instrument Design

1
Research Methods in MIS Instrument Design

• Dr. Deepak Khazanchi

2
Instrument Design Process

• Phase 1 Developing the instrument design
  strategy
• Phase 2 Constructing and refining the
  measurement questions
• Phase 3 Drafting and refining the instrument

3
Developing the Instrument Design Strategy

• Management-Research Question Hierarchy
• The management problem/question
• Research question(s)
• Investigative questions
• Measurement questions

4
Strategic Concerns of Instrument Design

• What type of data is needed to answer the
  management question?
• What communication approach will be used?
• Should the questions be structured,
  unstructured, or some combination?
• Should the questions be disguised or
  undisguised?

5
Ways to Interact with the Respondent

• Personal interview
• Telephone
• Mail
• Computer

6
Types of Measurement Questions?

• Target
• Classification
• Administrative

7
Appropriate Question Content

• Should this question be asked?
• Is the question of proper scope and coverage?
• Can the respondent adequately answer this
  question, as asked?
• Will the respondent willingly answer this
  question, as asked?

8
How to Test a Respondents Appropriateness

• Filter questions
• Screen questions

9
Question Wording Criteria

• Is the question stated in terms of a shared
  vocabulary?
• Does the question contain vocabulary with a
  single meaning?
• Does the question contain unsupported
  assumptions?
• Is the question correctly personalized?
• Are adequate alternatives presented within the
  question?

10
What Dictates Your Response Strategy?

• Characteristics of respondents
• Nature of the topic(s) being studied
• Type of data needed
• Your analysis plan

11
Types of Response Questions

• Free-response
• Dichotomous
• Multiple-choice
• Checklist
• Rating
• Ranking

12
Guidelines to Refining the Instrument

• Awaken the respondent's interest
• Use buffer questions as a guide to request
  sensitive information
• Use the funnel approach to move to more specific
  questions

13
Improving Survey Results

• Pretesting is an established practice for
  discovering errors and useful for training the
  research team

14
Self-Administered Surveys

• Types
• Mail survey
• Computer-delivered
• Intercept studies
• Disadvantages
• Large nonresponse error
• Cannot obtain detailed or large amounts of
  information

15
Concurrent Techniques to Improve Mail Response

• Anonymity
• Size, Color, and Reproduction
• Money Incentives
• Deadline Dates
• Cover Letters

• Reduce Length
• Survey Sponsorship
• Return Envelopes
• Postage
• Personalization

16
Outsourcing Survey Services

• Research Firms Provide
• Centralized-location interviewing
• Focus group facilities
• Trained staff with experience
• Data-processing and statistical analysis
  capabilities
• Access to point-of-sale data
• Panels