An Examination of the Factor Structure of the Emotional Skills Assessment Process ESAPCV Instrument

1
An Examination of the Factor Structure of the
Emotional Skills Assessment Process (ESAP-CV)
Instrument Using Confirmatory Factor Analysis

• William C. Bailey, Ph.D.
• Associate Professor
• Christina Chi, Ph.D.
• Assistant Professor
• School of Human Environmental Sciences
• Dale Bumpers College of Agricultural, Food and
  Life Sciences
• University of Arkansas

2
Emotional Skills Assessment Process (ESAP)

• Nelson and Low (1999, 2004) created the ESAP
  scale in order to assist students in academic
  achievement, career success, personal health, and
  leadership.
• ESAP was revised from a 213 item self-assessment
  instrument evaluating 10 strengths and 3 problem
  areas

3
ESAP-CV

• This study used a revised form of the ESAP with
  104 items.
• Evaluates five emotional skills
• Assertion
• Stress Management
• Drive Strength
• Time Management
• Commitment Ethic
• One Problem Area-- Change Orientation

4
Data Collection

• Data were collected using a questionnaire placed
  on www.surveymonkey.com
• Students were sent an email and asked to respond
  from a variety of University core classes to
  ensure diversity
• In addition to the ESAP-CV, there were
  demographic items such as gender, age, ethnicity,
  and college classification
• A total of 458 usable responses were collected

5
Sample Split In Halves

• The sample was randomly assigned to 2 groupsboth
  groups were a little more than 250 each.
• Because the largest subscale was 25 items, there
  was sufficient power for this analysis (1 item
  with at least 10 respondents).
• One group was analyized by exploratory factor
  analysis (EFA) and the other by confirmatory
  factory analysis (CFA).

6
Exploratory Factor Analysis (EFA)

• In order to evaluate the initial structure of
  each of the subscales, EFA was performed using
  SPSS 13.0.
• The Extraction Method was Principal Axis
  Factoring in order to maximize loadings and
  eliminate double loadings
• Loading factor of .40 was selected as item
  criteria.

7
Results of EFA was Followed by Confirmatory
Factor Analysis (CFA)

• CFA gives the researcher complete control of the
  specifications of each of the subscale
  constructs.
• CFA also allows for a statistical test of the
  goodness-of-fit for the proposed solution.
• AMOS 5.0 was used for analysis

8
Goodness-of-Fit Analysis Statistics 1

• Overall Chi-square statisticprovides a test of
  whether the sample covariance matrix is
  equivalent to the model-implied covariance matrix
  within sample error.
• Rule of thumb p values larger than .05 or .10.
• However, this is effected by sample size and
  should be interpreted with caution.

9
Goodness-of-Fit Analysis Statistics 2

• The CFI was created to compare the fit of the
  proposed model to the worst case alternative.
• This is a null baseline model where every measure
  is modeled as being uncorrelated with every other
  measure.
• CFI ranges between 0 and 1.
• Rule CFI values .90 are above are adequate of
  the model.

10
Commitment Ethic EFA Factor

• This 12 item scale measured one construct
  according to EFA.
• However, only 10 items loaded at better than .40
• Item 5I have a solid feeling of confidence in
  my ability to create a good life for myself.
• Item 7I do not procrastinate.

11
Commitment Ethics Item Loadings
Due to EFA resulting in a single factor, CFA was
not conduced.
12
EFA of Assertion

• The Assertion portion of the ESAP has a total of
  18 items.
• It has a unique design.
• The word Situation is used prior to three
  similar statements creating 6 items clusters.
• The EFA indicated there were only 5 items
  clusters of varying from 2 to 3 items.
• Items 1, 6, 16, 17, and 18 failed to load at .40
  or better.

13
CFA Model of Assertion
p. .000
14
Five Suggested Factor Names for Assertion

• Items 10, 11, 12 Response to Requests
• Items 5 6 Aware of Anothers Anger
• Items 7, 8, 9 Communication with Authority
• Items 13, 14, 15 Making Demands of Others
• Items 2 3 Anger Directed at Another Person

15
EFA Analysis Drive Strength

• Drive Strength has 25 items
• EFA generated Five Factors
• Five items failed to load .40 or better

16
CFA Model of Drive Strength
p. .000
17
Five Suggested Factor Names for Drive Strengths

• Factor 1 Self Starter
• Factor 2 Self Challenger
• Factor 3 Project Focus
• Factor 4 Planning for the Future
• Factor 5 Personal Success Strategies

18
Time Management EFA

• 12 items
• Resulted in 2 Factors
• All 12 items loaded at better than .40

19
CFA of Time Management
p. .000
20
Suggested Names for Time Management Factors

• Factor 1 Effective Time Management Skills
• Factor 2 Punctuality

21
EFA of Stress Management

• 25 items
• EFA generated 4 Factors
• Five items failed to load at .40 or better

22
Unable to Show CFA Model
23
Suggested Names for 4 Stress Factors

• Factor 1- Stress Obstructing Sense of
  Well-Being
• Factor 2 Coping by Relaxing
• Factor 3 Stress and Impatience
• Factor 4 Unable to Cope

24
EFA Analysis for Problem Area Change Orientation

• 12 items
• 2 Factors Generated
• 2 items failed to load at better than .40

25
CFA for Change Orientation
26
Modest Suggestions and Conclusions

• Several of the ESAP-CV scales measure more than
  one concept
• Reduction of items on some scales may be
  appropriate
• Some of the CFA models are statistically more
  powerful than others
• Small number of items subscales will be difficult
  to norm and title

27
Future Directions for Research

• Does the ESAP-CV really have predictive validity?
  What can it predict?
• Developing norms based on gender, ethnicity, or
  age?
• ????????????