Career direct correlations with other assessments accuracy job satisfaction

Career direct correlations with other assessments accuracy job satisfaction

• 1.
  CROWN FINANCIAL MINISTRIES CareerDirect Correlations with Other Assessments, Accuracy of Results, and Job Satisfaction Construct Validity: To provide evidence of construct validity, the instrument was correlated with Hogan’s (1986) Personality Inventory and Costa and McCrae’s (1985) measure of the “Big Five,” the NEO-PI. 1. Extroversion strongly related to the NEO-PI’s measure of extraversion r= .82, p < .0001) and Hogan’s measures of sociability r= .52, p < .0001) and ambition r= .52, p < .0001). 2. Conscientiousness correlated highly with the NEO-PI’s measure of conscientiousness r= .78, p < .0001) and moderately with the Hogan’s measure of prudence r= .44, p < 0001). 3. Compassion significantly related with the NEO-PI’s agreeableness r= .57, p < .0001) and the Hogan’s likability scale r= .61, p < .0001). 4. Adventurousness moderately related to the NEO-PI’s extroversion r= .51, p < .0001) and the Hogan’s ambition scale (N = .55, p < .0001). 5. Dominance correlated moderately with the NEO-PI’s extroversion r= .33, p < .0001) and conscientiousness r= .36, p < .0001). Further, the scale correlated moderately with Hogan’s ambition scale r= .54, p < .0001). 6. Innovation correlated moderately with the NEO-PI’s openness r= .47, p < .0001) and with the Hogan’s intellectance scale r= .55, p < .0001). 7. Correlations of the Personality Report factors of extroversion, conscientiousness, adventurousness, dominance, and innovation scales, with the Marlowe-Crowne scale of social desirability were negligible with a range from r = .05 to r = .19. Compassion r= -.32, p < .0001) and stress r= .32, p < .0001) were somewhat higher, but these were still acceptable and lower than the correlations between the NEO-PI scales and the Hogan scales with social desirability. 8. Stress highly related to the NEO-PI’s measure of neuroticism r= .81, p < .0001) and the Hogan’s adjustment scale ( r = .74, p < .0001). Emperical validity: Further evidence of validity was provided by client responses to evaluation surveys included in the returned feedback reports. 1. Accuracy of the personality factors rated by the clients themselves ranged from 92% to 96%, accuracy of the strengths, 97%, accuracy of the weaknesses, 83%, and overall helpfulness of the report, 96%. The lower perceived accuracy of the weaknesses led to changes in the text to make the statements less conflicting. 2. Accuracy of the personality factors rated by a close acquaintance or spouse ranged from 87% to 93%, accuracy of the strengths, 94%, and accuracy of the weaknesses, 71%. Again, changes were made in the text to make the statements less conflicting. Validity Evidence 1. General Interest Factors were tested for construct validity with the Strong Vocational Inventory scales. Simple correlations between appropriate factors were all positively related at a significant level. 2. Analyses were conducted to assess construct validity based on client responses to evaluation surveys included in the returned feedback reports. a. Interests, Skills, and Values sections- © 2011 Crown Financial Ministries, Inc www.crown.org Page 1 of 3
• 2.
  CROWN FINANCIAL MINISTRIES (1). Accuracy of the Interests scores, 90%. (2). Accuracy of the Skills scores, 87%. (3). Helpfulness of the Values sections: Work Environment, 91%, Work Outcomes, 89%, and Life Values, 99%. (Note-- The majority of these clients purchased the assessment and received the first version (616 of 676). A major revision was introduced in 2/97 resulted in a much smaller response rate. As a result of the feedback and further analysis of the data, another major revision was introduced as of 8/1/97. 3. Construct validity studies: a. Simple correlations were calculated between Career Direct Occupational Factors and the Strong Vocational Inventory scales. The full table consisted of 240 Strong scales and 22 Career Direct Occupational scales. A subset of the table with correlations (r) above .30 (plus or minus) between the Strong Holland (RIASEC) scales and Career Direct scales are as follows (N = 1002, normative sample of working adults, 1995): Career Direct Strong Strong Strong Strong Strong Strong Occupational Scales Realistic Investigative Artistic Social Enterprising Conventional Skilled Technical 0.87 0.47 Professional Outdoors 0.66 0.37 Non-technical 0.48 Adventure 0.64 0.46 Fashion 0.56 Service 0.45 Science 0.51 0.79 Performers 0.65 0.38 Writers/ Artists 0.32 0.78 0.35 Management 0.44 0.77 0.50 Security 0.35 Law/ Politics 0.35 0.42 0.48 Counseling/ 0.36 0.36 0.75 0.35 Education Animal Services 0.34 0.35 Medical 0.44 0.36 Financial 0.42 0.72 Foreign Service/ 0.33 0.50 0.44 0.33 Languages Drivers 0.48 Athletes 0.31 0.36 Note 1: p < 0.001 Note 2: Composition and names of occupation factors have changed slightly as item adjustments have been made from 1995 to 1999. © 2011 Crown Financial Ministries, Inc www.crown.org Page 2 of 3
• 3.
  CROWN FINANCIAL MINISTRIES b. Data from the normative sample of working adults (N = 1002), 1995, were entered into multiple regression analyses to predict Strong individual occupational scales (105 scales, males and female) using Career Direct General Interest factor scores (21), Personality factors (compassion and extroversion) and personality subfactors (10) from the remaining four factors. The adjusted R-squared statistic, which represents the amount of variance accounted for out of a total of 1.00, ranged from 0.52 (chiropractor) to 0.83 (computer programmer) for males, and 0.54 (librarian) to 0.86 (veterinarian) for females. Of the total, 59% of the 105 males scale equations yielded adjusted R-squares of 0.70 or greater, and 71% of the 105 female scale equations were 0.70 or greater. This indicates that a combination of Career Direct interests and personality factors explained a significant amount of variance on the Strong occupational scales. Job Satisfaction c. Doctoral dissertation, Using Career Profiles to Differentiate Between Occupations and Predict Job Satisfaction, 1998 by Cheryl Toth, Ph.D., IBM Global Systems. Dr. Toth used the data from the Career Direct normative sample of working adults to investigate the person-job fit within occupational groups and differential occupational activity. The research indicated that patterns of personality traits, vocational interests, and skills (abilities) influence preferences for particular occupations in Holland’s occupational typology. Descriptive discriminant analysis combined the four domains of personality, interests, skills, and work values into one analysis to test the significance of the four aspects together in accounting for individual’s preferences for different occupations. The results indicated that vocational interests, personality characteristics, and skills are significantly related to occupational preference and need to be incorporated into the assessment process to guide occupational choice. The investigation of predicting vocational choice with these multiple simultaneous predictors had not been evaluated prior to this study. Multiple regression analysis was used to investigate whether those variables that differentiate between occupations also contribute to job satisfaction based on satisfaction data collected at the same time as the Career Direct normative data. The results indicated that work values, while not contributing to occupational differentiation, did significantly contribute to satisfaction with one’s job. This comprehensive study of data from working adults concluded that in order to help persons improve the probability of making a satisfying career choice and to identify stable career paths, one should include all four domains of vocational interests, personality characteristics, skills/abilities, and work values. © 2011 Crown Financial Ministries, Inc www.crown.org Page 3 of 3