Fouad and Mohler (2004)
Fouad and Mohler (2004)
Fouad and Mohler (2004)
Carolyn J. Mohler
Colorado State University
This study examined evidence for the use of the Strong Interest Inventory with
diverse populations, including examination of the structure of interests across five
racial/ethnic groups, finding similarity in perceptions of the world of work. The
study also studied differences in means for the General Occupational Themes and
Basic Interest Scales as well as assessed differences in consistency and differentia-
tion across five racial/ethnic groups for career clients. Overall, the pattern of
results suggests minimal differences based on racial/ethnic group membership but
more meaningful group differences based on gender.
423
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
424 JOURNAL OF CAREER ASSESSMENT / November 2004
have implications for the context and content of some occupations. For example,
the Bureau of Labor Statistics (BLS; 2002) reported that African Americans and
Hispanics are underrepresented in many professional occupations (e.g., execu-
tive or managerial specialties, engineers, natural scientists, physicians, dentists,
etc.) but overrepresented in other lower paying positions (e.g., dietician, social
worker, guard, postal worker, etc.). This unequal distribution is also evident in
median weekly salaries as African Americans earned 80% and Hispanics earned
68% of the median weekly wage that Caucasians did (BLS, 2002). It seems that
race and ethnicity may have an important impact on occupational choice.
The aforementioned data indicate that the occupational landscape in the U.S.
workforce is unequal, with racial and ethnic minorities being underrepresented
in several occupational groups. It is essential that career counselors be aware of
these trends and begin to identify strategies to promote occupational equity with
all clients.
One question that continues to surface among practitioners is whether inter-
est inventories are appropriate to use with racial and ethnic minority clients. This
is a critical concern as interest inventories are the most widely used assessment
tool in career counseling (Walsh & Betz, 2001). Recent research has focused on
several methods to help determine the utility of assessment inventories such as
the Strong Interest Inventory (SII) with individuals of different racial and ethnic
backgrounds and the application of Holland’s (1997) RIASEC (realistic, inves-
tigative, artistic, social, enterprising, conventional) model, on which many of the
interest inventories, including the SII, were based. The purpose of this article is
to provide a brief review of the literature examining the cross-cultural validity of
the SII and to provide support for the use of interest inventories with racially and
ethnically diverse populations. We will also present additional empirical evi-
dence on racial/ethnic differences of the vocational interests of career clients and
discuss the practical implications of this line of research.
CULTURAL VALIDITY OF
THE STRONG INTEREST INVENTORY
The SII was developed to assess vocational interests of professionals and to pre-
dict individuals’ future occupational satisfaction by assessing their similarity to
those professionals’ interests. An overarching framework of Holland’s (1997) the-
ory, with six General Occupational Themes (i.e., GOTs: realistic, investigative,
artistic, social, enterprising, and conventional) provides interpretive clarity to the
SII. When researchers examine the “cultural validity” of an assessment tool, they
tend to focus on whether the underlying theory adequately explains assessment
results for racial/ethnic minorities, or in this case, whether the results fit
Holland’s (1997) hexagonal model. This also has the added benefit of providing
additional construct validity and generalizability of Holland’s theory.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 425
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
426 JOURNAL OF CAREER ASSESSMENT / November 2004
enables the comparison of the effects found in different studies. Effect sizes can
generally be measured in two ways. One way is as the standard difference
between two means (denoted by d). The other measurement includes a correla-
tion between an independent variable and individual scores on a dependent vari-
able; the correlation is called the “effect size correlation” (Rosnow & Rosenthal,
1996). In the latter method, effect sizes range from 0 to 1.0 and are often report-
ed as a correlation coefficient (i.e., r or r2). Cohen (1988) suggested using a guide-
line of small (0.1), medium (0.3), and large (0.5) to interpret practical signifi-
cance of effect sizes of the relationships between two variables. Vacha-Haase and
Nilsson (1998) recommended the use of proportion of variance, eta squared (η2),
in multivariate analyses, with .02, .06, and .14 as guides for estimating small,
medium, and large effect sizes.
Overall, it seems that effect size estimates indicate that racial/ethnic minority
group membership has a weak relationship with vocational interests and career
choice. For example, among middle school students, Davison Aviles and
Spokane (1999) found that the overall effect size for ethnicity across the six
Holland themes was very small (r = .06), meaning that although racial/ethnic
groups differed statistically in their vocational interests, this was not a big differ-
ence practically. Leung, Ivey, and Suzuki (1994) reported small effect sizes for
ethnic group differences in career choice among Caucasian and Asian American
students, finding as well that ethnicity and career choice were weakly related.
However, the researchers did find that Asian American students showed a higher
interest in investigative (r = .24) and typically male-dominated careers (r = .21).
Similarly, Park and Harrison (1995) found that Asian Americans have higher
interests in realistic, investigative, and conventional areas (r = .14, .11, and .32,
respectively) and less of an interest in social areas (r = .25) when compared to
Caucasian students. Some research indicates that Asian American students may
have different preferences for occupations than Caucasian students, although
other research indicates no difference in occupational choice.
Fouad, Harmon, and Hansen (1994) also reported few racial/ethnic group dif-
ferences in vocational interests among professionals who met the criteria for the
1994 revision of the SII. Minimal differences (i.e., effect sizes greater than r =
0.2) were found on the investigative scale, with Asian Americans scoring higher
than African American (r = .26), Hispanics (r = .21), and American Indians (r =
.29). Differences were also reported on the artistic scale, with American Indians
scoring lower than Asian Americans (r = .21) and Hispanics (r = .21). However,
it is worth noting that because they used the professionals who formed the crite-
rion sample for the revision of the SII, Fouad et al.’s sample consisted of those
who were successful in their occupation as well as satisfied in that occupation.
Thus, the professional sample used in this study may have a high degree of accul-
turation that may have implications for the findings, leading them to be more
similar to the mainstream Caucasian population in interests. Practitioners may
wish to think about incorporating discussions or assessing for level of accultura-
tion when working with clients from diverse backgrounds.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 427
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
428 JOURNAL OF CAREER ASSESSMENT / November 2004
Some research has examined Holland’s secondary constructs but has shown
inconsistent results. Correlational studies have estimated the relationships
among job satisfaction and consistency and differentiation to be relatively small,
ranging from –.03 to .12 in one study (Carson & Mowsesian, 1993) to –.18 to .04
in an international sample (Leong, Austin, Sekaran, & Komarraju, 1998). Using
multiple regression, Leong et al (1998) found that consistency and differentiation
did not predict job satisfaction among workers in India, which may suggest that
these indices of Holland’s theory do not apply cross-culturally. Swanson and
Gore (2000) and Holland (1997) noted that little attention has been paid to con-
sistency and differentiation because of small homogeneous sample sizes but rec-
ommend future researchers continue to investigate these constructs with newer
operationalizations. Little work has focused on consistency and differentiation
across racial/ethnic groups. It is important to examine if these concepts are simi-
lar across populations to help determine the cultural validity of Holland’s model.
This study will add to the existing literature by providing additional evidence
for the use of the SII with diverse populations, including examinations of
General Occupational Themes and Basic Interest Scales, consistency, differenti-
ation, and structure across five racial/ethnic groups for career clients. The empir-
ical results of this study will help inform practitioners using interest inventories
with racial and ethnic minority clients by expanding information on consistency
and differentiation and the Basic Interest Scales, which can assist with avoca-
tional and leisure counseling.
METHODOLOGY
Participants
Participants were a sample of career clients and students who had completed
the SII in 2001 and who had self-identified as members of the following
racial/ethnic groups: African American/Black, Asian or Pacific Islander, Latino,
Latina/Hispanic, American Indian or Alaskan Native, and Caucasian. Those
individuals who marked more than one racial/ethnic category were not included;
we also excluded those who marked “other.” Data were drawn randomly from the
SII publishing and scoring company’s database until a sample of 750 individuals
was developed. The final sample of 750 of each group was drawn from a larger
total sample. African American participants were drawn from a sample of 10,915
cases, the 750 Asian American participants were drawn from a sample of 5,504
cases, the 750 Hispanics were drawn from a sample of 6,564 cases, the Native
Americans were drawn from a sample of 1,017 cases, and the Caucasians were
drawn randomly from 88,617 cases. All participant data were anonymous, with
no identifying information given other than an identification number. The indi-
viduals completing the SII were informed, “Responses on this form may be used
in the aggregate for research and inventory revalidation and renorming.”
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 429
The 750 cases in each group contained groups of both men and women, rang-
ing from 54% female (Caucasian sample) to 61% female (African American sam-
ple). Specifically, women were 431, 437, 423, 450, and 454 of the American
Indian, Asian American, Caucasian, Hispanic, and African American samples,
respectively. The median age of the groups was 20, with mean ages ranging from
23.41 (SD = 10.19) for Native American women and men, 28.0 (SD = 12.11) for
Caucasian women and men, 22.78 (SD = 8.37) for Asian Americans, 25.19 (SD =
10.11) for African American men and women, and 23.03 (SD = 8.63) for
Hispanic/Latino women and men. Participants were asked to indicate the edu-
cational level they had completed; the mean for the entire group was 3.2, where
2 represented high school graduate, 3 represented trade/technical training, and 4
represented some college. Educational levels for specific groups were 2.52
(American Indian), 3.9 (Caucasian), 3.34 (Asian American), 3.25 (African
American), and 2.95 (Hispanic/Latino).
Participants were also asked about their employment status; they were also
able to respond that they were enrolled as a student, engaged as a homemaker,
or retired. Of the 3,750 participants, 63% indicated that they were only enrolled
as students, though percentages ranged from 59% (Caucasians) to 81% (Asian
Americans), with 67% of African Americans, 75% of Hispanics, and 76% of
American Indians indicating they were enrolled as students. A small number of
the groups indicated they were retired or were homemakers, whereas 28%, 25%,
23%, 20%, and 13% of Caucasians, African Americans, Hispanics, American
Indians, and Asian Americans, respectively, indicated they were unemployed and
looking for work. As a whole, the participants averaged working 20 to 25 hours a
week; those who were working were somewhat satisfied with their employment.
Consistent with the relatively young age of the group and their student status, the
majority had worked an average of between 3.5 and 5 years, though the group
also included a few people who had worked as many as 37 years.
Instrumentation
Participants completed the SII (Harmon, Hansen, Borgen, & Hammer, 1994).
The 317 items of the SII are designed to assess an individual’s preferences for a
variety of occupations, schools subjects, and activities. For most items, individu-
als are asked if they like, dislike, or are indifferent to each item. An individual’s
likes and dislikes are then used to compare that individual’s interests to the inter-
ests of professionals in some 100 occupations. The SII includes four types of
scales. The General Occupational Themes and Basic Interest Scales were used
in this study; the former are designed to measure the six Holland (1997) RIASEC
themes and the latter are used to measure how much an individual likes a vari-
ety of clusters of interests (e.g., mathematics, athletics, helping people). Two
additional types of scales include the Personal Styles Scales and Occupational
Scales.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
430 JOURNAL OF CAREER ASSESSMENT / November 2004
Psychometric information for the GOTs and BISs are provided in the manu-
al (Harmon et al., 1994). Internal consistency estimates for the six General
Occupational Themes range from .90 for the social GOT to .94 for the artistic
GOT. Internal consistency estimates for the BISs range from .74 (agriculture) to
.94 (mechanical activities). Test-retest reliabilities of the GOT over 3 to 6 months
for a sample of college students ranged from .77 (enterprising) to .91 (artistic);
test-retest reliabilities for this same group on the BISs ranged from .68 (military
activities) to .91 (religious activities). Test-retest reliabilities for employed adults
were higher, ranging in the .80s and .90s. The authors of the manual have pro-
vided substantial evidence of criterion related validity.
RESULTS
Means and standard deviations for all groups on the General Occupational
Themes and Basic Interest Scales are provided in Tables 1 through 3. The analy-
ses focused on four areas to assess cultural validity of Holland’s theory and
racial/ethnic group differences in the SII. The first analysis indicated whether the
groups differed structurally on the General Occupational Themes. Those groups
that were similar in pattern of relationships on the GOT (and thus appeared to
perceive the world of work similarly) were then used in the subsequent analyses:
mean differences on the GOT and BIS across groups, racial/ethnic and gender
differences in differentiation, and finally, racial/ethnic and gender differences in
consistency.
Structural Analyses
The structure of interests for the 10 groups (men and women in each
racial/ethnic group) was examined to determine if the structure underlying the
GOT across groups is similar. The correlation matrices for the 6 RIASEC themes
were examined to determine if they are related as predicted by the theory; that is,
if they are ordered around a circle such that realistic is next to investigative and
conventional, investigative next to artistic, and so on. The theory also suggests
that the correlations between adjacent pairs (e.g., RI, IA, AS) are higher than the
correlations between themes one apart (e.g., RA, IS, AE), which in turn are
greater than opposite themes (RS, IE, AC).
This predicted circular model and the predicted relationships among themes
are tested using the randomization test of hypothesized order (Hubert & Arabie,
1987). This test evaluates whether the relationships between themes for each
groups is random or if it fits the predicted pattern. In effect, the RANDALL pro-
gram (Tracey, 1997) tests the predicted order of correlations against a random
order of correlations. The program evaluates the number of predicted matches
that were met (e.g., that the IA correlation is higher than the IS correlation); the
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 431
Table 1
Means and Standard Deviations on General
Occupational Theme by Gender and Racial/Ethnic Group
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
432 JOURNAL OF CAREER ASSESSMENT / November 2004
Table 2
Female Means and Standard Deviations for
Basic Interest Scales for Racial/Ethnic Groups
test also provides a correspondence index (CI). The CI is a summary of the pre-
dicted matches met from which those matches not predicted are subtracted and
the entire sum is divided by 72 (the total possible number of predictions from six
themes). Possible CI scores range from –1 to 1; 0 indicates random pattern of cor-
relations (and poor fit of Holland’s model). Higher scores (e.g., greater than .50)
indicate a greater fit to Holland’s model. Probability value less than .05 was used
in this study to indicate that CI and thus predicted matches were significantly
greater than random.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 433
Table 3
Male Means and Standard Deviations for
Basic Interest Scales for Racial/Ethnic Groups
The number of predicted matches met, CIs, and associated probability levels
for each of the groups on the randomization test are presented in Table 4. Results
indicate that CIs ranged from .57 (p = .02) for Native American men to .94 (p =
.02) for the Asian American women. The mean CI was .77. Thus, as indicated by
Table 4, all CIs are high, with p values equal to or less than .05. These results
indicate that the pattern of relationships among the RIASEC themes for all of the
groups were in the predicted circular order.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
434 JOURNAL OF CAREER ASSESSMENT / November 2004
Table 4
Correspondence Indices, Number of Predicted
Matches, and Probability Levels for Randomized Test
Differences across groups were examined for the GOT using a multivariate
analysis of variance (MANOVA). In these analyses, the six orthogonal GOT
scales served as the dependent variables and gender and race/ethnicity as the
independent variables.
Results of the MANOVA indicated that all main and interaction effects were
significant; however, this may have been due to the very large sample sizes (all
were greater than 300). Thus, as recommended by Thompson (2002) and Vacha-
Haase and Nilsson (1998), we calculated effect sizes, using guidelines discussed
earlier. MANOVA results indicated a large effect size for sex differences among
the GOT themes, F(6, 3,735) = 314.15, p < .001, η2 = .34. A small effect size was
found for differences among ethnic groups, F(6, 37,35) = 20.01, p < .001, η2 =
.03). Effect sizes for interaction effects were all below .01.
The largest contributor to the large effect size for differences between men
and women was the realistic GOT (F = 754.62, p < .001, η2 = .17), with a mean
of 49.81 for men and 41.87 for women. Smaller effect sizes were found for artis-
tic (F = 185.77, p < .001, η2 = .05), with women scoring higher (48.19) than men
(43.67), and social GOT (F = 177.79, p < .001, η2 = .05), with women again scor-
ing higher (51.42) than men (46.64).
Follow-up analyses of the ethnicity main effect indicated that the contributors
to the small effect size were the investigative GOT (F = 25.83, p < .001, η2 = .03)
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 435
and enterprising GOT (F = 26.43, p < .001, η2 = .03). Asian Americans scored
higher (46.3) than the Native American (41.56) group on the investigative GOT,
and African Americans (52.63) scored higher than Native Americans (47.3) on
the enterprising GOT.
Differentiation
The third type of analysis calculated group differences on the construct of dif-
ferentiation, or the difference between an individual’s highest and lowest GOTs.
Differentiation was calculated using the measure recommended by Sackett and
Hansen (1995), which takes into account the entire spread of scores. They used
a standard deviation of all six scores instead of the difference between the two
highest codes suggested by Monahan (1987); Sackett and Hansen’s approach
incorporates the difference across the entire hexagon rather than for just two
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
436 JOURNAL OF CAREER ASSESSMENT / November 2004
Table 5
Means and Standard Deviations for Differentiation
themes. Mean differentiation scores for the 10 groups in this study are presented
in Table 5.
Differentiation differences for gender and race/ethnicity were calculated using
analysis of variance. Results indicated a small effect size for gender (F = 82.82, p <
.001, η2 = .02, men’s X = 7.8, women’s X = 8.68). Ethnic group differences were
negligible.
Consistency
The final analysis conducted was to assess consistency of themes, or how close-
ly related an individual’s high themes are. Consistency was calculated using
Strahan’s (1987) formula, which assigns a weight of 6, 2, 1 to the three codes
(indicating distance between code 1 and 2 is more important than between code
2 and 3) and then a 2 to adjacent codes, a 1 to codes that are one theme apart,
and a 0 to codes that are opposite each other on the hexagon. Thus, a Holland
code of RSA would be C = 6(0) + 2(1) + 1(1), or 3, whereas a code of RIC would
be C = 6(2) + 2(2) + 1(1), or 17. Strahan then recommends a rank transforma-
tion of Y to eliminate gaps in the intervals caused by the weighting, thus the con-
sistency index of C ranges from 1 to 10 and would be 4 for the first example of
RSA and 10 for the second example of RIC. Mean consistency scores for the 10
groups are presented in Table 6. There were no meaningful gender or racial/eth-
nic group differences in consistency; effect sizes were less than .003.
DISCUSSION
The primary goal of this study was to provide additional evidence for the use
of the SII with diverse populations, including examinations of the structure of
and differences in means for the GOTs and BISs as well as assessing differences
in consistency and differentiation across five racial/ethnic groups for career
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 437
Table 6
Means and Standard Deviations for Consistency
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
438 JOURNAL OF CAREER ASSESSMENT / November 2004
REFERENCES
Brewer, C. A., & Suchan, T. A. (2001). Mapping Census 2000: The geography of U.S. diversity.
Washington, DC: Government Printing Office.
Bureau of Labor Statistics. (2002). 2002 occupational employment statistics. Retrieved June 2002
from http: //www.bls.gov
Carson, A. D., & Mowsesian, R. (1993). Moderators of the prediction of job satisfaction from con-
gruence: A test of Holland’s theory. Journal of Career Assessment, 1, 130-144.
Carter, R. T., & Swanson, J. L. (1990). The validity of the Strong Interest Inventory with Black
Americans: A review of the literature. Journal of Vocational Behavior, 36, 195-209.
Cohen, J. (1988). Statistical power analyses for the behavioral sciences (2nd ed.). Hillsdale, NJ:
Lawrence Erlbaum.
Davison Aviles, R. M., & Spokane, A. R. (1999). The vocational interests of Hispanic, African
American, and Caucasian middle school students. Measurement and Evaluation in Counseling
and Development, 32, 138-148.
Day, S. X., & Rounds, J. (1998). Universality of vocational interest structure among racial and eth-
nic minorities. American Psychologist, 53, 728-736.
Day, S. X., Rounds, J., & Swaney, K. (1998). The structure of vocational interests for diverse racial-
ethnic groups. Psychological Science, 9, 40-44.
Fouad, N. A. (2002). Cross-cultural differences in vocational interests: Between-group differences
on the Strong Interest Inventory. Journal of Counseling Psychology, 49, 282-289.
Fouad, N. A., Harmon, L. W., & Borgen, F. H. (1997). Structure of interests in employed male and
female members of U.S. racial-ethnic minority and nonminority groups. Journal of Counseling
Psychology, 44, 339-345.
Fouad, N. A., Harmon, L. W., & Hansen, J. C. (1994). Cross-cultural use of the Strong. In L. W.
Harmon, J. C. Hanson, F. H. Borgen, & A. C. Hammer (Eds.), Strong Interest Inventory:
Applications and technical guide (pp. 255-280), Palo Alto, CA: Consulting Psychologists Press.
Harmon, L. W., Hansen, J. C., Borgen, F. H., & Hammer, A. L. (Eds.). (1994). Strong Interest
Inventory: Applications and technical guide. Palo Alto, CA: Consulting Psychologists Press.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015
Fouad, Mohler / CULTURE VALIDITY OF HOLLAND’S THEORY 439
Holland, J. L. (1997). Making vocational choices: A theory of vocational personalities and work envi-
ronments (3rd ed.). Odessa, FL: Psychological Assessment Resources.
Hubert, L., & Arabie, P. (1987). Evaluating order hypotheses within proximity matrices.
Psychological Bulletin, 102, 172-178.
Lattimore, R. R., & Borgen, F. H. (1999). Validity of the 1994 Strong Interest Inventory with racial
and ethnic minority groups in the United States. Journal of Counseling Psychology, 46, 185-195.
Leong, F. T. L., Austin, J. T., Sekaran, U., & Komarraju, M. (1998). An evaluation of the cross-
cultural validity of Holland’s theory: Career choices by workers in India. Journal of Vocational
Behavior, 52, 441-455.
Leung, S. A., Ivey, D., & Suzuki, L. (1994). Factors affecting the career aspirations of Asian
Americans. Journal of Counseling and Development, 72, 404-410.
Monahan, C. J. (1987). Construct validation of a modified differentiation index. Journal of
Vocational Behavior, 30, 217-226.
National Research Council. (1999). Changing nature of work: Implications for occupational analy-
sis. Washington, DC: National Academy of Science.
Park, S. E., & Harrison, A. A. (1995). Career-related interests and values, perceived control, and
acculturation of Asian-American and Caucasian-American college students. Journal of Applied
Social Psychology, 25, 1184-1203.
Rosnow, R. L., & Rosenthal, R. (1996). Computing contrasts, effect sizes, and counternulls on
other people’s published data: General procedures for research consumers. Psychological
Methods, 1, 331-340.
Sackett, S. A., & Hansen, J. C. (1995). Vocational outcomes of college freshman with flat profiles
on the Strong Interest Inventory. Measurement and Evaluation in Counseling and Development,
28, 9-24.
Strahan, R. F. (1987). Measures of consistency for Holland-type codes. Journal of Vocational
Behavior, 31, 37-44.
Sue, D. W., & Kirk, B. A. (1972). Differential characteristics of Japanese-American and Chinese-
American college students. Journal of Counseling Psychology, 20, 142-148.
Sue, D. W., & Kirk, B. A. (1973). Psychological characteristics of Chinese-American students.
Journal of Counseling Psychology, 9, 471-478.
Swanson, J. L., & Gore, P. A., Jr. (2000). Advances in vocational psychology theory and research.
In S. D. Brown & R. W. Lent (Eds.), Handbook of counseling psychology (3rd ed., pp. 233-269).
New York: John Wiley.
Thompson, B. (2002). “Statistical,” “practical,” and “clinical”: How many kinds of significance do
counselors need to consider? Journal of Counseling & Development, 80, 64-71.
Tracey, T. G. (1997). RANDALL: A Microsoft Fortran program for a randomization test of hypoth-
esized order relations. Educational and Psychological Measurement, 57, 164-168.
Vacha-Haase, T., & Nilsson, J. E. (1998). Statistical significance reporting: Current trends and uses
in MECD. Measurement and Evaluation in Counseling and Development, 31, 46-57.
Walsh, W. B., & Betz, N. E. (2001). Tests and assessment (4th ed.). Englewood Cliffs, NJ: Prentice
Hall.
Downloaded from jca.sagepub.com at UCSF LIBRARY & CKM on April 25, 2015