The Evolution of The Performance Appraisal Process
The Evolution of The Performance Appraisal Process
The Evolution of The Performance Appraisal Process
Early history
Although not called performance appraisal, the Bible has many examples
where the evaluation of individual performance is an important issue. “The
Lord has filled him (Bezalel) with the Spirit of God, in wisdom and
understanding, in knowledge and all manner of workmanship to design artistic
works, to work in gold and silver and bronze, in carving wood, and to work in
all manner of artistic workmanship” (Exodus, 35, pp. 31-3). In this instance,
Moses selected the man who was known to be the most skilled craftsman from
the tribes of Israel to build and furnish the tabernacle of the Lord in
approximately 1350 BC. Merit exams were given for selection and promotion
decisions as early as the Han Dynasty, 206 BC-220 AD (Wren, 1994).
Furthermore, in the early third century AD, “Imperial Raters” were employed
by emperors of the Wei dynasty to rate the performance of the official family
members. Commentary on the appraisals of the “Imperial Raters” mirrors the
sentiments of today’s critics, stating that “The Imperial Rater of Nine Grades
seldom rates men according to their merits but always according to his likes
and dislikes” (Patten, 1977). In 1648, it is reported that the Dublin (Ireland)
Evening Post evaluated legislators by using a rating scale based upon personal The evolution of
qualities (Hackett, 1928). the performance
Most likely, the early 1800s marked the beginning of performance appraisals appraisal
in industry with Robert Owen’s use of “silent monitors” in the cotton mills of
Scotland (Wren, 1994). Silent monitors were blocks of wood with different colors process
painted on each visible side and placed above each employee’s work station. At
the end of the day, the block was turned so that a particular color, representing 235
a grade (rating) of the employee’s performance, was facing the aisle for
everyone to see. Anecdotal evidence indicates that this practice had a
facilitating influence on subsequent behavior.
Tools
The first tools used were global ratings and global essays (DeVries et al., 1981).
In global ratings, the rater provides an overall estimate of performance without
distinctions among any performance dimensions. Typical ratings include
“outstanding”, “satisfactory” and “needs improvement”. For global essays, a
rater responds narratively to a question such as “What is your overall
evaluation of this person over the last year?” The subjectivity of both methods
and the variability of the essay method made it difficult to use these tools to
make quality decisions. In addition, unless the essay is done correctly with a
great deal of detail, it is not particularly useful for developmental feedback. The
lack of reference to job-related behaviors would make these tools almost
certainly subject to legal action in today’s business environment.
The next tool widely used was the man-to-man ranking procedure,
developed for the US Army in 1914 (Scott and Clothier, 1923). The Army used
five scales to rank its officers: physical qualities; intelligence; leadership;
personal qualities; and the general value to the service. The rater chose 12 to 25
officers of the same rank as the officer being rated. The rater then ranks these
officers from highest to lowest based on one of the five scales and selects five
officers to use as the standard for judgment ((1) highest, (2) middle, (3) lowest, (4)
between highest and middle and (5) between middle and lowest). Values are
assigned to each of the five “standardized” officers and the ratee is assigned a
value by comparing him with these officers. Each rater makes his/her own
scale, resulting in a complex system which fails to account for individual
differences in scale construction.
Evolving from the man-to-man system was the judgmental rank order
procedure (DeVries et al., 1981). Raters provide an overall evaluation of
performance by checking a box which places each ratee in a certain percentage
of all ratees (top 25 per cent, top 50 per cent, bottom 50 per cent, bottom 25 per
cent). A rater may also list each employee’s name in order of effectiveness on
individual dimensions or distribute his/her employees along a scale on the basis
of total performance. While ranking employees does force distinction between The evolution of
ratees, these methods are qualitative, making it difficult to judge how much the performance
better the performance of one employee is over another and nearly impossible appraisal
to compare ratings across divisions. Also, while the top performers and bottom
performers will remain at the extremes, the employees in the middle may not process
have truly differentiable performance. Therefore, its utility in administrative
decisions is questionable. It is also not very effective for feedback and is subject 237
to legal issues due to the use of overall job performance ratings without
reference to job related dimensions.
The final tool to gain popularity during this time was the graphic- or trait-
rating scales. Benjamin (1952) reported that 87 per cent of a sample of 130
companies used these types of rating scales and they continue to be one of the
most common rating tools in use today. With this tool, the rater indicates on a
numerical scale the degree to which the ratee possesses certain personality
traits. The performance dimensions are usually ill-defined (and difficult to
measure) traits such as leadership, initiative, cooperation, judgment, creativity,
resourcefulness, innovativeness, and dependability. Because of the global, non
job specific nature of these traits, graphic-rating scales have not withstood legal
scrutiny (Bernardin and Beatty, 1984) and are not very useful in providing
performance feedback. Additionally, these vague performance dimensions call
on the rater to link observed behavior with the appropriate personality trait,
making rater error prevalent (Bernardin and Buckley, 1981). However, the
positive aspects of using the trait-rating scales are that they are inexpensive
and relatively easy to develop and administer, the results are quantifiable, the
rater examines more than one performance dimension, and because they are
standardized, the results are comparable across individuals and across
divisions (Cascio, 1991).
Prior to World War II, performance appraisal systems tended to exclude top
management, generally used graphic-rating scales and had just one or two
forms for all employees regardless of the job performed or skills necessary
(Spriegel, 1962). These systems appraised individuals on the basis of previously
established performance dimensions, using a standard, numerical scoring
system. They focused on past actions instead of future goals and were always
conducted by the supervisor with little input from the employee. These
shortcomings caused the military and industry to search for more accurate and
useful performance appraisal systems (DeVries et al., 1981).
Goals
It has been suggested that the purpose of a performance appraisal system
should be employee development and feedback (see Fedor, 1991). It has been
shown that individuals are motivated to seek feedback (if it is seen as a valuable
resource) to reduce uncertainty and to provide information relevant to self
evaluations (Ashford, 1986). There is also evidence that performance feedback
(if given appropriately) can lead to substantial improvements in future
performance (Guzzo et al., 1985; Kopelman, 1986; Landy et al., 1982). Feedback
can be a useful tool for development, especially if it is specific and behaviorally-
oriented, as well as both problem-oriented and solution-oriented (Murphy and
Cleveland, 1995). Therefore, many believe that performance appraisal systems
should provide meaningful feedback, rather than exclusively be used to make
judgments about the employee. Although, when the same performance
appraisal system is used for administrative decision making (e.g. raises,
promotions) and for feedback, both functions may suffer (Cleveland et al., 1989;
Meyer et al., 1965).
Journal of Tools
Management As a result of his study of managerial practices in General Motors, Peter
History Drucker first proposed Management by Objectives in The Practice of
Management in 1954. Douglas McGregor then applied this practice to
4,3 performance appraisals in 1957 in his article “An uneasy look at performance
appraisal”. McGregor recommended that employees be appraised on the basis
240 of short-term goals, rather than traits, which are jointly set by the employee and
the manager. The first step in the process is for the employee to arrive at a clear
statement of responsibilities of his/her position as they actually are in practice.
This statement is reviewed by the manager, and modified until both employee
and supervisor agree that the list is adequate. The employee then assesses
his/her strengths and weaknesses and, working from the statement of
responsibilities, establishes his/her goals for the projected evaluation period.
These goals are specific, measurable, time bounded and joined to an action plan
(McConkie, 1979). The employee and the manager meet to discuss and modify
the goals until both believe they are satisfactory. The final step occurs at the end
of the evaluation period or whenever there is a major change in the work
situation. Subordinates make appraisals of performance based on the
accomplishment of goals set forth at the beginning of the appraisal period. The
supervisor and employee have an appraisal interview in which they examine
the subordinate self-appraisal and set new goals for the next appraisal period
(Patten, 1977; DeVries et al., 1981). The typical cycle includes setting of
objectives, negotiation, implementation, discussion, changing directions, and
eventual measuring of accomplishment or failure (Kindall and Gatza, 1963).
McGregor believed that the management by objectives approach to
performance appraisal had many advantages. First, it redefined the role of
manager from judge to helper, permitting guidance needed for personal
development. Second, the technique focuses on what the employee produces as
a result of performance, increasing employee acceptance relative to
performance appraisal systems based on traits. Third, it shifts the orientation
toward future actions instead of past behaviors (DeVries et al., 1981; Patten,
1977). Management by objectives was an accepted practice in private industry
in the 1970s and was used primarily for managers (Hay Associates, 1976).
Although management by objectives has many positive features, its
limitations need to be understood. The primary issue that needs to be addressed
by the organization is the high level of management commitment and time
required to reorient the thinking of employees (Patten, 1977). Communication of
this commitment needs to be clear in order to prevent the complexity of the
system from turning initial excitement into confusion and disillusionment,
culminating in eventual disinterest and failure. Additionally, the purpose for
the new system needs to be clearly recognized, because while management by
objectives is a useful tool for performance planning and feedback, it is not
easily used for administrative decisions (DeVries et al., 1981).
A high degree of job analysis and inferential skills are needed to determine
which performance dimensions to measure and the goal achievement standards
to use. Initially, the goals and objectives which are set tend to be easily The evolution of
quantified, easily achieved and not necessarily central to the job (Murphy and the performance
Cleveland, 1995). Levinson (1970) discovered a tendency for objective-setting appraisal
measures such as sales dollars or number of units produced result in a
disregard for less quantifiable aspects of job performance such as customer process
service and quality work. Thus, if objectives are activity focused instead of
output centered (means rather than ends), this method is ineffective. There is 241
also a tendency for managers to ignore factors which are outside the employee’s
control, but which often affect goal accomplishment, leaving the employee
responsible for goal completion regardless of external influences (Goodale,
1977). In addition to external factors, managerial jobs are often measured in
terms of unit, rather than individual, objectives, which requires that individual’s
be held accountable for outcomes requiring interdependent employee efforts
(Levinson, 1970; Schneier and Beatty, 1978). These are only a few of the common
errors associated with MBO (Kleber, 1972), but they help to illustrate the
complexity of this performance appraisal method.
Tools
The first tool to focus on behaviors was the Behaviorally Anchored Rating
Scales (BARS), designed by Smith and Kendall (1963). BARS development is a
long and arduous process, involving many steps and many people. From this
process, performance dimensions are more clearly defined and are based on
more observable behaviors. For example, a very high rating for a teacher in the
lecture performance dimension might be “lecturer uses concrete examples to
clarify answers”, a higher than average rating might be “lecturer’s response
repeats a point in the lecture” and a very low rating might be “lecturer insults
or verbally attacks questioner” (Murphy and Constans, 1987). Despite the time
and expense of developing a BARS tool, research has not shown that this
Journal of method is more accurate than graphic-rating scales (Schwab et al., 1975). Thus,
Management the goal of having sound psychometric properties was not achieved.
History Another tool which used behavioral examples was the Mixed Standard
Scales (MSS), designed by Blanz and Ghiselli (1972). Each scale is designed to
4,3 measure two performance dimensions, instead of one (as in BARS). For
example, in a six-item grouping for a lecturer/teacher, items 1, 4 and 5 might
242 refer to behaviors that represent a “response to questions” performance
dimension and items 2, 3 and 6 might refer to behaviors that represent a
“speaking style” performance dimension (Murphy and Constans, 1987). For
each performance dimension, there is one item describing good performance,
one describing average performance and one describing poor performance. For
each item, the rater is asked to respond whether the employee’s performance is
better than, about equal to or worse than the behavior described in each item.
While the rater’s task of filling out the form is more simple than with other
methods, the scoring system is so complex that the results may not be
understood, just as in the forced-choice method (Murphy and Cleveland, 1995).
Although BARS were found to result in more accurate rating of performance
than MSS (Benson et al., 1988), neither method alone fulfilled the needs of
performance raters – accuracy, ease of use, employee needs for information and
development.
Behavior observation scales were intended to improve on BARS (Latham and
Wexley, 1977). This scale uses the same class of items as the MSS, but asks the
rater to describe how frequently specific employee behaviors or critical
incidents occurred over the appraisal period (Murphy and Cleveland, 1995).
While it was designed to remove subjectivity, research suggests that this
method is as subjective, if not more subjective than trait-ratings or overall
evaluations (Murphy et al., 1982; Murphy and Constans, 1988). Other tools
which attempted to reduce rater error are the distributional measurement
model (Kane and Lawler, 1979) and the performance distribution assessment.
Thus, this era, which focused its efforts on reducing rater error, produced a
great deal of literature and a number of tools, but progress in improving
performance appraisals has been lacking. In fact, the beginning of the shift
away from rater error reduction research was a classic article by Bernardin and
Pence (1980) which demonstrated that decreases in rater error were
accompanied by decreases in the accuracy with which performance was
evaluated.
Legal issues
Shift in ideas
Passage of the Civil Rights Act of 1964 and the 1966 and 1970 Equal
Employment Opportunity Commission Guidelines for Regulation of Selection
procedures created a need for improvement in organizational appraisal
practices. These legal considerations exerted strong pressure on organizations
to formalize, validate, and organize appraisal systems (Murphy and Cleveland,
1995). The typical practices of the past such as use of personality traits in
appraisals, loose relationships between performance appraisal ratings and The evolution of
human resources outcomes, and a dearth of specific job-related behavior in the performance
evaluations were becoming targets of increasing amounts of federal regulation appraisal
and litigation.
In 1978, Uniform Guidelines on employee selection procedures were adopted process
by four major federal enforcement agencies. These guidelines stated that
employers cannot discriminate against any protected group by using a selection 243
device (including performance appraisals) for any personnel decisions/
practices that result in selection, training, transfer, retention or promotion of
employees (DeVries et al., 1981). It was not necessary to establish an intention to
discriminate to prove discrimination. The presence (or absence) of a
disproportionate number from a protected group is defined as prima facie
evidence of adverse impact. The Uniform Guidelines require any test or
selection device which shows adverse impact or discriminates against any
group protected by Title VII of the 1964 Civil Rights Act be validated or
demonstrated to be related to job performance.
Experts offered guidance in order to protect organizations from legal
considerations and the structure of performance appraisals changed (Bernardin
and Beatty, 1984) – performance appraisals should be based on specific
dimensions, defined in terms of behaviors, which have been established as
relevant through job analysis. Raters should receive training or instruction,
have adequate opportunities to observe the performance they are evaluating
and appraise their employees frequently. Feedback should be given to the ratee
and an appeals process should be in place. If possible, multiple raters should be
used to avoid rater bias and extreme ratings should be supported by
documentation. If organizations follow these guidelines for their performance
appraisal system, the likelihood of a successful discrimination case is reduced.
Conclusion
After decades of research, where is the performance appraisal process today?
Have the tools and the processes advanced to the point of accurately and
effectively measuring the performance of employees? The answer is “probably
not”. Frankly, not much has changed since the classic work of Barrett (1966/67).
His book was one of the first to provide much of the advice given to users of
performance appraisal today. Those with a serious interest in performance
appraisal need to read this book. It is as applicable today as it was when first
published. Subsequent researchers have delved into the minutia of performance
appraisal process with negligible substantive contributions.
Researchers have focused on reducing the errors in the tools, but have not
been particularly concerned with what the tools are actually measuring – what
we are observing and how well we are observing it. Academicians have delved
into the mind of the rater and tried to determine the processes used to evaluate
employees. They attempt to train the rater to improve observational skills. They
tell the rater to keep a performance diary. While these ideas are theoretically
sound, practically, the amount of time for this exercise is too demanding.
Additionally, researchers studying the rating process appear to have
neglected the political aspect of performance appraisal. Often, the goal of the
rater is not to evaluate the performance of the employee, but to keep the
employee satisfied and not to deleteriously influence employee morale. The
manager also has to be concerned about his/her own image. If a number of
employees receive negative ratings, that reflects poorly on the manager. Thus,
the goals of the manager may be different from those that the organization is
trying to achieve through the performance appraisal process. Therefore,
research on performance appraisals needs to turn to learning more about the
conditions that encourage raters to use the performance appraisal system as it
was intended to be used.
Even though the process is unsatisfactory for most people in industry,
performance appraisals serve a number of valuable organizational purposes.
Because our culture believes that people should be rewarded for outstanding
performance, yet does not like to receive negative feedback, performance
appraisal systems are very complicated. Organizations need to understand the
strengths and weaknesses associated with each of the tools and determine
which goals they want to accomplish. They need to realize that a single tool The evolution of
cannot be used over a diverse series of jobs. Once performance appraisals are the performance
seen as a tool for managing resources, the research focus should shift to appraisal
matching the appropriate tools with the desired outcomes. Until then,
businesses will continue to use the performance appraisal systems in use today, process
and hopefully through Divine Providence, the best people will generally rise to
the top. 247
References
Ashford, S.J. (1986), “Feedback-seeking in individual adaptation: a resource perspective”,
Academy of Management Journal, Vol. 29, pp. 465-87.
Barrett, R.S. (1967), Performance Rating, Science Research Associates, Inc., Chicago, IL.
Bellows, R.M. and Estep, M.F. (1954), Employment Psychology: The Interview, Rinehart, New
York, NY.
Benjamin, R., Jr (1952), “A survey of 130 merit-rating plans”, Personnel, Vol. 29, pp. 289-94.
Benson, P.G., Buckley, M.R. and Hall, S. (1988), “The impact of rating scale format on rater accuracy:
an evaluation of the mixed standard scale”, Journal of Management, Vol 14, pp. 415-23.
Berkshire, J.R. and Highland, R.W. (1953), “Forced choice performance rating – a methodology
study”, Personnel Psychology, Vol. 6, pp. 355-78.
Bernardin, H.J. and Buckley, M.R. (1981), “Strategies in rater training”, Academy of Management
Review, Vol. 6, pp. 205-13.
Bernardin, H.J. and Beatty, R.W. (1984), Performance Appraisal: Assessing Human Behavior At
Work, Kent, Boston, MS.
Bernardin, H.J. and Pence, E.C. (1980), “Rater training: creating new response sets and decreasing
accuracy”, Journal of Applied Psychology, Vol. 65, pp. 60-6.
Blanz, F. and Ghiselli, E.E. (1972), “The mixed standard scale: a new rating system”, Personnel
Psychology, Vol. 25, pp. 185-99.
Cascio, W.F. (1991), Applied Psychology In Personnel Management, Prentice-Hall, Englewood
Cliffs, NJ.
Cleveland, J.N., Murphy, K.R. and Williams, R.E. (1989), “Multiple uses of performance appraisal:
prevelance and correlates”, Journal of Applied Psychology, Vol. 74, pp. 130-5.
DeVries, D.L., Morrison, A.M., Shullman, S.L. and Gerlach, M.L. (1981), Performance Appraisal On
The Line, Center for Creative Leadership, Greensboro, NC.
Drucker, P.F. (1954), The Practice of Management, Harper, NewYork, NY.
Fedor, D.B. (1991), “Recipient respounses to performance feedback: a proposed model and its
implications”, Research in Personnel and Human Resources Management, Vol. 9 (annually),
pp. 73-120.
Flanagan, J.C. (1954), “The critical incidents technique”, Psychological Bulletin, Vol. 51, pp. 327-58.
Goodale, J.G. (1977), “Behaviorally-based rating scales: toward an integrated approach to
performance appraisal”, in Hammer, W.C. and Schmidt, F.L. (Eds), Contemporary Problems in
Personnel (rev. ed.), St Clair, Chicago, IL.
Graves, W.B. (1948), “Efficiency rating systems: their history, organization and functioning”,
Hearings, Efficiency Rating System for Federal Employees, 80th Congress, 2nd Session,
Government Printing Office, Washington, D.C.
Guzzo, R.A., Jette, R.D. and Katzell, R.A. (1985), “The effects of psychologically-based intervention
programs on worker productivity”, Personnel Psychology, Vol. 38, pp. 275-93.
Hackett, J.D. (1928), “Rating legislators”, Personnel, Vol. 7 No. 2, pp. 130-1.
Hay Associates (1976), “Accent on appraisal”, Management Memo, No. 293.
Journal of Ilgen, D.R., Barnes-Farrell, J.L. and McKellin, D.B. (1993), “Performance appraisal process
research in the 1980s: what has it contributed to appraisals in use?”, Organizational Behavior
Management and Human Decision Processes, Vol. 54, pp. 321-68.
History Kane, J.S. and Lawler, E.E. (1979), “Performance appraisal effectiveness: its assessment and
4,3 determinants”, in Staw, B. (Ed.), Research in Organizational Behavior, Vol. 1, JAI Press,
Greenwich, CT.
Kindall, A.F. and Gatza, J. (1963), “Positive program for performance appraisal”, Harvard
248 Business Review, Vol. 41 No. 6, pp. 153-62.
Kleber, T.P. (1972), “Forty common goal-setting errors”, Human Resource Management, Vol. 11
No. 3, pp. 10-13.
Kopelman, R.E. (1986), “Objective feedback”, in Locke, E.A. (Ed.), Generalizing From Laboratory
To Field Settings, Lexington Books, Lexington, MA.
Landy, F.J. and Farr, J.L. (1980), “Performance rating”, Psychological Bulletin, Vol. 87, pp. 72-107.
Landy, F.J. and Farr, J.L. (1983), The Measurement of Work Performance: Methods, Theory, and
Applications, Academic Press, New York, NY.
Landy, F.J., Farr, J.L. and Jacobs, R.R. (1982), “Utility concepts in performance measurement”,
Organizational Behavior and Human Performance, Vol. 30, pp. 15-40.
Latham, G.P. and Wexley, K.N. (1977), “Behavioral observation scales”, Personnel Psychology, Vol.
30, pp. 255-68.
Levinson, H. (1970), “Management by whose objectives”, Harvard Business Review, Vol. 48 No. 4,
pp. 125-34.
Likert, R.L. (1961), New Patterns of Management, McGraw-Hill, New York, NY.
Lopez, F.M. (1968), Evaluating Employee Performance, Public Personnel Association, Chicago, IL.
McConkie, M.L. (1979), “A clarification of the goal setting and appraisal processes in MBO”,
Academy of Management Review, Vol. 4, pp. 29-40.
McGregor, D. (1957), “An uneasy look at performance appraisal”, Harvard Business Review, Vol.
35 No. 3, pp. 89-94.
Meyer, H.H., Kay, E. and French, J. (1965), “Split roles in performance appraisal”, Harvard
Business Review, Vol. 43, pp. 123-9.
Murphy, K.R. and Cleveland, J.N. (1995), Understanding Performance Appraisal: Social,
Organizational and Goal-Based Perspectives, Sage, Thousand Oaks, CA.
Murphy, K.R. and Constans, J.I. (1987), “Behavioral anchors as a source of bias in rating”, Journal
of Applied Psychology, Vol. 72, pp. 523-79.
Murphy, K.R. and Constans, J.I. (1988), “Psychological issues in scale format research: Behavioral
anchors as a source of bias in rating”, in Cardy, R., Peiffer, S. and Newman, J. (Eds), Advances
in Information Processing in Organizations, Vol. 3, JAI Press, Greenwich, CT.
Murphy, K.R., Martin, C. and Garcia, M. (1982), “Do behavioral observation scales measure
observation?”, Journal of Applied Psychology, Vol. 67, pp. 562-7.
Patten, T.H., Jr (1977), Pay: Employee Compensation and Incentive Plans, Free Press, London.
Petrie, F.A. (1950), “Is there something new in efficiency rating?”, Personnel Administrator, Vol.
13, pp. 24.
Richardson, M.W. (1949), “Forced-choice performance reports: a modern merit-rating method”,
Personnel, Vol. 26, pp. 205-12.
Schneier, C.E. and Beatty, R.W. (1978), “The influence of role prescriptions on the performance
appraisal processes”, Academy of Management Journal, Vol. 21, pp. 129-34.
Schwab, D.P., Heneman, H.G., III and DeCotiis, T.A. (1975), “Behaviorally anchored rating scales:
a review of the literature”, Personnel Psychology, Vol. 28, pp. 549-62.
Scott, W.D. and Clothier, R.C. (1923), Personnel Management: Principles, Practices, and Points of
View, A.W. Shaw, New York, NY.
Scott, W.D., Clothier, R.C. and Spriegel, W.R. (1941), Personnel Management, McGraw-Hill, New The evolution of
York, NY.
Sisson, E.D. (1948), “Forced-choice: the new army rating”, Personnel Psychology, Vol. 1, pp. 365-81.
the performance
Smith, P.C. and Kendall, L.M. (1963), “Retranslation of expectations: an approach to the appraisal
construction of unambiguous anchors for rating scales”, Journal of Applied Psychology, Vol. process
47, pp. 149-55.
Spriegel, W.R. (1962), “Company practices in appraisal of managerial performance”, Personnel,
Vol. 39, pp. 77. 249
Van Riper, P. (1958), History of the United States Civil Service, Row, Peterson and Co., Evanston, IL.
Whisler, T.L. and Harper, S.F. (Eds), (1962), Performance Appraisal: Research And Practice, Holt,
Rinehart & Winston, New York, NY.
White, L.D. (1954), The Jacksonians, The Macmillan Co., New York, NY.
Wren, D.A. (1994), The Evolution of Management Thought, John Wiley & Sons, Inc., New York,
NY.