Do Higher Education Institutions Make A Difference in Competence Development? A Model of Competence Production at University
Do Higher Education Institutions Make A Difference in Competence Development? A Model of Competence Production at University
Do Higher Education Institutions Make A Difference in Competence Development? A Model of Competence Production at University
DOI 10.1007/s10734-014-9725-1
Introduction
In the second half of the twentieth century, due mainly to computerization and changes in
the work organization, advanced countries started to move from economies that demanded
for labor factor toward economies that demanded for competencies: physical strength has
being replaced by mind strength. The competitiveness and performance of national
123
504
123
505
123
506
ability to make leading-edge innovations. It is widely agreed that the productivity growth
of the industrialized economies is mainly an ongoing intellectual achievement, a sustained
flow of new ideas (Lucas 2009).
Countries that have high skills in their workforces and high tech are up the top of the
OECD productivity league tables. The complementarity between skills and technology
adoption is particularly strong, and is manifested through three channels. First, skilled
workers are more adept at dealing with changing technologies. Second, the availability of
more skilled workers creates incentives for firms to adopt and develop new technologies
that are more skill intensive (Acemoglu 1998). Third, skilled workers, engineers and
scientists are required to produce adaptations of existing technologies and even more to
create new ones.
In this way, teaching and research activities of universities are responsible for skill
enhancement of the population and the development and transfer of technology. Therefore,
governments should encourage peoples participation in higher education. In fact, participation in tertiary education increased in almost all OECD countries in the late 1990s
(OECD 2005).2 The increases in enrolment were mainly attributable to higher participation
rates rather than an increase in population at the relevant ages. Yet, the investment gap in
higher education between Europe and the United States is considerable. In 2005, the
proportion of the total population with higher education amounted to 39 % in the US
compared to only 24 % in the EU, although the gap is narrower for the younger population.
This educational attainment gap is mirrored by a gap in expenditure, with the US devoting
3.3 % of its GDP to higher education versus only 1.3 % in the EU. In any case, the key
question here is not how many years of education an individual has, but the relevant
question is what this individual can do with the years of education he/she has. In other
words, it is not simply going to school but only actual learning that counts for economic
growth. For example, Hanushek and Kimkos paper (2000) concentrates on the importance
of labor force qualitymeasured by cognitive skills in mathematics and scienceon
economic growth. By linking international test scores across countries, a direct measure of
quality is developed, and this proves to have a strong and robust influence on growth.
Obviously, if there are inefficiencies in the market for skill formation, and it is quite
likely that there are, there is a potential case for some government intervention. If higher
education and training activities do render educated/trained individuals more productive,
and if improvements in productivity for some workers/activities spill over to others
(positive externalities), then the government should subsidize both higher education and
training. There may be spillovers both within and between firms so that gains to the
economy as a whole exceed those accruing to the educated/trained individuals. For
example, the employment-relevant skills which firms require from graduates may be
general, which are transferable (with the employee) from firm to firm. For general skills it
is likely to be more efficient to provide these at the supra-firm level since the public good
element to this type of knowledge will cause individual firms to under-invest in it. HE is
therefore an obvious location for this type of training. The problem is how economists
forecast skill needs, how the economy responds to a lack of skills and the economic
consequences of not anticipating skills needs. More importantly, given that we do not fully
understand the nature of the externalities, it is difficult to know how the optimal policy
should look like.
2
However, the expansion of higher education in the 1990s created a situation in which increasing numbers
of graduates were unable to access employment that required and valued graduate skills and knowledge
(Elias and Purcell 2004).
123
507
o c oc
;
[ 0
o x oz
However, in practice, some problems arise when describing the production of human
capital. The most important difficulty is to find a proper quantitative measure of the output.
Several approaches have been used in applied works (Felstead et al. 2007): educational
attainment, occupational classification, skill tests, self-assessment, and job requirements.
Alternatively, some studies have used earnings as a proxy variable, assuming that workers
are paid the value of their marginal product (Davis and Haltiwanger 1991; Dunne et al.
2004). Yet, what constitutes a suitable measure of output is still quite controversial.
At the university level, because grades are measurable and may correlate positively with
learning, some papers have used students grades as a proxy for learning outcomes. The
grade production function specification implicitly assumes that the students choose the
optimal amounts of effort inputs (class attendance and homework completion), given their
ability and educational goals (Douglas and Sulock 1995). In the database generated by the
Reflex project, average university marks are available. Nevertheless, we consider that
grades are not a good proxy for the output of the educational production process since
grading policies vary from one university to anotherand from one degree to another, and
from one instructor to another. Alternatively, although we have information on wages
earned by young university graduates, we feel that they are not proxying correctly the
output because salaries also entail an important firm component that reflects things such as
the firms compensation policies, rent sharing and workers bargaining power within the
firm. We have also an important percentage of graduates working for the public sector
where salaries are not necessary a reflection of their productivity. Personnel classifications
and wage structure in the Public Administration are mainly predetermined in Spain by the
123
508
administrative legislation of public function. Instead, the approach used to assess competence acquisition process among university graduates will be based on the answers to the
question How do you rate your own level of competence? (See Fig. 1 in To what extent
do graduates own competencies meet their job requirements? Evidence from Spain
section).3
Although graduates responses to the question about the acquired level of competence
provide a self-assessment of the level of competencies built up during higher education, the
acquisition of different abilities can be done also out of the campus. Life cycle skill
formation is a dynamic process in which early inputs strongly affect the productivity
(Heckman 2006). Family environments play a key role in shaping cognitive and noncognitive skills at different stages of the life cycle of the child. Production of individual
human capital can also be associated to experiences in the neighborhood, in responsibilities
held in student organizations or other clubs (Scouts, music bands,), internships, summer
jobs, etc. Additionally, it should be taken into account the fact that graduates in the Reflex
survey had to assess their level of competencies at the moment of the interview (around
5 years after graduation), so their professional paths since they left the higher education
system and more recently, their current work, enables them to acquire or develop these
competencies. In short, due to the information on the acquired level of competence is
obtained from the source closest to the actual job situation, the analysis should look after
the fact that personal skills can be acquired, developed and improved in the workplace
trough learning by doing and formal training programs.
Asking them to assess their own level of competence in the 19 domains included in the master questionnaire there is the possibility that graduates are doing an overestimation of their competencies. However,
controlling for the possible effects of self-overestimation is not possible in this survey, although there are
studies that show that among university graduates there is more honesty in responding and the effect of
possible bias is minimal or nonexistent (Schmidt and van der Molen 2001).
Questions on competencies in REFLEX were: A. How do you rate your own level of competence?; B.
What is the required level of competence in your current work? Answers to A?Individuals human
capital; Answers to B?Human capital needed for job; Difference A-B: deficit (-) or surplus (?) of
competencies.
123
509
performing well under pressure); (2) mobilizing others (working productively with others,
coordinating activities, making meaning clear to others); and (3) having good specialist
knowledge (mastery of own field, ability to rapidly acquire new knowledge). Overall,
graduates considered their levels of competence matched their current job requirements
rather well. With the exception of Ability to make your meaning clear to others, where
Spanish graduates show a lightly deficit, for the rest of competencies there is a match, or
even surplus, of competencies (e.g. Willingness to question your own and others ideas or
Ability to rapidly acquire new knowledge).
Looking at the results obtained, it is noticeable that interpersonal competencies (such as
making meaning clear to others or ability to work productively with others) appear to be
more important at work than cognitive competencies (such as ability to write and speak in
a foreign language or knowledge of other fields or disciplines). At the same time that noncognitive skills are more demanded in job positions than cognitive skills, the results
indicate that the most required competencies in the graduate labor market are mainly
transferable skills, in other words, skills learned in one context that are useful in another.
However, surprisingly, some competencies that are believed to influence labor market
activities, such as negotiation ability or languages, are not seen as important in the Spanish
graduate labor market.
123
510
6
5
Alertness to new
opportunities
2
1
Fig. 1 Competencies required in the current job and competencies possessed: self-assessment of Spanish
graduates. 1 (very low) to 7 (very high) The figure depicts in a descending order the mean values of the
ratings given to the question about the required level of competence Source Authors calculations
The discussion here is, of necessity, rather brief and interested readers are urged to consult McKelvey and
Zavoina (1975) where the model and estimation procedure are described in detail.
123
511
The model is built around a latent regression. We begin with (Greene 1997):
y x0 b z 0 a e
as usual, y* is unobserved. What we do observe is:
y 0 if
1
if
2
if
..
.
y 0;
0\y l1 ;
l1 \y l2 ;
lJ1 y;
if
which is a form of censoring. The ls are unknown parameters to be estimated with b and a.
The model cannot be consistently estimated using ordinary least squares; it is usually
estimated using maximum likelihood. The beta coefficients quantify the impact of the
modes of teaching and learning, and assessment in the acquisition of competencies. All
other things being equal or held constant, positive coefficients mean that a higher value of
the associated variable implies a greater probability of possessing a competence.6
Our explanatory variables of interest, the contribution of the universities to the competence development/enhancement, are proxied by the following modes of teaching and
learning, and assessment:
Assignment-based assessment (e.g. written essays or reports; work with other students;
or oral presentations).
Tutorials (e.g. small group teaching, research seminars, or problem-solving sessions).
Teacher-focused teaching.
Examinations (e.g. multiple choice questions; or analyses of cases/texts).
Lectures.
These five methods come from the application of a principal component analysis (PCA)
to the answers given by graduates to the original question in the questionnaire: To what
extent were the following modes of teaching and learning emphasized in your study programme? (1 = not at all; 5 = to a very high extent). The options were:
Lectures.
Group assignments.
Participation in research projects.
Facts and practical knowledge.
Theories and paradigms.
Teacher as the main source of information.
Project and/or problem-based learning.
Written assignments.
Oral presentations by students.
Multiple choice exams.
The variable y* is a continuous latent variable which cannot be observed. In reality, what we have is a
form of data censoring where parameters called mu have to be estimated alongside the betas and the alphas.
See Greene (1997) for further details. The y variable, which is an observed variable, takes, in our case, the
values on a seven-point scale given by the surveyed. For the econometric analysis using LIMDEP software,
answers were recoded from 0 to 6.
123
512
precisely a variable-reduction procedure that creates factor scores that will account for
most of the variance in the observed variables. The analysis provides orthogonal factor
scores that are completely uncorrelated (Dillon and Goldstein 1984). Table 1 present the
factor load matrix resulting from PCA where five factors capture 73 % of the overall
variance.
It is clear from Table 1 that different teaching and assessment methods are appropriate
to different learning aims. The theoretical aspects of the influence of different modes of
teaching and learning, and assessment in the development of competencies among college
students have been discussed by Entwistl (2003)and by Salas Velasco et al. (2012), among
others. For example, lectures contribute to develop the ability to analyze and interpret
information; practical sessions are very useful in order to develop the capacity to solve
problems or the capacity to apply knowledge to practical situations; or computer lab
sessions enhance the ability to analyze and search for information from different sources
(Salas Velasco et al. 2012).
123
0.04
Tutorials
Assignment-based
assessment
-0.02
0.42
-0.01
0.61
-0.15
-0.16
-0.21
0.43
-0.04
0.30
Written assignments
0.14
-0.14
0.47
0.14
-0.11
-0.02
0.01
0.00
0.29
Lectures
Group assignments
Factor 2
Factor 1
Teacher-focused
teaching
-0.03
0.00
0.11
0.06
0.53
0.71
-0.03
-0.02
-0.03
-0.08
Factor 3
Table 1 Application of a principal component analysis (PCA) to the different modes of teaching and learning, and assessment
Examinations
0.97
0.02
-0.08
-0.14
0.00
-0.04
0.13
-0.02
0.05
-0.03
Factor 4
Lectures
-0.02
-0.07
-0.08
0.01
0.52
-0.37
0.09
-0.25
0.10
0.80
Factor 5
123
123
3.272**
2.063**
8.13E-02
0.125
0.122
Tutorials
Teacher-focused teaching
Examinations
10.808**
Assignment-based assessment
0.101
0.371
9.17E-02
-0.311
-2.40E-02
5.30E-02
-9.93E-04
9.36E-02
1.569
-0.468
-0.407
0.151
Services
-1.007
3.426**
-0.346
-2.314**
-0.790
-2.907**
1.170
0.948
-3.988**
-4.192**
-0.481
-0.681
-3.595**
6.52E-02
-0.476
Ref.
8.73E-02
0.23
0.14
0.56
37.86
3.55
3.69
7.17E-03
0.12
4.27E-02
0.15
0.14
0.33
1.83E-02
4.60E-02
3.68E-02
2.04E-02
2.83E-03
-3.36E-02
0.278
0.101
-0.129
-0.503
-0.573
-0.433
-7.65E-02
4.77E-02
Ref.
0.39
Education
-0.083
7.01E-02
2.44E-02
6.99E-03
4.50E-02
-6.86E-03
0.00
4.182
7.77E-02
Lectures
0.00
0.00
0.00
0.00
3.690**
2.272**
3.753**
4.970
0.140
Constant
0.586
0.374
0.267
1.355
-0.991
6.302**
0.251
-0.863
-2.513**
-3.528**
-2.658**
-0.578
0.573
0.581
0.543
0.661
0.208
1.270
2.100**
9.373**
t-ratio
0.23
0.14
0.56
37.86
3.55
3.69
7.17E-03
0.12
4.24E-02
0.15
0.14
0.33
8.76E-02
0.39
0.00
0.00
0.00
0.00
0.00
Mean of X
Coefficient
Mean of X
Coefficient
t-ratio
Table 2 Factors explaining competence development among Spanish university graduates: the role of the HEIs
-2.082**
0.170
-2.62E-02
4.30E-02
4.35E-03
5.30E-02
0.216
-1.05E-02
2.115**
-0.266
0.558
2.055**
1.553
4.856**
-0.026
-0.818
-0.422
-0.124
-1.786*
-1.170
-2.781**
0.127
2.299**
-0.554
3.080**
2.021**
1.276
5.004**
9.003**
t-ratio
-0.294
-0.194
-0.373
2.27E-02
Ref.
0.193
-1.89E-02
0.1149
6.91E-02
4.56E-02
0.189
4.071
Coefficient
0.23
0.14
0.57
37.87
3.55
3.69
0.01
0.12
0.04
0.15
0.14
0.33
0.09
0.39
0.00
0.00
0.00
0.00
0.00
Mean of X
514
High Educ (2014) 68:503523
-0.250
-9.50E-03
1.441
2.597
4.048
5.389
7.236
Mu(1)
Mu(2)
Mu(3)
Mu(4)
Mu(5)
3207
-4642.885
142.7187
0.0000
v2
P (v2 [ value)
148.286**
141.507**
86.656**
32.480**
11.558**
0.54
0.31
-1.743*
-0.068
9.11E-02
0.57
2.88
0.25
29.85
0.64
7.11E-02
-2.931**
0.607
0.860
Number of observations
Ref.
-0.497
4.05E-02
0.539
4.14E-02
3.20E-02
0.979
1.10E-02
Age
0.741
5.40E-02
Woman
0.347
4.71E-02
6.919
5.206
3.942
2.658
1.260
0.442
0.244
-9.33E-02
Ref.
7.53E-02
5.79E-02
0.145
-1.26E-02
0.403
-0.209
0.0000
184.5142
-4762.14
3208
146.824**
138.860**
86.778**
37.350**
10.627**
3.110**
1.677*
-0.550
1.133
1.556
1.892*
-1.198
5.557**
-1.587
t-ratio
0.54
0.31
9.13E-02
0.57
2.88
0.25
29.85
0.64
7.11E-02
Mean of X
Coefficient
Mean of X
Coefficient
t-ratio
Table 2 continued
5.817
4.122
2.974
1.836
1.120
0.357
0.291
0.146
Ref.
3.77E-02
-8.12E-02
6.98E-02
-1.56E-02
0.265
7.94E-04
Coefficient
0.0000
175.46
-4520.96
3205
130.662**
105.165**
57.694**
23.770**
11.647**
2.530**
2.024**
0.861
0.558
-2.166**
0.914
-1.450
3.616**
0.006
t-ratio
0.54
0.31
0.09
0.57
2.87
0.25
29.85
0.64
0.07
Mean of X
123
123
6.45E-02
2.21E-03
-0.245
-9.06E-02
9.25E-02
0.211
-0.400
Services
0.133
Engineering, Manufacturing,
and Construction
0.619
-5.81E-02
1.040
1.914*
4.806**
-1.999**
0.821
-0.355
0.803
0.107
2.242**
Ref.
0.394
-1.662*
-0.136
0.776
-0.888
Education
2.88E-02
-3.00E-02
Examinations
Lectures
2.997**
4.83E-02
1.439
0.106
Tutorials
Teacher-focused teaching
8.145**
1.689*
3.647
6.28E-02
Assignment-based
assessment
37.84
3.55
3.69
7.17E-03
0.12
4.27E-02
0.15
0.14
0.33
8.73E-02
0.39
0.00
0.00
0.00
0.00
0.00
-1.011
-5.43E-02
4.46E-03
1.51E-02
0.235
2.08**
0.44
5.209**
-0.141
-0.706
-0.204
-0.107
0.117
1.317
0.714
2.596**
0.992
-0.798
1.544
4.980**
1.990**
1.106
11.226**
1.93E-02
0.220
9.60E-02
0.459
Ref.
8.23E-02
-2.74E-02
5.84E-02
0.171
7.19E-02
4.16E-02
5.064
t-ratio
37.86
3.55
3.68
7.17E-03
0.12
4.21E-02
0.15
0.14
0.33
8.79E-02
0.39
0.00
0.00
0.00
0.00
0.00
Mean of X
Coefficient
Mean of X
Coefficient
t-ratio
Constant
Table 2 continued
-7.07E-04
7.57E-02
0.240
0.529
-0.572
-0.419
-0.168
-0.370
-0.320
-5.63E-02
Ref.
1.63E-02
2.30E-02
5.28E-02
6.70E-02
0.104
0.180
3.249
Coefficient
-0.331
2.237**
5.437**
1.269
-3.808**
-2.124**
-1.028
-2.243**
-2.411**
-0.320
0.199
0.675
1.420
1.974**
2.924**
4.828**
7.334**
t-ratio
37.87
3.55
3.68
6.88E-03
0.121
4.25E-02
0.150
0.145
0.333
8.69E-02
0.393
0.00
0.00
0.00
0.00
0.00
Mean of X
516
High Educ (2014) 68:503523
0.237
0.512
1.957
-0.234
0.927
Ref.
Mu(2)
0.175
Mu(1)
9.99E-02
7.00E-03
-0.149
-2.65E-02
32.61**
11.75**
3.644**
1.646*
-1.396
2.642**
0.188
1.327
-2.489**
-2.087**
-0.929
-0.124
Woman
2.415**
0.189
Study-related work
experience during higher
education
Age
1.097
0.105
0.998
7.56E-02
0.54
0.31
9.13E-02
0.57
2.87
0.25
29.85
0.64
7.07E-02
0.23
0.14
0.56
2.209
1.225
0.254
0.122
7.01E-02
Ref.
0.1723498
7.00E-02
0.108415
-2.41E-02
-1.29E-02
-0.2823933
8.31E-02
0.182
-1.80E-02
19.469**
7.533**
1.752*
0.826
0.402
2.538**
1.853*
1.403
-2.258**
-0.176
-2.125**
1.041
1.849*
-0.232
t-ratio
0.54
0.31
9.10E-02
0.57
2.88
0.25
29.84
0.64
7.07E-02
0.23
0.14
0.57
Mean of X
Coefficient
Mean of X
Coefficient
t-ratio
Participated in work
placement/internships
Table 2 continued
2.135
0.956
0.458
0.254
5.57E-03
Ref.
0.194
-3.88E-02
0.103
2.51E-03
0.337
9.86E-03
0.125
0.222
9.69E-02
Coefficient
31.792**
9.987**
3.273**
1.775*
0.033
2.903**
-1.037
1.348
0.243
4.633**
0.074
1.575
2.260**
1.268
t-ratio
0.54
0.31
9.10E-02
0.57
2.88
0.25
29.85
0.64
7.10E-02
0.23
0.14
0.57
Mean of X
123
123
4.256
5.925
Mu(5)
0.0000
Asterisks indicate coefficients that are significant at the 5% level (**) and 10% level (*)
146.721
172.924
v2
P (v2 [ value)
0.0000
-4263.2
3,209
3,209
156.236**
134.030**
69.373**
-4975.5
7.385
5.406
3.914
125.51**
115.4**
73.00**
Number of observations
3.105
Mu(4)
t-ratio
Mean of X
Coefficient
Mean of X
Coefficient
t-ratio
Mu(3)
Table 2 continued
6.532
4.707
3.384
Coefficient
0.0000
187.86
-4765.2
3,199
131.2**
124.3**
75.840**
t-ratio
Mean of X
518
High Educ (2014) 68:503523
519
123
520
including a dummy variable for those with a graduate parent (father with higher education). The estimations show a positive effect (statistically significant) of a higher socioeconomic status in the development of the Ability to use time efficiently.
Graduates responses to the question about the acquired level of competence provide
also a self-assessment of the level of competencies built up during HE. The regressions
confirm a significant and positive impact of experiences abroad on the development of
competencies. Students who spent time abroad during higher education for study or work
develop, clearly, the Ability to coordinate activities and Ability to rapidly acquire new
knowledge as well. Evidence on the economic returns to studying abroad can be found in
Oosterbeek and Webbink (2006). Among other findings, the authors show that studying
abroad is associated with an increase in the probability of finding a job in which international contacts are importantsee also Salisbury et al. (2009) for a recent research about
the factors that influence students predisposition to study abroad. Likewise, study-related
work experience during higher education allows graduates to accumulate productive
capacities: Ability to work productively with others and Ability to perform well under
pressure.
Finally, the professional path of graduates since they left HE and current situation may
be an important effect on their assessment of the competencies. Graduates who enrolled in
additional formal study/training programmes after graduation in 19992000 exhibit, ceteris
paribus, higher competencies in the Ability to perform well under pressure, Ability to
rapidly acquire new knowledge, and Ability to coordinate activities. Likewise, a higher
number of years of experience in the labor market since graduation in 19992000 exercise
a positive impact on competence developmentwith the exception of the Ability to make
your meaning clear to others. In summary, on this evidence, the effects of HE modes are
evidently important, but also circumstances outside the classrooms.
123
521
certain teaching and learning, and assessment methods correlate with certain competencies.
For example, evidence shows that assignment-based assessment, in contrast with traditional modes of teaching such as lectures, is the most effective mode of teaching and
learning to developing labor market competencies among Spanish graduates.
Our results have clear implications for policy in the Bologna process. The recent reform
of higher education in Spain has important consequences for students, academics, and the
labor market. Developing transferable competencies that university graduates can take into
the workplace is becoming a major concern for Spanish universities. One of the main
challenges still facing HEIs is to transform their pedagogical practicesthe lecture continues to be the dominant teaching methodinto competence-based teaching as a response
of HEIs to labor market needs. Although the teaching of transferable skills is neither easy
nor certain, learner-centered instruction, which incorporates active teaching methods, is
more expensive to implement comparing with the traditional onesit demands more
resources, smaller groups, more instructors, etc.but it is indeed less cost-effective. In any
case, popular discussions of skill formation almost always focus on expenditures in schools
or on educational reforms but neglect important non-institutional sources of skill formation, which are equally important, if not more important, producers of the varieties of skills
that are useful in a modern economy. This paper exhibits that, along with academic
institutions, firmsworking experience gained after graduationappear as sources of
learning and competence development as well.
The importance of this paper lies in the implications that a competence-based approach
has for teaching and learning. The curriculum developers and teaching staff in higher
education sectors could use the findings to tailor the curriculum and teaching practices
accordingly in order to better-equip higher education students to obtain those abilities and
attributes which are useful for the labor market. Nevertheless, we should mention two
limitations of this research, still ongoing under the title Approaches to Teaching,
Learning and Assessment in a Competence-based Curriculum. On the one hand, the issue
of causality will be treated carefully in future research. In other words, to be sure that some
modes of teaching and learning, and assessment activities are more appropriate than others
to the best development of certain competencies, a repeated measures design should be
taken into account. On the other hand, graduates self-assessments of competence development should be accompanied by objective measures of competence gains in their educational programmes provided by universities.
Acknowledgements I would like to acknowledge the useful comments given to me by the anonymous
referees. I would also like to thank Professor Ken Mayhew, University of Oxford, for his considerable help
and advice on an earlier version of this work during my visit at SKOPE.
References
Acemoglu, D. (1998). Why do new technologies complement skills? Directed technical change and wage
inequality. Quarterly Journal of Economics, 113(4), 10551089.
Allen, J., Inenaga, Y., van der Velden, R., & Yoshimoto, K. (Eds.). (2007). Competencies, higher education
and career in Japan and the Netherlands (Higher Education Dynamics). Dordrecht, The Netherlands:
Springer.
Altonji, J. G., Bharadwaj, P., & Lange, F. (2008). Changes in the characteristics of American youth:
Implications for adult outcomes. NBER Working paper series #13883, National bureau of economic
research, Cambridge, MA.
Arnold, J., Loan-Clarke, J., Harrington, A., & Hart, C. (1999). Students perceptions of competence
development in undergraduate business-related degrees. Studies in Higher Education, 24(1), 4359.
123
522
Biemans, H., Nieuwenhuis, L., Poell, R., Mulder, M., & Wesselink, R. (2004). Competence-based VET in
the Netherlands: Background and pitfalls. Journal of Vocational Education and Training, 56(4),
523538.
Bowles, S., Gintis, H., & Osborne, M. (2001). Incentive-enhancing preferences: Personality behavior, and
earnings. American Economic Association Papers and Proceedings, 91, 155158.
Brennan, J., & McGeevor, P. (1988). Graduates at work: Degree courses and the labour market. London:
Kingsley.
Davis, S. J., & Haltiwanger, J. (1991). Wage dispersion between and within U.S. manufacturing plants,
196386, pp. 115180 Brookings papers on economic activity: Microeconomics.
Dillon, W. R., & Goldstein, M. (1984). Multivariate analysis: Methods and applications. New York: Wiley.
Douglas, S., & Sulock, J. (1995). Estimating educational production functions with correction for drops.
Journal of Economic Education, 26(2), 101112.
Dunkin, M. J. (1983). A review of research on lecturing. In J. P. Powell (Ed.), Higher education research
and development (Vol. 2(1), pp. 6378). ERIC Document Reproduction Service No. ED240897.
Dunne, T., Haltiwanger, J. C., & Troske, K. R. (2004). Technology and Jobs: Secular changes and cyclical
dynamics. Carnegie-Rochester Conference Series on Public Policy, 46, 107178.
Elias, P., & Purcell, K. (2004). Is mass higher education working? Evidence from the labour market
experiences of recent graduates. National Institute Economic Review, 190, 6074.
Entwistl, N. (2003). University teaching-learning environments and their influences on student learning: An
introduction to the ETL project. Paper presented at the EARLI conference, Padova, 2630 August 2003
(mimeo).
Felstead, A., Gallie, D., Green, F., & Zhou, Y. (2007). Skills at work, 1986 to 2006. ESRC Centre on Skills,
Knowledge and Organisational Performance, Universities of Oxford and Cardiff.
Garcia-Aracil, A., Mora, J. G., & Vila, L. E. (2004). The rewards of human capital competencies for young
European higher education graduates. Tertiary Education and Management, 10(4), 287305.
Greene, W. H. (1997). Econometric analysis. Upper Saddle River, NJ: Prentice-Hall.
Hanushek, E. (1996). Measuring investment in education. Journal of Economic Perspectives, 10(4), 930.
Hanushek, E. (2002). Publicly provided education, NBER working paper series #8799, National Bureau of
Economic Research, Cambridge, MA.
Hanushek, E. A., & Kimko, D. D. (2000). Schooling, labor-force quality, and the growth of nations.
American Economic Review, 90(5), 11841208.
Heckman, J. J. (2000). Policies to foster human capital. Research in Economics, 54, 356.
Heckman, J. J. (2006). Skill formation and the economics of investing in disadvantaged children, Science,
312 30 June 2006.
Heckman, J. J., & Rubinstein, Y. (2001). The importance of noncognitive skills: Lessons from the GED test
program. American Economic Review, 91(2), 145149.
Heckman, J., Stixrud, J., & Urzua, S. (2006). The effects of cognitive and noncognitive abilities on labor
market outcomes and social behavior. Journal of Labor Economics, 24(3), 411482.
Lleras, C. (2008). Do skills and behaviors in high school matter? The contribution of noncognitive factors in
explaining differences in educational attainment and earnings. Social Science Research, 37, 888902.
Lucas, R. E. (2009). Ideas and growth. Economica, 76(301), 119.
McKeachie, W. J., Pintrich, P. R., Lin, Y-G., & Smith, D. A. F. (1986).Teaching and learning in the college
classroom: A review of the research literature. National Center for Research to Improve Postsecondary
Teaching and Learning, Technical report No. 90-B-003.1, Ann Arbor, MI (ED 314 999).
McKelvey, R. D., & Zavoina, W. (1975). A statistical model for the analysis of ordinal level dependent
variables. Journal of Mathematical Sociology, 4, 103120.
Mulder, M., Weigel, T., & Collins, K. (2007). The concept of competence in the development of vocational
education and training in selected EU member states: A critical analysis. Journal of Vocational
Education and Training, 59(1), 6788.
Murnane, R. J., Willett, J. B., & Levy, F. (1995). The growing importance of cognitive skills in wage
determination. Review of Economics and Statistics, 77(2), 251266.
OECD. (2005). Education at a glance 2005: OECD Indicators. Paris: OECD.
OECD. (2007). Education at a glance 2007: OECD Indicators. Paris: OECD.
Oosterbeek, H., & Webbink, D. (2006). Assessing the returns to studying abroad, CPB discussion paper No.
64.
Purcell, K., Elias, P., Atfield, G., Behle, H., Ellison, R., and Luchinskaya, D. (2013): Transitions into
Employment, further Study and other Outcomes. The Futuretrack Stage 4 Report, HECSU and IER,
University of Warwick.
Ramsden, P., & Moses, I. (1992). Associations between research and teaching in Australian higher education. Higher Education, 23, 273295.
123
523
Roizen, J., & Jepson, M. (1985). Degrees for Jobs: Employer expectations of higher education. Guildford:
Society for Research into Higher Education & NFER-Nelson.
Salas Velasco, M., Sanchez Martnez, M. T., & Rodrguez Ferrero, N. (2012). Developing generic competences in the European higher education area: A proposal for teaching the principles of economics.
European Journal of Education, 47, 462476.
Salisbury, M. H., Umbach, P. D., Paulsen, M. B., & Pascarella, E. T. (2009). Going global: Understanding
the choice process of the intent to study abroad. Research in Higher Education, 50, 119143.
Schmidt, H. G., & van der Molen, H. T. (2001). Self-reported competency ratings of graduates of a problembased medical curriculum. Academic Medicine, 76(5), 466468.
Stren, L. A., & Aamodt, P. O. (2010). The quality of higher education and employability of graduates.
Quality in Higher Education, 16(3), 297313.
Teichler, U. (2007a). Does higher education matter? Lessons from a comparative graduate survey. European
Journal of Education, 42(1), 1134.
Teichler, U. (Ed.) (2007b). Careers of university graduates. Views and experiences in comparative perspectives, higher education dynamics, (Vol. 17), New York: Springer.
Vandenbussche, J., Aghion, P., & Meghir, C. (2006). Growth, distance to frontier and composition of human
capital. Journal of Economic Growth, 11(2), 97127.
123