Risk Governance-Ortwinrenn
Risk Governance-Ortwinrenn
Risk Governance-Ortwinrenn
Risk governance
To cite this article: Marjolein B.A. van Asselt & Ortwin Renn (2011) Risk governance, Journal of
Risk Research, 14:4, 431-449, DOI: 10.1080/13669877.2011.553730
Risk governance
Marjolein B.A. van Asselta* and Ortwin Rennb
a
Faculty of Arts and Social Sciences, Maastricht University, Maastricht, The Netherlands;
b
Institut für Socialwissenschaften, University of Stuttgart, Stuttgart, Germany
(Received 27 May 2010; final version received 8 January 2011)
Taylor and Francis
RJRR_A_553730.sgm
Journal
10.1080/13669877.2011.553730
1366-9877
Original
Taylor
02011
00
Professor
marijke.hermans@maastrichtuniversity.nl
000002011
&ofArticle
Francis
Marjoleinvan
Risk
(print)/1466-4461
ResearchAsselt(online)
The term ‘governance’ has been used in political science to describe the multitude
of actors and processes that lead to collective binding decisions. The term ‘risk
governance’ involves the translation of the substance and core principles of
governance to the context of risk-related decision-making. Does it involve a major
change on how risks are conceptualized, managed, and communicated, or it is just
a new fashion? In this paper, we aim to delineate the genesis and analytical scope
of risk governance. In our view, risk governance pertains to the various ways in
which many actors, individuals, and institutions, public and private, deal with risks
surrounded by uncertainty, complexity, and/or ambiguity. It emphasizes that not
all risks are simple; they cannot be calculated as a function of probability and
effect. It is more than a descriptive shorthand for a complex, interacting network
in which collective binding decisions are taken around a particular set of societal
issues. The ambition is that risk governance provides a conceptual as well as
normative basis for how to deal responsibly with uncertain, complex, and/or
ambiguous risks in particular. We propose to synthesize the body of scholarly
ideas and proposals on the governance of systemic risks in a set of principles: the
communication and inclusion principle, the integration principle, and the
reflection principle. This set of principles should be read as a synthesis of what
needs to be seriously considered in organizing structures and processes to govern
risks.
Keywords: risk governance; uncertainty; complexity; ambiguity; paradigm shift
1. Introduction
A new proposal in professional risk assessment and management communities is to
combine the terms ‘governance’ and ‘risk’ into the compound ‘risk governance’. Does
this shift signal a major change on how risks are conceptualized, managed, and
communicated, or it is just a new fashion? In this paper, we aim to delineate what risk
governance is all about.
The term ‘governance’ has been used in political science to describe the multitude
of actors and processes that lead to collective binding decisions. Governing choices in
modern societies is generally conceptualized as an interplay between governmental
institutions, economic forces, and civil society actors (such as NGOs). As most defi-
nitions state, governance embodies a horizontally organized structure encompassing
state and non-state actors bringing about collectively binding decisions without
superior authority (c.f. Rosenau 1992; Wolf 2002). In this perspective, non-state
In 2001, the first articles with risk governance in its title appeared in peer-reviewed
scientific journals, namely the Journal of Hazardous Materials (Heriard-Dubreuil
2001) and Science and Culture (Elliott 2001). The article ‘Present challenges to risk
governance’ authored by Gilles Heriard-Dubreuil, which was included in a special
issue called ‘Risk and Governance’, can be characterized as a summary of the
conclusions and insights from the TRUSTNET project. Dave Elliott’s paper ‘Risk
governance: Is consensus a con?’ is a critical discussion of the conclusions drawn in
the context of TRUSTNET. Neither one of them, however, provides a definition of
risk governance, notwithstanding the fact that it is discussed in terms of a new para-
digm (see also Amendola 2001; Heriard-Dubreuil et al. 2002). Only it is clear that the
notion ‘risk governance’ is introduced in opposition to the classical notions of risk
assessment and risk management. Risk governance is apparently different. The issues
discussed in the above-mentioned early papers on risk governance involve the
complexity of modern risks, the role of science and experts, and the importance of
trust and stakeholder participation. The notion ‘risk governance’ has been further
endorsed by the successor to TRUSTNET, namely TRUSTNET-IN-ACTION
(www.trustnetinaction.com), a network of experts, presenting itself as a think tank in
the field of risk, environmental and health issues, financially supported by the
European Union (EU).
The notion ‘risk governance’ appeared also in the European Commission’s
Science & Society action plan (2001); Section 3.2. is entitled ‘Risk governance’, with
reference to TRUSTNET. As discussed above, in the TRUSTNET context risk
governance was propagated as an alternative paradigm. The commission, however,
used risk governance more traditionally as an umbrella notion ‘embracing risk
identification, assessment, management, and communication’. Also in the EU sixth
framework program, a call for research proposals entitled ‘risk governance and ethics’
was launched. Against this background, it is no surprise that a number of EU-financed
projects, such as MIDIR (midir.eu), RISKGOV (www.riskgov.com), SAFE FOODS
(www.safefoods.nl) and the Marie Curie research training networks Mountain Risks
(mountain-risks.eu), and GoverNat (Governance of Natural Resources), entertained
the notion ‘risk governance’.
So risk governance is a notion introduced to the academic discourse via European
networks on risk at the turn of the millennium. It is rooted in transdisciplinary work
in the interface between risk assessment, risk management, regulatory sciences, and
policy analysis, especially at the level of the EU. It is important to stress that other
endeavors preceding TRUSTNET in a way paved the way for coining the notion. The
Organization for Economic Co-Operation and Development (OECD) work on
systemic risk (OECD 2003) and the Hood, Rothstein, and Baldwin (2001) book on the
government of risk are examples of key trailblazers.
In the early days, the notion ‘risk governance’ was proposed, however, in a rather
loose way. It was used as a label, without explicit consideration of the content. Risk
governance was more a notion than a concept. It has been brought to a new level by
the establishment of International Risk Governance Council (IRGC) in 2003. IRGC,
based in Switzerland, presents itself as an independent think tank, aiming to contribute
to ‘the anticipation and governance of global, systemic risk’ (www.irgc.org). It estab-
lished a working group under the chairmanship of Ortwin Renn who also participated
in TRUSTNET and mandated the group to write a White Paper on risk governance.
This White Paper, which appeared in 2005, is the first scholarly effort to develop risk
governance conceptually.3 The paper is also published as lead chapter in the book
434 M.B.A. van Asselt and O. Renn
Global Risk Governance: Concept and Practice using the IRGC Framework (Renn
and Walker 2008; see also similar chapters in Bouder, Slavin, and Löfstedt (2007) and
Bischof (2008)), in which next to the framework itself critical reviews and case studies
have been included. Subsequently, some agencies and national regulatory bodies have
partially adopted the framework and designed manuals of how to use it for their
specific purpose (Dreyer and Renn for EFSA 2009 and the handbook for risk assess-
ment and policy advice of the Dutch Food and Consumer Product Safety Authority
[version 10 July, 2009]). In 2007, the first chair in Risk Governance was established
at Maastricht University, the Netherlands.
3. Governance
Risk governance as an emerging concept should be understood also in the context of
the broader ‘governance’-turn in the policy sciences (Versluis 2003). The notion
‘governance’ came into fashion in the 1980s in circles engaged with development
(Stern 2000) and was soon adopted in other domains. During the last decade, the term
has experienced tremendous popularity in the literature in the fields of, among others,
international relations, various policy sciences (among others in subfields referred to
as European studies and comparative political science), and environmental studies and
risk research. The idea of governance has been (re-)introduced4 to enlarge the
perspective on policy and politics by acknowledging that government is not the only,
and may be not even the most important, actor5 in managing and organizing society.
The shift to governance is best understood as response to new challenges, such as
globalization, increased international cooperation (such as the EU), societal changes,
including the increased engagement of citizens and the rise of non-governmental
organizations (NGOs), changing role of the private sector, an augmenting complexity
of policy issues, and the resulting difficulty in taking decisions with confidence and
legitimacy (Pierre and Peters 2000; Walls et al. 2005).
Many classical policy theories share a hierarchic orientation with government as
the central actor. In policy theories – inspired by economics – that central role is
awarded to the market. Both clusters of theories are single-actor in their perspective
on power and control. That is different in the governance perspective. In that view,
collective binding decisions are generated and implemented in complex multi-actor
networks and processes. Power is distributed, as multi-actor networks involve a wide
variety of actors. The governance perspective considers also various social actors
next to state and market, including new civic actors, such as NGOs and ad hoc coali-
tions of civilians, of whom it is unclear who their supporters are and whom they
represent. This view also includes the role of non-elected actors, such as civil
servants, experts, think tanks, and all kinds of committees active in various ways in
policy processes. The governance perspective thus draws attention to the diversity of
actors, the diversity of their roles, the manifold relationships between them, and all
kind of dynamic networks emerging from these relationships. Scholars subscribing to
the governance perspective examine actor-networks, the dynamics, and the roles of
the various actors in these dynamics as a way to understand policy development and
political decisions.
Some authors differentiate between horizontal and vertical governance (Benz and
Eberlein 1999; Lyall and Tait 2004). The horizontal level includes relevant actors in
decision-making processes within a defined geographical or functional segment (such
as all relevant actors within a community, region, nation, or continent). The vertical
Journal of Risk Research 435
level describes the links between these segments (such as the institutional relation-
ships between the local, regional, state, and international levels). When various levels
are involved, which is often the case, the notion ‘multi-level governance’ is advanced.
In such a context also, ‘government’ is no longer a single entity (Rauschmayer,
Paavola, and Wittmer 2009).
The notion ‘governance’ is used both in a descriptive and in a normative sense. In
a descriptive use of the term, the idea of a complex web of manifold interactions
between heterogeneous actors is used to describe the current state of affairs in general
terms or to describe and understand the state of affairs pertaining to a particular policy
dossier or policy domain. Governance is then an observation and an approach. The
description of governance as structures and processes for collective decision-making
involving governmental and non-governmental actors (Hagendijk and Irwin 2006;
Keohane and Nye 2000) is an example of a descriptive definition. In a normative use,
the notion of governance refers to a model or framework for organizing and managing
society. In the famous 2001 White Paper of the European Commission on governance,
such a normative perspective is propagated. In the White Paper, which can be read as
a response to the bovine spongiform encephalopathy (BSE) crisis, governance is
presented as an alternative model, in which transparency, stakeholder participation,
accountability, and policy coherence are key principles. Also the definition of gover-
nance as ‘a horizontally organized structure of functional self-regulation encompassing
state and non-state actors bringing about collectively binding decisions without supe-
rior authority’ (Rosenau 1992; Wolf 2002) hints at treating governance in terms of a
normative model (horizontally organized, self-regulation, and egalitarian) for how
societal decision-making should be organized. Often this distinction between descrip-
tion (of the state of affairs) and (policy) model is not made, with the consequence that
it is unclear whether governance serves as reference to the framework guiding the
analysis, or whether it has the status of a (proposed) policy theory.
This is true also for risk governance. The term is used both in a descriptive and in
a normative sense. We would like to argue that the interdisciplinary body of literature
on risk endorses that the state of affairs pertaining to the regulation of many risks is
adequately described in terms of governance. Decisions about risks are taken in
complex webs of actors, rules, conventions, processes, mechanisms, institutional
arrangements, and political cultures. Risk decisions can be understood only as the
upshot of complex interplays between multiple actors. The governance perspective is
needed to sensibly examine and explain the societal dynamics around issues framed
as risk issues. So risk governance ‘combines two concepts that are apparently sepa-
rate, but belong instead to spheres of investigation and practical interest that are
strictly intertwined and partially overlapping’ (de Marchi 2003, 171).
However, many of the authors, more or less explicitly, argue that in regulatory
practice this state of affairs is not adequately accommodated. They emphasize that the
nature of many risks requires cooperation, coordination, and trust between a range of
stakeholders who have diverging interests and different perceptions of the (potential)
risks involved. These scholars, loud and clear or in more diplomatic terms, contend
also that otherwise risks are not responsibly managed, with Ulrich Beck’s notion of
‘organised irresponsibility’6 as probably the most radical stance (1992). So a number
of these scholars propagate ideas, principles, or frameworks for how to deal with risks
in a more adequate and more responsible manner. Many of them do so without using
the term ‘risk governance’ explicitly. We take the liberty to synthesize their proposals
under the capture of risk governance. In doing so, governance is used no longer only
436 M.B.A. van Asselt and O. Renn
in a descriptive, but also in a normative sense. It proposes a new form, or at least new
principles, of handling risks. So in this paper, risk governance is a hybrid of an analyt-
ical frame and a normative model. Another example of such a hybrid can be found in
decision theory where the various stages of decision-making, that the theory suggests,
can be used as a checklist of how decisions are made (descriptive use), and at the same
time functions as a guideline of how to organize the decision process when complex
decision have to be made (normative model) (Keeney 1992, 2004a; North 1968).
All three principles are discussed in more detail in the following sections. We would
also like to emphasize that the three principles – communication and inclusion, inte-
gration, and reflection – should not be considered as separate steps or stages, but as
principles that should be considered at every step or stage in the risk governance
process. Without paying attention to these principles, the term ‘risk governance’
becomes meaningless.
One of the most consistent messages to have arisen from social science research into risk
over the past 30 years is that risk communication … needs to accommodate far more than
a simple one-way transfer of information … the mere provision of ‘expert’ information
is unlikely to address public and stakeholder concerns or resolve any underlying societal
issues.
Research on risk controversies has demonstrated that in general the public does not,
by definition, misunderstand science and that experts and governments may also
misunderstand public perceptions (Horlick-Jones 1998; Irwin and Wynne 1996).
Furthermore, risk communication and trust are delicately interconnected processes.
Communication breakdowns may damage trust, while on the other hand, communica-
tion strategies that misjudge the context in terms of the level of, and reasons for,
(dis)trust may boomerang back and actually increase distrust (Löfstedt 2005).
Notions of communication proliferate. We refer to communication as meaning-
ful interactions in which knowledge, experiences, interpretations, concerns, and
440 M.B.A. van Asselt and O. Renn
● Who is included?
● What is included?
● What are the scope and mandate of the process?
Inclusion can take different forms: roundtables, open forums, negotiated rule-making
exercises, mediation, or mixed advisory committees, including scientists and stake-
holders (Amy 1983; Renn 2008; Rowe and Frewer 2000; Steelman and Ascher 1997;
Stoll-Kleemann and Welp 2006). Social learning is required to find out what level and
Journal of Risk Research 441
type of inclusion are appropriate in view of the context and the type of risk, as there
is lack of agreement on methodologies; they have contrasting strengths and weak-
nesses (Pidgeon et al. 2005).
Inclusion is defended for several reasons (compare Roca, Gamboa, and Tàbara
2008). First, it is argued that in view of uncertainty, complexity, and/or ambiguity, it
is needed to explore various sources of information and to identify various perspec-
tives. It is important to know what the various actors label as risk problems. In that
view, inclusion is a means to an end: integration of all relevant knowledge and inclu-
sion of all relevant concerns. Second, it is argued from a democratic perspective that
actors affected by the risks and/or the ways in which the risks are governed have a
right to participate in deciding about those risks. In that view, inclusion is not just a
means, but an end in itself. At the same time, inclusion is a means to agree on princi-
ples and rules that should be respected in the processes and structures of collective
decision-making. Third, it is argued that the more actors are involved in weighing the
essentially heterogeneous pros and cons, the more socially robust the outcome. When
uncertainty, complexity, and/or ambiguity reign, there is no simple decision rule. In
that view, inclusion is also a way to organize checks and balances. Inclusion is thus
supposed to support the co-production of risk knowledge, the coordination of risk
evaluation, and the design of risk management.
Also here, social learning is required. It is not a matter of degree: more inclusion
does not equal better risk governance. The degree and type of inclusion may vary
depending on the phase and context. In each phase and context, it has to be thought
through what kind and degree of inclusion is needed. So differentiation is not an
exception, but rather the rule.
The challenge is to organize productive and meaningful communication with, and
inclusion of, a range of actors which have complementary roles and diverging interests.
The available empirical analyses suggest that the attempt to include different stake-
holders, to consider and deliberate their concerns, and to provide a platform for the
exchange of arguments can help to de-escalate conflicts and to legitimize the final deci-
sion that will always disappoint some actors in society (Beierle and Cayford 2002; US
National Research Council of the National Academies 2008). Inclusion does, however,
not necessarily reduce conflict or lead to more widely accepted decisions (Kinney and
Leschine 2002). Participation procedures themselves can become a source of conflict
(Wiedemann and Femers 1993). Not every relevant actor might be interested in partic-
ipating. Some actors might try to impose their framing on the process from the very
beginning. For example, those who consider themselves sensitive to electromagnetic
fields will insist that meetings pertaining to risks of wireless telecommunication take
place in meeting places free of electromagnetic fields. In this way, their risk-framing
gets embodied (Soneryd 2007). So it is important to accept and address conflict.
Consensus-building, in other words closure on risk assessment, evaluation and regu-
latory measures, facilitates decision-making, but in many cases conflicts cannot be
settled, nor should that be the aim. Critical evaluations12 and meta-analysis of such
evaluations are needed to learn how communication and inclusion can be effectively
organized in various contexts. Lack of evaluation will hamper such social learning.
uncertainty (c.f. De Vries et al. this issue). The communication and inclusion principle
holds that various actors take part in this reflective discourse and discuss how deci-
sions could and should be made in the face of irresolvable uncertainty, complexity, and
ambiguity. The reflection principle emphasizes that there are important difficult issues
(uncertainty, complexity, ambiguity, and balancing act) that need repeated consider-
ation of all actors throughout the process. Otherwise, the process risks to (re)introduce
the familiar frames and routines developed for simple risks.
Acknowledgments
We would like to thank Livia Smits for her support in preparing the paper and reviewing first
ideas and first versions of the paper. We, furthermore, benefited from comments on drafts from
Ragnar Löfstedt, Esther Versluis, Tessa Fox, Marijke Hermans, and two anonymous reviewers.
Notes
1. Including Ravetz ([1971]1996, 2006; see also Funtowicz and Ravetz 1992); Nowotny
(1976, 2008); Nowotny, Scott, and Gibbons (2001); Fischhoff, Watson, and Hope (1984);
Fischhoff et al. (1978); Slovic (1987, 2000); Slovic, Fischhoff, and Lichtenstein (1980);
Wynne (1980, 1982, 2001, 2002, 2010); Irwin and Wynne (1996); O’Riordan (1982);
444 M.B.A. van Asselt and O. Renn
O’Riordan, Cameron, and Jordan (2001); O’Riordan and McMichael (2002); Beck
([1986]1992, 2009); Beck, Giddens and Lash 1994; Jasanoff (1987, 1993, 1998, 2005);
Tesh (1988 [reprinted in 2000]); Kasperson and Kasperson (1991, 2005a, 2005b; see also
Pidgeon, Kasperson, and P. Slovic 2003); Löfstedt (1996, 2003, 2005; see also Linnerooth-
Bayer, Löfstedt, and Sjöstedt 2001); Stirling (1998, 2003, 2004); Vos (2000); van Asselt
(2000, 2005); van Asselt and Vos (2006, 2008; see also Everson and Vos 2009); Fischer
(2002); Fisher, Jones, and von Schomberg (2006); Huitema (2002); Mourik (2004); and so-
called cultural theorists (e.g., Douglas and Wildavsky 1982; Rayner 1992; Rayner and
Cantor 1987; Thompson, Ellis, and Wildavsky 1990; Adams 1995).
2. With ambiguity, we refer to the plurality of legitimate viewpoints for evaluating decision
outcomes and justifying judgments about their tolerability and acceptability. So ambiguity
refers to the existence of multiple values and perspectives.
3. See also the recent IRGC report on risk governance (2009).
4. The etymology of the term dates back to the Ancient Greek times (Halachmi 2005; Kjaer
2004). Plato used the term ‘kuberman’ as a reference to leadership, which assimilated in
Latin to ‘gubernanre’. This notion evaluated along various trajectories. Next to English, it
is part of, among others, the French, Spanish, and Portuguese vocabulary.
5. There is also a perspective on governance, provocatively termed ‘governance without
government’ (Rosenau 1995; Rosenau and Czempiel 1992), which emphasizes the
decreased and decreasing role of the nation state.
6. Beck (1992) did not explicitly define organized irresponsibility. Van Asselt and Vos (2008)
provide the following definition: ‘society’s ill-preparedness and inability to deal with
surprises, negative consequences, and/or long-term impacts which are associated with
uncertain risks, notwithstanding all institutions and procedures in place’.
7. This notion has been introduced to the risk literature by Harremoës et al. (2002). Latency
lacuna refers to the fact that technologies are improved while the health and/or environ-
mental impacts are studied. When such monitoring and impact studies identify risks, the
question is whether those findings still hold for the newer generation of the technology.
8. Compare Rosa (2003, 55) who argues that risk is about ‘certain states of the world which
are possible and not predetermined’ and as ‘an outcome that is possible’ (2003, 56).
9. Central notion in the social constructivist theory of technology of Bijker, Hughes, and
Pinch (1984). It means that there is flexibility in interpretation, while it is not infinite.
10. Roca, Gamboa, and Tàbara (2008) provide another example of a multifaceted risk which is
uncertain, complex, and ambiguous: coastal erosion risks.
11. Some like-minded authors prefer to re-conceptualize risk in a way that renders the addi-
tion ‘uncertain’ superfluous. For example, Aven and Renn (2009, 2) suggest to redefine
risk as a reference to ‘uncertainty about and severity of the consequences (or outcomes)
of an activity with respect to something that humans value’. See also Rosa (2003). We
agree with such definitions, and we use them as well. In this paper, however, we prefer
to highlight the element of uncertainty because in our view the deep acknowledgment of
uncertainty is one of the major shifts compared to what has been referred to as the posi-
tivist, modernist, or Knightian risk paradigm. So the use of the notion ‘uncertain risk’ in
this paper should be understood as a way to underscore the importance of uncertainty in
risk governance. Compare a large giant: all giants are large, but large giants are really
huge.
12. See, for example, Kinney and Leschine (2002) and Santos and Chess (2003). These authors
emphasize that outcome as well as process variables and theoretical as well as participant-
based criteria should be included in the evaluations (see also Pidgeon et al. 2005).
References
Adams, J. 1995. Risk. London: UCL Press.
Amendola, A. 2001. Recent paradigms for risk informed decision making. Safety Science 40,
nos. 1–4: 17–30.
Amy, D.J. 1983. Environmental mediation: An alternative approach to policy stalemates.
Policy Sciences 15: 345–65.
Aven, T., and O. Renn. 2009. On risk defined as an event where the outcome is uncertain.
Journal of Risk Research 12, no. 1: 1–11.
Journal of Risk Research 445
Beck, U. [1986] 1992. Risk society: Towards a new modernity. Trans. M.A. Ritter [in
German]. London: Sage.
Beck, U. 2009. World at risk. Cambridge: Polity Press.
Beck, U., A. Giddens, and S. Lash. 1994. Reflexive modernization: Politics, tradition and
aesthetics in the modern social order. Cambridge: Polity Press.
Beierle, T.C., and J. Cayford. 2002. Democracy in practice: Public participation in environ-
mental decisions. Washington, DC: Resources for the Future.
Benz, A., and B. Eberlein. 1999. The Europeanization of regional policies: Patterns of multi-
level governance. Journal of European Public Policy 6, no. 2: 329–48.
Bijker, W., T. Hughes, and T. Pinch. 1987. The social construction of technological
systems: New directions in the sociology and history of technology. Cambridge, MA: MIT
Press.
Bischof, H.-J., ed. 2008. Risks in modern society. Berlin/Heidelberg: Springer.
Bouder, F., D. Slavin, and R. Löfstedt, eds. 2007. The tolerability of risk: A new framework
for risk management. London: Earthscan.
Charnley, G., and E.D. Elliott. 2002. Risk versus precaution: Environmental law and public
health protection. Environmental Law Reporter 32, no. 2: 10363–6.
Collingridge, D. 1996. Resilience, flexibility, and diversity in managing the risks of technolo-
gies. In Accident and design: Contemporary debates in risk management, ed. C. Hood and
D.K.C. Jones, 40–5. London: UCL Press.
de Bandt, O., and P. Hartmann. 2000. Systemic risk: A survey. Working Paper No. 35, Work-
ing Paper Series, 1–77, European Central Bank.
de Jouvenel, B. 1967. The art of conjecture. Trans. N. Lary. New York: Basic Books.
de Marchi, B. 2003. Public participation and risk governance. Science and Public Policy 30,
no. 3: 171–6.
Douglas, M., and A. Wildavsky. 1982. Risk and culture: Essays on the selection of technical
and environmental dangers. Berkeley, CA: University of California Press.
Dreyer, M., and O. Renn, eds. 2009. Food safety governance. Integrating science, precaution
and public involvement. Heidelberg/New York: Springer.
Elliott, D. 2001. Risk governance: Is consensus a con? Science as Culture 10, no. 2: 265–71.
European Commission. 2001. European governance: A white paper. Report Number
COM(2001) 428 final. Brussels: European Commission.
Everson, M., and E. Vos, eds. 2009. Uncertain risks regulated in national, European and
international contexts. Abingdon/New York: Routledge-Cavendish.
Fischer, E. 2002, Precaution, precaution everywhere: Developing a ‘common understanding’
of the precautionary principle in the European Union. Maastricht Journal of European
and Comparative Law 9, no. 1: 7–28.
Fischer, E.C., J.S. Jones, and R. von Schomberg, eds. 2006. Implementing the precautionary
principle: Perspectives and prospects. Cheltenham/Northampton: Edward Elgar.
Fischhoff, B. 1995. Risk perception and communication unplugged: Twenty years of process.
Risk Analysis 15, no. 2: 137–45.
Fischhoff, B., P. Slovic, S. Lichtenstein, S. Read, and B. Combs. 1978. How safe is safe
enough? A psychometric study of attitudes towards technological risks and benefits.
Policy Sciences 9: 127–52.
Fischhoff, B., S.R. Watson, and C. Hope. 1984. Defining risk. Policy Sciences 17: 123–39.
Funtowicz, S., and J. Ravetz. 1992. Three types of risk assessment and the emergence of post-
normal science. In Social theories of risk, ed. S. Krimsky and D. Golding, 230–51. New
York: Praeger.
Hagendijk, R., and A. Irwin. 2006. Public deliberation and governance: Engaging with
science and technology in contemporary Europe. Minerva 44, no. 2: 167–84.
Halachmi, A. 2005. Governance and risk management: Challenges and public productivity.
International Journal of Public Sector Management 18, no. 4: 300–17.
Harremoës, P., D. Gee, M. MacGarvin, A. Stirling, J. Keys, B. Wynne, and S. Guedes Vaz,
eds. 2002. The precautionary principle in the 20th century: Late lessons from early
warnings. London: Earthscan.
Hellstroem, T. 2001. Emerging technological and systemic risk: Three cases with manage-
ment suggestions. Contribution to the OECD International Futures Project on Emerging
Systemic Risks. Paris: OECD.
446 M.B.A. van Asselt and O. Renn
Löfstedt, R.E. 2003. Risk communication: Pitfalls and promises. European Review 11, no. 3:
417–35.
Löfstedt, R.E. 2005. Risk management in post-trust societies. Hampshire/New York: Palgrave
Macmillan.
Lyall, C., and J. Tait. 2004. Shifting policy debates and the implications for governance. In
New modes of governance. Developing an integrated policy approach to science, ed. C.
Lyall and J. Tait, 3–17. Aldershot: Ashgate.
Millstone, E., P. Van Zwanenberg, C. Marris, L. Levidow, and H. Torgesen. 2004. Science in
trade disputes related to potential risks: Comparative case studies. Seville: Institute for
Prospective Technological Studies (JRC-IPTS).
Mourik, R. 2004. Did water kill the cows?: The distribution and democratisation of risk,
responsibility and liability in a Dutch agricultural controversy on water pollution and
cattle sickness. Amsterdam: Amsterdam University Press.
North, D.W. 1968. A tutorial introduction to decision theory. IEEE Transactions on Systems
Science and Cybernetics SSC-4, no. 3: 200–10.
Nowotny, H. 1976. Social aspects of the nuclear power controversy. Report Number RM-76-
33. Laxenburg: IIASA.
Nowotny, H. 2008, Insatiable curiosity: Innovation in a fragile future. Cambridge, MA: MIT
Press.
Nowotny, H., P. Scott, and M. Gibbons. 2001. Re-Thinking science: Knowledge and the public
in an age of uncertainty. Cambridge: Polity Press in association with Blackwell.
OECD. 2003. Emerging systemic risks. Final report to the OECD Futures Project. Paris:
OECD.
O’Riordan, T. 1982. Risk perception studies and policy priorities. Risk Analysis 2, no. 2:
95–100.
O’Riordan, T., J. Cameron, and A. Jordan. 2001. Reinterpreting the precautionary principle.
London: Cameron May International Law and Policy.
O’Riordan, T., and A.J. McMichael. 2002. Dealing with scientific uncertainties. In Environ-
mental change, climate and health: Issues and research methods, ed. P. Martens and A.J.
McMichael, 311–32. Cambridge: Cambridge University Press.
Pidgeon, N., R.E. Kasperson, and P. Slovic, eds. 2003. The social amplification of risk.
Cambridge: Cambridge University Press.
Pidgeon, N.F., W. Poortinga, G. Rowe, T.-H. Jones, J. Walls, and T. O’Riordan. 2005. Using
surveys in public participation processes for risk decision making: The case of the 2003
British GM Nation? Public debate. Risk Analysis 25, no. 2: 467–79.
Pierre, J., and B.G. Peters. 2000. Governance, politics and the state. Houndsmill/London:
Macmillan.
Rauschmayer, F., J. Paavola, and H. Wittmer. 2009. European governance of natural
resources and participation in a multi-level context: An editorial. Environmental Policy
and Governance 19, no. 3: 141–7.
Ravetz, J.R. [1971] 1996. Scientific knowledge and its social problems. New Brunswick, NJ/
London: Transaction publishers.
Ravetz, J. 2006. The no-nonsense guide to science. Oxford: New Internationalist.
Rayner, S. 1992. Cultural theory and risk analysis. In Social theory of risk, ed. S. Krimsky and
D. Golding, 83–115. Westport, CT: Praeger.
Rayner, S., and R. Cantor. 1987. How fair is safe enough? The cultural approach to societal
technology choice. Risk Analysis 7, no. 1: 3–9.
Renn, O. 2008. Risk governance: Coping with uncertainty in a complex world. London:
Earthscan.
Renn, O., and F. Keil. 2009. Was ist das Systemische an systemischen Risiken? [What is
systemic about systemic risks?]. GAIA Ecological Perspectives for Science and Society
18, no. 2: 97–9.
Renn, O., and P. Schweizer. 2009. Inclusive risk governance: Concepts and application to
environmental policy making. Environmental Policy and Governance 19, no. 3: 174–85.
Renn, O., and K. Walker. 2008. Lessons learned: A re-assessment of the IRGC framework
on risk governance. In Global risk governance. Concept and practice using the IRGC
framework, ed. O. Renn and K. Walker, 331–60. International Risk Governance Council
Bookseries 1. Berlin/Heidelberg: Springer.
448 M.B.A. van Asselt and O. Renn
Roca, E., G. Gamboa, and J.D. Tàbara. 2008. Assessing the multidimensionality of coastal
erosion risks: Public participation and multicriteria analysis in a Mediterranean coastal
system. Risk Analysis 28, no. 2: 399–412.
Rosa, E.A. 2003. The logical structure of the social amplification of risk framework (SARF):
Metatheoretical foundations and policy implications. In The social amplification of risk, ed.
N. Pidgeon, R.E. Kasperson, and P. Slovic, 47–79. Cambridge: Cambridge University Press.
Rosenau, J.N. 1992. Governance, order, and change in world politics. In Governance without
government: Order and change in world politics, ed. J.N. Rosenau and E.-O. Czempiel,
1–29. Cambridge: Cambridge University Press.
Rosenau, J.N. 1995. Governance in the 21st century. Global Governance 1, no. 1: 13–43.
Rosenau, J.N., and E.-O. Czempiel. 1992. Governance without government: Order and
change in world politics. Cambridge: Cambridge University Press.
Rowe, G., and L.J. Frewer. 2000. Public participation methods: A framework for evaluation.
Science, Technology & Human Values 225, no. 1: 3–29.
Santos, S.L., and C. Chess. 2003. Evaluating citizen advisory boards: The importance of theory
and participant-based criteria and practical implications. Risk Analysis 23, no. 2: 269–79.
Schön, D.A. 1983. The reflective practitioner: How professionals think in action. New York:
Basic Books.
Slovic, P. 1987. Perception of risk. Science 236, no. 4799: 280–5.
Slovic, P. 2000. The perception of risk. London/Sterling, VA: Earthscan.
Slovic, P., B. Fischhoff, and S. Lichtenstein. 1980. Facts and fears: Understanding perceived
risks. In Societal risk assessment: How safe is safe enough?, ed. R. Schwing and J.W.
Albers, 181–214. New York: Plenum Press.
Soneryd, L. 2007. Deliberations on the unknown, the unsensed, and the unsayable? Public
protests and the development of third-generation mobile phones in Sweden. Science,
Technology & Human Values 32, no. 3: 287–314.
Steelman, T., and W. Ascher. 1997. Public involvement methods in natural resource policy
making: Advantages, disadvantages and tradeoffs. Policy Sciences 30, no. 2: 71–90.
Stern, P.C., and H.V. Fineberg. 1996. Understanding risk: Informing decisions in a
democratic society. Washington, DC: US National Research Council.
Stern, R.E. 2000. New approaches to urban governance in Latin America. Paper presented at
the seminar IDRC and management of sustainable urban development in Latin America:
Lessons learnt and demands for knowledge, 6–7 April, in Montevideo, Uruguay.
Stirling, A. 1998. Risk at a turning point? Journal of Risk Research. 1, no. 2: 97–109.
Stirling, A. 2003. Risk, uncertainty and precaution: Some instrumental implications from the
social sciences. In Negotiating change, ed. F. Berkhout, M. Leach, and I. Scoones, 37–76.
London: Edward Elgar.
Stirling, A. 2004. Opening up or closing down: Analysis, participation and power in the social
appraisal of technology. In Science, citizenship and globalisation, ed. M. Leach, I.
Scoones, and B. Wynne, 218–31. London: Zed.
Stirling, A. 2007. Risk assessment in science: Towards a more constructive policy debate.
EMBO Reports 8: 309–15.
Stoll-Kleemann, S., and M. Welp, eds. 2006. Stakeholder dialogues in natural resources
management: Theory and practice. Heidelberg/Berlin: Springer.
Tesh, S.N. 1988. Uncertain hazards: Environmental activists and scientific proof. Repr.,
Ithaca, NY: Cornell University Press, 2000.
Thompson, M., R. Ellis, and A. Wildavsky. 1990. Cultural theory. Boulder, CO: Westview
Press.
US National Research Council of the National Academies. 2008. Public participation in envi-
ronmental assessment and decision making. Washington, DC: National Academies Press.
van Asselt, M.B.A. 2000. Perspectives on uncertainty and risk. Dordrecht/Boston, MA:
Kluwer Academic.
van Asselt, M.B.A. 2005. The complex significance of uncertainty in a risk era: Logics,
manners and strategies in use. International Journal for Risk Assessment and Manage-
ment 5, nos. 2–4: 125–58.
van Asselt, M.B.A. 2007. Risk governance: Over omgaan met onzekerheid en mogelijke
toekomsten [Risk governance: Dealing with uncertainty and possible futures]. Inaugural
lecture. Maastricht: Universiteit Maastricht.
Journal of Risk Research 449
van Asselt, M.B.A., S.A. van ‘t Klooster, P.W.F. van Notten, and L.A. Smits. 2010. Foresight
in action: Developing policy-oriented scenarios. London: Earthscan.
van Asselt, M.B.A., and E. Vos. 2006. The precautionary principle and the uncertainty
paradox. Journal of Risk Research 9, no. 4: 313–36.
van Asselt, M.B.A., and E. Vos. 2008. Wrestling with uncertain risks: EU regulation of
GMOs and the uncertainty paradox. Journal of Risk Research 11, nos. 1–2: 281–300.
Versluis, E. 2003. Enforcement matters: Enforcement and compliance of European directives
in four member states. Delft: Eburon.
Vos, E. 2000. EU food safety regulation in the aftermath of the BSE crisis. Journal of
Consumer Policy 23: 227–55.
Walls, J., T. O’Riordan, T. Horlick-Jones, and J. Niewöhner. 2005. The meta-governance of
risk and new technologies: GM crops and mobile phones. Journal of Risk Research 8,
nos. 7–8: 635–61.
Wiedemann, P.M., and S. Femers. 1993. Public participation in waste management
decision-making: Analysis and management of conflict. Journal of Hazardous Materials
33: 355–68.
Wolf, K.D. 2002. Contextualizing normative standards for legitimate governance beyond the
state. In Participatory governance: Political and societal implications, ed. J.R. Grote and
B. Gbikpi, 35–50. Opladen: Leske und Budrich.
WRR – Scientific Council for Government Policy. 2009. Uncertain safety: Allocating respon-
sibilities for safety. Amsterdam: Amsterdam University Press.
Wynne, B. 1980. Technology, risk and participation: On the social treatment of uncertainty. In
Society, technology and risk assessment, ed. J. Conrad, 173–208. Burlington, MA:
Academic Press.
Wynne, B. 1982. Rationality and ritual: The windscale inquiry and nuclear decisions in
Britain. Chalfont St. Glies: British Society for the History of Science.
Wynne, B. 2001. Creating public alienation: Expert cultures of risk and ethics on GMOs.
Science as Culture 10, no. 4: 445–81.
Wynne, B. 2002. Risk and environment as legitimatory discourses of technology: Reflexivity
inside out? Current Sociology 50, no. 30: 459–77.
Wynne, B. 2010. Rationality and ritual: Participation and exclusion in nuclear decision-
making. London: Earthscan.
Zinn, J.O., and P. Taylor-Gooby. 2006. Risk as an interdisciplinary research area. In Risk in
social science, ed. P. Taylor-Gooby and J. Zinn, 20–53. Oxford: Oxford University Press.