Skip to main content

Carey Jewitt

UCL Institute of Education, Culture, Communication and Media, Faculty Member

Followers

42

Following

4

Co-authors

3

Public Views

Carey Jewitt is Professor of Digital Technology at UCL Knowledge Lab, University College London. Her research interests centre on multimodal and multisensorial approaches to digital interaction, and methodological innovation. Carey is PI of the IN-TOUCH project, an ERC Consolidator Award, that explores the social implications of digitally mediated touch for communication <in-touch-digital.com>

less

Matthew Wolf-Meyer

Rensselaer Polytechnic Institute

Universidade Estadual de Campinas

York University

Caroline J . Tully

University of Melbourne

Ignacio Farías

Humboldt Universität zu Berlin

Pontificia Universidad Catolica de Chile

École Normale Supérieure de Lyon

Yurij Castelfranchi

UFMG - The Federal University of Minas Gerais

KU Leuven

Lars Gertenbach

University of Kassel

Interests

Uploads

Papers by Carey Jewitt

The Making of Meaning through Dyadic Haptic Affective Touch

ACM Transactions on Computer-Human Interaction

Despite the importance of touch in human–human relations, research in affective tactile practices... more Despite the importance of touch in human–human relations, research in affective tactile practices is in its infancy, lacking in-depth understanding needed to inform the design of remote digital touch communication. This article reports two qualitative studies that explore tactile affective communication in specific social contexts, and the bi-directional creation, sending and interpretation of digital touch messages using a purpose-built research tool, the Tactile Emoticon. The system comprises a pair of remotely connected mitts, which enable users in different locations to communicate through tactile messages, by orchestrating duration and level of three haptic sensations: vibration, pressure and temperature. Qualitative analysis shows the nuanced ways in which 68 participants configured these elements to make meaning from touch messages they sent and received. It points to the affect and emotion of touch, its sensoriality and ambiguity, the significance of context, social norms an...

Supporting novice designers design of digital touch

International Journal of Technology and Design Education

Digitally mediated touch is an emerging and significant area for technology and therefore for des... more Digitally mediated touch is an emerging and significant area for technology and therefore for design and design education. However, the design of digital touch is a challenge, especially for novice designers, compounded by low awareness and understanding of the sociality of touch and the complexity of communicating felt sensations. This paper presents a qualitative study of a two-part educational intervention on the design of digital touch using a design-based research methodology. Findings are presented and discussed on the design challenges faced by novice designers in relation to touch and digital touch (the focus of part one of the intervention) and the development and piloting of the Designing Digital Touch (DDT) toolkit (the outcome of part two). The paper discusses how the toolkit can be used to foster and support novice designers to respond to the future facing complexity of digital touch design.

Closing Thoughts, Insights and Resources for Digital Touch Communication Research and Design

Human–Computer Interaction Series, 2019

This chapter closes the book with a note on thematic directions, in response to the speculative a... more This chapter closes the book with a note on thematic directions, in response to the speculative and emergent character of digital touch communication, signalling our desire and need to keep the conversation open. We point to the significance of a social take on digital touch, particularly with reference to the types of questions this perspective raises and the way it positions technology in relation to people and society more generally. We draw attention to the research insights on digital touch communication discussed throughout the book that may inform design. Finally, we comment on the theoretical and methodological routes that we have taken to research digital touch communication, and draw on the ideas and research presented in this book to sketch an emergent research and design framework for digital touch communication.

Multimodal approaches to video analysis of digital learning environments

Contemporary digital learning environments, such as tangibles, mobile and sensor-based technologi... more Contemporary digital learning environments, such as tangibles, mobile and sensor-based technologies are inherently multimodal, both in terms of representation modalities and interaction modes. Drawing on social semiotics, multimodality offers a valuable approach for analysing video data, as it systematically attends to the interpretation of a wide range of communicational forms (e.g. gaze, posture, action, speech) used for making meaning. This paper explores a multimodal approach to video data in the context of ubiquitous technologies for learning.

Mobile Experiences of Historical Place: A Multimodal Analysis of Emotional Engagement

Journal of the Learning Sciences, 2015

This paper explores how to research the opportunities for emotional engagement that mobile techno... more This paper explores how to research the opportunities for emotional engagement that mobile technologies provide for the design and enactment of learning environments. In the context of mobile technologies that foster location based linking, we make the case for the centrality of in-situ real-time observational research on how emotional engagement unfolds and for the inclusion of bodily aspects of interaction. We propose that multimodal methods offer tools for observing emotion as a central facet of personenvironment interaction, and provide an example of these methods put into practice for a study of emotional engagement in mobile history learning. A multimodal analysis of video data from sixteen pairs of 9-10 year olds learning about the WWII history of their local Common is used to illustrate how students' emotional engagement was supported by their use of mobile devices through: multimodal layering and linking of stimuli; the creation of digital artefacts, and changes in pace. These findings are significant for understanding the role of digital augmentation in fostering emotional engagement in history learning; informing how digital augmentation can be designed to effectively foster emotional engagement for learning; and provide insight into the benefits of multimodality as an analytical approach for examining emotion through bodily interaction.

Creative Probes, Proxy Feelers, and Speculations on Interactive Skin

Multimodal Technologies and Interaction, 2022

This paper critically discusses the combination of creative and social research methods to genera... more This paper critically discusses the combination of creative and social research methods to generate a novel approach to explore the multimodal technoscape. This paper draws on an interdisciplinary exploratory case study on interactive skin—an emergent technology that augments and/or interacts with the skin. This paper shows how concepts from skin studies and the HCI literature can be used to draw on creative methods to think about and with the body. We describe the use of an online probe pack, a speculative research workshop and sensory research interviews using ‘proxy feelers’ to agitate the design space of interactive skin futures. We show how combining these methods provoked and expanded the scope of interactive skin from the technological to the sensory and the social. We discuss the opportunities and challenges of the research dialogues that this approach facilitated, make the case for creative methodological improvisation and exploration of emergent technologies and show how c...

Screens and the Social Landscape: Digital Design, Representation, Communication and Interaction

Becoming in Touch with Industrial Robots through Ethnography

by Ned Barker and Carey Jewitt

Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020

Touch is central to communication and social interaction. For both humans and robots touch is a m... more Touch is central to communication and social interaction. For both humans and robots touch is a mode through which they sense the world. A second wave of industrial robots is reshaping how touch operates within the labor process. Recent studies have turned their attention to the role of touch in Human-Robot Interaction (HRI). While these studies have produced useful knowledge in relation to the affective capacities of robotic touch, methods remain restrictive. This paper contributes to expanding research methods for the study of robotic touch. It reports on the design of an ongoing ethnography that forms part of the InTouch project. The interdisciplinary project takes forward a socially orientated stance and is concerned with how technologies shape the semiotic and sensory dimensions of touch in the 'real world'. We contend that these dimensions are key factors in shaping how humans and robots interact, yet are currently overlooked in the HRI community. This multi-sited sens...

Digital Touch Ethics and Values

Human–Computer Interaction Series

This chapter examines key ethical considerations and challenges of designing and researching touc... more This chapter examines key ethical considerations and challenges of designing and researching touch technologies, with a focus on incorporating ethical touch sensitivities and values into digital touch communication. We discuss the difficulty of researching and designing ethically in the context of an emerging technological landscape, as reflected in wider HCI ethics debate. The chapter then explores the central role of the human body as site for digital touch communication, before focusing on key challenges around trust, control, consent, and tactile data. In line with preceding chapters, we argue that digital touch practices are part of, and impact on, wider social relations and communications. The kinds of touch practices and relations designed into touch technologies bring with them implications for power relations and social cohesion, and it is these wider processes that digital touch design is able to-at least in parts-anticipate and shape. We close with a summary of key points and their implications for research and design.

Taking an Extended Embodied Perspective of Touch: Connection-Disconnection in iVR

by Ned Barker and Carey Jewitt

Bringing touch into VR experiences through haptics is considered increasingly important for user ... more Bringing touch into VR experiences through haptics is considered increasingly important for user engagement and fostering feelings of presence and immersion, yet few qualitative studies have explored users' iVR touch experiences. This paper takes an embodied approach–bringing attention to the tactile-kinaesthetic body–to explore users' wholistic experiences of touch in iVR, moving beyond the cutaneous and tactile elements of “feeling” to elaborate upon themes of movement and kinetics. Our findings show how both touch connections and disconnections emerged though material forms of tactility (the controller, body positioning, tactile expectations) and through “felt proximities” and the tactile-kinaesthetic experience thus shaping the sense of presence. The analysis shows three key factors that influence connection and disconnection, and how connection is re-navigated or sought at moments of experienced disconnection: a sense of control or agency; identity; and bridging between...

Using a social semiotic approach to multimodality : researching learning in schools, museums and hospitals

The aim of this paper is to show how a substantive area of social research –learning– can be inve... more The aim of this paper is to show how a substantive area of social research –learning– can be investigated using a multimodal social semiotic approach. We apply the approach to three different institutions – a school, a museum and a hospital, illustrating key concepts and addressing issues around pedagogy and technology in contemporary society. A multimodal social semiotic approach focuses on meaning-making, in all modes. It is a theoretical perspective that brings all socially organized resources that people use to make meaning into one descriptive and analytical domain. These resources include modes such as image, writing, gesture, gaze, speech, posture; and media such as screens, 3 D forms of various kinds, books, notes and notebooks. All of these modes and media are also used in environments designed for learning. That makes a multimodal social semiotic approach particularly apt for studying learning.

Filtering Touch: An Ethnography of Dirt, Danger, and Industrial Robots

Journal of Contemporary Ethnography, 2021

“Industry 4.0” marks the advent of a new wave of industrial robotics designed to bring increased ... more “Industry 4.0” marks the advent of a new wave of industrial robotics designed to bring increased automation to “extreme” touch practices and enhance productivity. This article presents an ethnography of touch in two industrial settings using fourth generation industrial robots (a Glass Factory and a Waste Management Center) to critically explore the social and sensorial implications of such technologies for workers. We attend to manifestations of dirt and danger as encountered through describing workers’ sensory experiences and identity formation. The contribution of the article is two-fold. The first is analytical through the development of three “filters” to grasp the complexity of the social and sensorial dynamics of touch in situ while tracing dispersed mediating effects of the introduction of novel technologies. The second is empirical, teasing out themes embedded in the sociosensorial dynamics of touch that intersect with gender, ethnicity, and class and relate to the technological mediation of touch.

Managing time and space in the new english classroom

Only write down what you need to know: Annotation for what?

Methodological synergies across the arts and social science

A multimodal framework for computer mediated learning : the reshaping of curriculum knowledge and learning

Talk, action, and visual communication in teaching and learning science

The School science review, 2003

This article focuses on the ways in which a teacher works to develop some shared understanding of... more This article focuses on the ways in which a teacher works to develop some shared understanding of the concept of magnetic field with a class of year 8 pupils. Specifically, it explores how the teacher uses talk, visual communication, and demonstration to move from the phenomenon (i.e. iron filings and magnets) to the scientific theory of magnetic field. Through the analysis a number of fundamental issues relating to science teaching and learning are raised and discussed.

The pedagogic construction of ‘ability’ in school English

Multimodal Methodologies for Researching Digital Data and Environments (MODE) [IOE Research Briefing N°91]

The MODE project aims to provide systematic ways to investigate all modes of communication within... more The MODE project aims to provide systematic ways to investigate all modes of communication within digital environments, whether they are sites of learning, work, or social networking sites. It is developing multimodal methodologies that look beyond language at other forms of communication and interaction (e.g. visual, auditory, and bodily) to address contemporary questions about the increasingly digital environments within which social scientists practice and research today. IOE Research Briefings are short descriptions of significant research findings, based on the wide range of projects carried out by IOE researchers.

Becoming in Touch with Industrial Robots through Ethnography

Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020

Touch is central to communication and social interaction. For both humans and robots touch is a m... more Touch is central to communication and social interaction. For both humans and robots touch is a mode through which they sense the world. A second wave of industrial robots is reshaping how touch operates within the labor process. Recent studies have turned their attention to the role of touch in Human-Robot Interaction (HRI). While these studies have produced useful knowledge in relation to the affective capacities of robotic touch, methods remain restrictive. This paper contributes to expanding research methods for the study of robotic touch. It reports on the design of an ongoing ethnography that forms part of the InTouch project. The interdisciplinary project takes forward a socially orientated stance and is concerned with how technologies shape the semiotic and sensory dimensions of touch in the 'real world'. We contend that these dimensions are key factors in shaping how humans and robots interact, yet are currently overlooked in the HRI community. This multi-sited sens...

The Making of Meaning through Dyadic Haptic Affective Touch

ACM Transactions on Computer-Human Interaction

Despite the importance of touch in human–human relations, research in affective tactile practices... more Despite the importance of touch in human–human relations, research in affective tactile practices is in its infancy, lacking in-depth understanding needed to inform the design of remote digital touch communication. This article reports two qualitative studies that explore tactile affective communication in specific social contexts, and the bi-directional creation, sending and interpretation of digital touch messages using a purpose-built research tool, the Tactile Emoticon. The system comprises a pair of remotely connected mitts, which enable users in different locations to communicate through tactile messages, by orchestrating duration and level of three haptic sensations: vibration, pressure and temperature. Qualitative analysis shows the nuanced ways in which 68 participants configured these elements to make meaning from touch messages they sent and received. It points to the affect and emotion of touch, its sensoriality and ambiguity, the significance of context, social norms an...

Supporting novice designers design of digital touch

International Journal of Technology and Design Education

Digitally mediated touch is an emerging and significant area for technology and therefore for des... more Digitally mediated touch is an emerging and significant area for technology and therefore for design and design education. However, the design of digital touch is a challenge, especially for novice designers, compounded by low awareness and understanding of the sociality of touch and the complexity of communicating felt sensations. This paper presents a qualitative study of a two-part educational intervention on the design of digital touch using a design-based research methodology. Findings are presented and discussed on the design challenges faced by novice designers in relation to touch and digital touch (the focus of part one of the intervention) and the development and piloting of the Designing Digital Touch (DDT) toolkit (the outcome of part two). The paper discusses how the toolkit can be used to foster and support novice designers to respond to the future facing complexity of digital touch design.

Closing Thoughts, Insights and Resources for Digital Touch Communication Research and Design

Human–Computer Interaction Series, 2019

This chapter closes the book with a note on thematic directions, in response to the speculative a... more This chapter closes the book with a note on thematic directions, in response to the speculative and emergent character of digital touch communication, signalling our desire and need to keep the conversation open. We point to the significance of a social take on digital touch, particularly with reference to the types of questions this perspective raises and the way it positions technology in relation to people and society more generally. We draw attention to the research insights on digital touch communication discussed throughout the book that may inform design. Finally, we comment on the theoretical and methodological routes that we have taken to research digital touch communication, and draw on the ideas and research presented in this book to sketch an emergent research and design framework for digital touch communication.

Multimodal approaches to video analysis of digital learning environments

Contemporary digital learning environments, such as tangibles, mobile and sensor-based technologi... more Contemporary digital learning environments, such as tangibles, mobile and sensor-based technologies are inherently multimodal, both in terms of representation modalities and interaction modes. Drawing on social semiotics, multimodality offers a valuable approach for analysing video data, as it systematically attends to the interpretation of a wide range of communicational forms (e.g. gaze, posture, action, speech) used for making meaning. This paper explores a multimodal approach to video data in the context of ubiquitous technologies for learning.

Mobile Experiences of Historical Place: A Multimodal Analysis of Emotional Engagement

Journal of the Learning Sciences, 2015

This paper explores how to research the opportunities for emotional engagement that mobile techno... more This paper explores how to research the opportunities for emotional engagement that mobile technologies provide for the design and enactment of learning environments. In the context of mobile technologies that foster location based linking, we make the case for the centrality of in-situ real-time observational research on how emotional engagement unfolds and for the inclusion of bodily aspects of interaction. We propose that multimodal methods offer tools for observing emotion as a central facet of personenvironment interaction, and provide an example of these methods put into practice for a study of emotional engagement in mobile history learning. A multimodal analysis of video data from sixteen pairs of 9-10 year olds learning about the WWII history of their local Common is used to illustrate how students' emotional engagement was supported by their use of mobile devices through: multimodal layering and linking of stimuli; the creation of digital artefacts, and changes in pace. These findings are significant for understanding the role of digital augmentation in fostering emotional engagement in history learning; informing how digital augmentation can be designed to effectively foster emotional engagement for learning; and provide insight into the benefits of multimodality as an analytical approach for examining emotion through bodily interaction.

Creative Probes, Proxy Feelers, and Speculations on Interactive Skin

Multimodal Technologies and Interaction, 2022

This paper critically discusses the combination of creative and social research methods to genera... more This paper critically discusses the combination of creative and social research methods to generate a novel approach to explore the multimodal technoscape. This paper draws on an interdisciplinary exploratory case study on interactive skin—an emergent technology that augments and/or interacts with the skin. This paper shows how concepts from skin studies and the HCI literature can be used to draw on creative methods to think about and with the body. We describe the use of an online probe pack, a speculative research workshop and sensory research interviews using ‘proxy feelers’ to agitate the design space of interactive skin futures. We show how combining these methods provoked and expanded the scope of interactive skin from the technological to the sensory and the social. We discuss the opportunities and challenges of the research dialogues that this approach facilitated, make the case for creative methodological improvisation and exploration of emergent technologies and show how c...

Screens and the Social Landscape: Digital Design, Representation, Communication and Interaction

Becoming in Touch with Industrial Robots through Ethnography

by Ned Barker and Carey Jewitt

Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020

Touch is central to communication and social interaction. For both humans and robots touch is a m... more Touch is central to communication and social interaction. For both humans and robots touch is a mode through which they sense the world. A second wave of industrial robots is reshaping how touch operates within the labor process. Recent studies have turned their attention to the role of touch in Human-Robot Interaction (HRI). While these studies have produced useful knowledge in relation to the affective capacities of robotic touch, methods remain restrictive. This paper contributes to expanding research methods for the study of robotic touch. It reports on the design of an ongoing ethnography that forms part of the InTouch project. The interdisciplinary project takes forward a socially orientated stance and is concerned with how technologies shape the semiotic and sensory dimensions of touch in the 'real world'. We contend that these dimensions are key factors in shaping how humans and robots interact, yet are currently overlooked in the HRI community. This multi-sited sens...

Digital Touch Ethics and Values

Human–Computer Interaction Series

This chapter examines key ethical considerations and challenges of designing and researching touc... more This chapter examines key ethical considerations and challenges of designing and researching touch technologies, with a focus on incorporating ethical touch sensitivities and values into digital touch communication. We discuss the difficulty of researching and designing ethically in the context of an emerging technological landscape, as reflected in wider HCI ethics debate. The chapter then explores the central role of the human body as site for digital touch communication, before focusing on key challenges around trust, control, consent, and tactile data. In line with preceding chapters, we argue that digital touch practices are part of, and impact on, wider social relations and communications. The kinds of touch practices and relations designed into touch technologies bring with them implications for power relations and social cohesion, and it is these wider processes that digital touch design is able to-at least in parts-anticipate and shape. We close with a summary of key points and their implications for research and design.

Taking an Extended Embodied Perspective of Touch: Connection-Disconnection in iVR

by Ned Barker and Carey Jewitt

Bringing touch into VR experiences through haptics is considered increasingly important for user ... more Bringing touch into VR experiences through haptics is considered increasingly important for user engagement and fostering feelings of presence and immersion, yet few qualitative studies have explored users' iVR touch experiences. This paper takes an embodied approach–bringing attention to the tactile-kinaesthetic body–to explore users' wholistic experiences of touch in iVR, moving beyond the cutaneous and tactile elements of “feeling” to elaborate upon themes of movement and kinetics. Our findings show how both touch connections and disconnections emerged though material forms of tactility (the controller, body positioning, tactile expectations) and through “felt proximities” and the tactile-kinaesthetic experience thus shaping the sense of presence. The analysis shows three key factors that influence connection and disconnection, and how connection is re-navigated or sought at moments of experienced disconnection: a sense of control or agency; identity; and bridging between...

Using a social semiotic approach to multimodality : researching learning in schools, museums and hospitals

The aim of this paper is to show how a substantive area of social research –learning– can be inve... more The aim of this paper is to show how a substantive area of social research –learning– can be investigated using a multimodal social semiotic approach. We apply the approach to three different institutions – a school, a museum and a hospital, illustrating key concepts and addressing issues around pedagogy and technology in contemporary society. A multimodal social semiotic approach focuses on meaning-making, in all modes. It is a theoretical perspective that brings all socially organized resources that people use to make meaning into one descriptive and analytical domain. These resources include modes such as image, writing, gesture, gaze, speech, posture; and media such as screens, 3 D forms of various kinds, books, notes and notebooks. All of these modes and media are also used in environments designed for learning. That makes a multimodal social semiotic approach particularly apt for studying learning.

Filtering Touch: An Ethnography of Dirt, Danger, and Industrial Robots

Journal of Contemporary Ethnography, 2021

“Industry 4.0” marks the advent of a new wave of industrial robotics designed to bring increased ... more “Industry 4.0” marks the advent of a new wave of industrial robotics designed to bring increased automation to “extreme” touch practices and enhance productivity. This article presents an ethnography of touch in two industrial settings using fourth generation industrial robots (a Glass Factory and a Waste Management Center) to critically explore the social and sensorial implications of such technologies for workers. We attend to manifestations of dirt and danger as encountered through describing workers’ sensory experiences and identity formation. The contribution of the article is two-fold. The first is analytical through the development of three “filters” to grasp the complexity of the social and sensorial dynamics of touch in situ while tracing dispersed mediating effects of the introduction of novel technologies. The second is empirical, teasing out themes embedded in the sociosensorial dynamics of touch that intersect with gender, ethnicity, and class and relate to the technological mediation of touch.

Managing time and space in the new english classroom

Only write down what you need to know: Annotation for what?

Methodological synergies across the arts and social science

A multimodal framework for computer mediated learning : the reshaping of curriculum knowledge and learning

Talk, action, and visual communication in teaching and learning science

The School science review, 2003

This article focuses on the ways in which a teacher works to develop some shared understanding of... more This article focuses on the ways in which a teacher works to develop some shared understanding of the concept of magnetic field with a class of year 8 pupils. Specifically, it explores how the teacher uses talk, visual communication, and demonstration to move from the phenomenon (i.e. iron filings and magnets) to the scientific theory of magnetic field. Through the analysis a number of fundamental issues relating to science teaching and learning are raised and discussed.

The pedagogic construction of ‘ability’ in school English

Multimodal Methodologies for Researching Digital Data and Environments (MODE) [IOE Research Briefing N°91]

The MODE project aims to provide systematic ways to investigate all modes of communication within... more The MODE project aims to provide systematic ways to investigate all modes of communication within digital environments, whether they are sites of learning, work, or social networking sites. It is developing multimodal methodologies that look beyond language at other forms of communication and interaction (e.g. visual, auditory, and bodily) to address contemporary questions about the increasingly digital environments within which social scientists practice and research today. IOE Research Briefings are short descriptions of significant research findings, based on the wide range of projects carried out by IOE researchers.

Becoming in Touch with Industrial Robots through Ethnography

Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020

Touch is central to communication and social interaction. For both humans and robots touch is a m... more Touch is central to communication and social interaction. For both humans and robots touch is a mode through which they sense the world. A second wave of industrial robots is reshaping how touch operates within the labor process. Recent studies have turned their attention to the role of touch in Human-Robot Interaction (HRI). While these studies have produced useful knowledge in relation to the affective capacities of robotic touch, methods remain restrictive. This paper contributes to expanding research methods for the study of robotic touch. It reports on the design of an ongoing ethnography that forms part of the InTouch project. The interdisciplinary project takes forward a socially orientated stance and is concerned with how technologies shape the semiotic and sensory dimensions of touch in the 'real world'. We contend that these dimensions are key factors in shaping how humans and robots interact, yet are currently overlooked in the HRI community. This multi-sited sens...

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Alternative Proxy