Chapter Five:

Immersive Techs or Extended Reality (XR)

Prepared by : Surafiel H.
Department of Computer Science,
Addis Ababa University
December, 2021
 Introduction
• Immersive technologies encompass a range of tools that allow users to interact seamlessly
with blended realities, integrating virtual content with the physical environment.

• These technologies create unique experiences by merging the physical world with digital or
simulated realities.

• Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) are the main
categories within immersive technologies, sharing many common attributes.

• Nonetheless, AR overlays computer-generated information onto the user's actual

environment, whereas VR employs computer-generated information to deliver a complete
sense of immersion.
2
Overview of AR, VR, and MR

https://www.youtube.com/watch?v=E0QLVj9FJ0A&ab_channel=ScienceTime
3
 Overview of Augmented Reality (AR)
• The fundamental idea of Augmented reality (AR) is to combine, or mix, the view of the
real environment with additional, virtual content that is presented through computer
graphics.

• It’s the view of the real environment with the additional virtual content or digital object
that is presented through computer graphics.
✓ Computer graphics is the use of computers to create and manipulate pictures on a

display device

• AR allows users to overlay computer- generated content in the real world.

• It’s the integration of digital information with the user's environment in real-time.
4
• In Augmented Reality, users see and interact with the real world while digital content is
added to it.

5
• By using AR, the information about the surrounding real world becomes interactive and
digitally usable.

• Through augmented vision, a user can digitally interact with and adjust information
about their surrounding environment.

6
 Overview of Virtual Reality (VR)
• Virtual Reality (VR) provides a profoundly immersive experience, effectively
deceiving your senses into perceiving a distinct environment or world that is separate
from reality.

• Users are immersed in entirely artificial (synthetic) environments, also known as

computer-simulated reality.

7
• The fully immersive experience in VR is primarily achieved through the use of a Head-

Mounted Display (HMD) or headset.

• By donning such devices, you are transported into a computer-generated realm of

visuals and sounds, within which you have the ability to manipulate objects and

navigate through the environment.

8
9
 Overview of Mixed Reality (MR)
• Merging real and virtual worlds to create new environments and visualizations.
• Physical and digital objects coexist and interact in real-time.
• Also known as hybrid reality.
• Combines elements of Virtual Reality (VR) and Augmented Reality (AR).
• Enables dynamic interactions between digital and physical components.
• Offers a spectrum of experiences from physical to virtual.
• Potential to revolutionize education, design, entertainment, and collaboration.

https://www.youtube.com/watch?v=e-n90xrVXh8&ab_channel=CNET
10
11
12
 Key Differences
• AR enhances real-world views with digital overlays for interactive information.

• VR immerses users in entirely computer-generated environments, enhancing presence and

interaction.

• MR blends real and virtual worlds, enabling dynamic interactions between physical and
digital components in real-time.

13
14
 Head-Mounted Display (HMD)
• A display device worn on the head or as part of a helmet.
• Types:
✓ Monocular HMD: Single display optic in front of one eye.
✓ Binocular HMD: Two display optics in front of both eyes.

• Components: Includes small displays, lenses, and semi-transparent

mirrors.
• Display Capabilities:
✓ Virtual Imagery: Most HMDs display computer-generated imagery (CGI).
✓ Live Imagery: Some HMDs display live imagery from the physical world.
✓ AR and MR: HMDs can superimpose CGI on the real-world view.

15
16
• Combining Real and Virtual Worlds:
✓ Optical See-Through: Combines real-world view and CGI through a partially reflective
mirror.

✓ Video See-Through: Combines real-world view and CGI electronically using a camera.

• Applications:

✓ Gaming,

✓ Aviation,

✓ Engineering,

✓ Medicine, and so on.

17
 Challenges of HMD
• Ergonomics:

➢ The study of designing equipment and devices to fit the human body's natural movements
and capabilities, aiming to improve comfort, efficiency, and safety.

➢ Ergonomics in HMDs: The challenge of designing HMDs to be comfortable and easy to wear
for extended periods, considering factors like weight, fit, balance, and strain on the eyes and
neck.

• High prices

• Limited mobility due to size and connectivity

• Depth perception and multiple interaction points make interacting with virtual zones difficult.

18
 Alternatives of HMD
• Monitors: Indirect view; users don't look directly into the mixed world.

• Tablets: Direct view by pointing the camera at the scene.

19
 The Architecture of AR Systems
• Early ARS built upon three key components:

1. Infrastructure Tracker Unit

2. Processing Unit

3. Visual Unit

20
21
• The Infrastructure Tracker Unit collects real-world data, which is then

processed by the Processing Unit.

• The Processing Unit integrates virtual and real content and transmits the

result to the Video Out module of the Visual Unit.

• Visual Unit: Categorized into two system types based on visualization

technology, video see-through and optical see-through.

22
• Video see-through: Utilizes a Head-Mounted Display (HMD) with video-

mixing capability, projecting merged images on a closed-view HMD.

• Optical see-through: Relies on an HMD equipped with optical combiners to

merge images within an open-view HMD.

23
 Additional Considerations on AR System Design
• AR systems have evolved significantly, incorporating advanced components for
enhanced performance and features.

• Key considerations for modern AR system design include:

• Hardware Integration: Modern AR systems may include advanced sensors, improved

optics, and lightweight, ergonomic designs to enhance user comfort and experience.

• Software Advancements: The integration of AI and machine learning algorithms can

improve object recognition, tracking, and interaction within AR environments.

• Connectivity: High-speed, low-latency connectivity, such as 5G, enables more responsive

and immersive experiences, particularly for collaborative and remote applications.
24
• User Interface (UI) and User Experience (UX): Designing intuitive and user-friendly
interfaces is crucial for widespread adoption. This includes natural gesture recognition,
voice commands, and adaptive interfaces that respond to user behavior.

• Interoperability: Ensuring that AR systems can seamlessly integrate with other devices and
platforms enhances their versatility and usability across different applications and
industries.

• Security and Privacy: As AR systems often collect and process sensitive data, robust
security measures and privacy protections are essential to safeguard user information.

• Power Efficiency: Advances in battery technology and power management are critical for
extending the usage time of mobile AR devices.

25
 Application of AR Systems
• AR has the potential to revolutionize numerous fields, ranging from education and

medicine to entertainment and military applications.

• By seamlessly merging the digital and physical realms, AR opens up a realm of

possibilities.

26
 AR in Education
• Augmented reality offers adaptable educational possibilities.

• It can be used on various platforms: desktops, mobile devices, and smartphones.

• AR technology is versatile and portable, suitable for different scenarios.

• Applications in education include enhancing classroom content, supporting special

education, extending learning beyond the classroom, and combining with other
technologies.

27
28
 Key Reasons for Using AR in Education
• Affordable learning materials: AR technology replaces costly physical materials.
• Interactive lessons: Students engage with AR models on personal devices, reinforcing
understanding.
• Higher engagement: Integrating AR captures student interest and enhances lesson
effectiveness.
• Improved retention: AR's multisensory approach leads to better knowledge retention.
• Fostering intellectual curiosity: AR excites modern learners and promotes critical
thinking.
• AR creates an authentic learning environment catering to diverse learning styles

29
Affordable learning materials

30
Interactive lessons

31
Higher engagement

32
Higher Retention

33
Boost intellectual curiosity

34
 AR in Medicine
• Augmented reality (AR) is transforming industries, including healthcare and medical
education, by simplifying tasks and enhancing efficiency.

• AR has quickly found its place in medical routines for doctors, nurses, and patients,
contributing to safety and effectiveness.

35
 Applications of AR in Medicine
• Surgery (Minimally Invasive Surgery): AR aids in surgeries by providing three-
dimensional organ or tumor reconstructions, improving efficiency and results.

• Startups like Augmedics offer AR headsets for spine surgeons, overlaying 3D models
on real spines for enhanced visualization.

• Education of Future Doctors: AR technology enhances medical education, providing

immersive learning experiences and visualizations for future doctors.

• Diagnostics: AR tools can aid in diagnosing conditions like depression and other
mental illnesses by analyzing facial expressions, voice tones, and gestures.
36
37
• Describing Symptoms: Medical apps like AyeDecide use AR to simulate vision

impaired by diseases, helping patients better understand and describe their symptoms.

38
• Nursing Care: AccuVein employs AR to display patients' veins on their skin,
increasing the success rate of intravenous injections..

39
• Ultrasounds: AR software turns smart glasses into ultrasound scanners, offering
potential benefits in developing countries, military medicine, and emergency situations.

40
• Diabetes Management: Google's smart contact lens aims to measure glucose levels in
tears, easing the lives of those with diabetes.

41
• Navigation: AR navigation apps provide information about nearby objects of interest,
including hospitals and automated external defibrillators (AEDs).

42
 Benefits of AR in Medicine
• Minimally Invasive Surgery: Reduces risks associated with surgery, improves
efficiency.

• Informed Decisions: Facilitates better treatment decisions and illness prevention

strategies.

• Patient Experience: Makes medical procedures more tolerable and improves aftercare.

• Medical Training: Enhances medical education and training experiences.

• Procedural Assistance: Supports medical procedures and routine tasks.

43
Application of AR in Entertainment

44
• AR in games:

✓ ARgames encourage physical activity and

movement, exemplified by games like
Pokémon GO.

✓ Concerns arise about potential accidents

due to players being overly absorbed in
AR games.

✓ Pokémon GO has popularized the concept

of AR gaming.

45
• AR in music:

✓ AR complements music by providing

additional context and information
about songs and artists.

✓ Enhances live music performances by

visually illustrating the story behind a
song or its creation process.

46
• AR on TV:

✓ Experiments are underway to integrate AR into television programming.

✓ AR on TV can offer supplementary information like match scores and betting

options.

47
• AR in eSports:

✓ AR transforms eSports into interactive experiences for viewers.

✓ Watchers can actively engage and participate in the eSports shows, blurring the
line between audience and participants.

48
• AR in the Theater:
✓ AR serves both entertainment and accessibility purposes in theater.
✓ Virtual objects can be overlaid on the real environment, aiding in subtitling for translation
or assisting hearing-impaired attendees.
✓ AR provides an alternative to traditional LED displays used for subtitling, reducing
distractions during performances.

49
More videos:
https://www.youtube.com/watch?v=XLP4YTpUpBI&t=2s&ab_channel=Simplile
arn
https://www.youtube.com/watch?v=ZFTgGi06vbM&t=231s&ab_channel=edurek
a%21
https://www.youtube.com/watch?v=f9MwaH6oGEY

https://www.youtube.com/watch?v=IEzaFR_X35U

https://www.youtube.com/watch?v=2zsIXVqxbuc

https://www.youtube.com/watch?v=AJJOWemfOYI