VIRTUAL SURGERY

Sherin N Sultana
Department of Computer Science and Engineering
M G College of Engineering
shereenslthn@gmail.com

Abstract — Rapid change is under way on several fronts in II. VIRTUAL SURGERY
medicine and surgery. Advance in computing power have enable
continued growth in virtual reality, visualization, and simulation Virtual surgery, in general is a Virtual Reality Technique of
technologies. The ideal learning opportunities afforded by simulating surgery procedure, which help Surgeons improve
simulated and virtual environments have prompted their surgery plans and practice surgery process on 3D models.
exploration as learning modalities for surgical education and
training. Ongoing improvements in this technology suggest an
In case of virtual surgery a simulated model of the human
important future role for virtual reality and simulation in
autonomy which looks, feel and respond like a real human
medicine.
body is created for the surgeon to operate on. The simulator
I. INTRODUCTION surgery results can be evaluated before the surgery is carried
out on real patient. This helps the surgeon to have clear
Rapid change in most segments of the society is occurring picture of the outcome of surgery. If the surgeon finds some
as a result of increasingly more sophisticated, affordable and errors, he can correct by repeating the surgical procedure as
ubiquitous computing power. One clear example of this many number of times and finalizing the parameters for good
change process is the internet, which provides interactive and surgical results.
instantaneous access to information that must scarcely
conceivable only a few years ago. The surgeon can also view the anatomy from wide range of
angles. This process, which cannot be done on a real patient in
Same is the case in the medical field. Adv in the surgery, helps the surgeon correct the incision, cutting,
instrumentation, visualisation and monitoring have enabled gain experience and therefore improve the surgical skills.
continual growth in the medical field. The information
revolution has enabled fundamental changes in this field. Of The virtual surgery is based on the patient specific model,
the many disciplines arising from this new information era, so when the real surgery takes place, the surgeon is already
virtual reality holds the greatest promise. The term virtual familiar with all the specific operations that are to be
reality was coined by Jaron Lanier, founded of VPL research, employed.
in the late 1980’s. Virtual reality is defined as human
computer interface that simulate realistic environments while
enabling participant interaction, as a 3D digital world that
accurately models actual environment, or simply as
cyberspace.

Virtual reality is just beginning to come to that threshold

level where we can begin using Simulators in Medicine the
way that the Aviation industry has been using it for the past 50
Years — to avoid errors.

In surgery, the life of the patient is of utmost importance

and surgeon cannot experiment on the patient body. VR
provide a good tool to experiment the various complications
arise during surgery. Fig 1 A implementation of virtual surgery

III. VIRTUAL REALITY APPLICATIONS IN SURGERY

 The highly visual and interactive nature of virtual surgery 1) It is interactive.
has proven to be useful in understanding complex 3D 2) An instructor presence is not necessary, so student’ can
structures and for training in visuospatial tasks. Virtual reality practice in their free moment.
application in surgery can be subdivided as follows:
3) Changes can be made that demonstrate variation in
A. TRAINING AND EDUCATION anatomy or disease state.
The similarities between pilots and surgeons 4) Simulated position and forces can be recorded to
responsibilities are striking; both must, be ready to manage compare with established performance matrices for
potentially life-threatening situations in dynamic, assessment and credentialing.
unpredictable environments. The long and successful use of 5) Students could also try different technique and loot at
flight simulation in air and space flight training has inspired tissues from perspective that would be impossible during
the application of this technology to surgical and education. real operations.

Traditionally, textbook images or cadavers were used for

B. SURGICAL PLANNING
training purposes, the former i.e. textbook images, limiting
one’s perspective of anatomical structures to 2D plane and the In traditional surgery planning, the surgeon calculates
latter, cadavers; limited in supply and generally allowing one- various parameters and procedure for surgery from his earlier
time use only. Today VR simulators are becoming the training experience and imagination. The surgeon does not have an
methods of choice in medical schools. Unlike textbook exact idea about the result of the surgery after it has been
examples, VR simulators allow users to view the anatomy performed. So the result of the surgery depends mainly on
from a wide range of angles and “fly through” organs to human factors. This leads to lots of errors and even to the risk
examine bodies from inside. of losing the life of the patients. The incorporation of the
virtual reality techniques helps in reducing the errors and plan
The experience can be highly interactive allowing students the surgery in the most reliable manner.
to strip away the various layers of tissues and muscles to
examine each organ separately. Unlike cadavers, VR models The virtual reality technology can serve as useful adjunct to
enable the user to perform a procedure countless times. traditional surgical planning techniques. Basic research in
Perhaps because of the number of complications resulting image processing and segmentation of computed tomography
from the uncontrolled growth of laparoscopic procedures in and magnetic resonance scans has enabled reliable 3D
early 1990’s many groups have pursed simulation of reconstruction of important anatomical structures. This 3D
minimally invasive and endoscopic procedures. Advances in imaging data have been used to further understand complex
tissue modeling, graphics and haptic instrumentation have anatomical relationships in specific patient prior to surgery
enabled the development of open abdominal and hollow-tube and also to examine and display the microsurgical anatomy of
anastomosis simulators. various internal operations.

3D reconstruction has proven particularly useful in

planning stereo-static and minimally invasive neurosurgical
procedures. Modeling of deformable facial tissues has enabled
simulations of tissue changes and the postoperative outcome
of craniofacial surgery. Other soft tissue application includes
planning Liver resection on a 3D deformable liver model with
aid of a virtual laparoscopic tool.

C. IMAGE GUIDANCE

The integration of advanced imaging technology, image

processing and 3D graphical capabilities has led to great
interest in image guided and computer-aided surgery.
Fig 2 Implementing Virtual Surgery for training and education
The application of computational algorithm and VR
Computer-based training has many potential advantages:
visualization to diagnostic imaging, preoperative surgical
planning and inter-operative surgical navigation is referred to segmentation methods like SNAKE’. The final model is
as Computer Aided Surgery. obtained by deforming the reference model with constraints
imposed by segmentation results. The image is digitally
Navigation in surgery relates on stereo-static principles, mapped on to the polygonal mesh representing whatever part
based on the ability to locate a given point using geometric of the body on organ is being examined. Each vortex of the
reference. Most of the work done in this field has been within polygon is assigned attributes like colour and reflectivity from
neurosurgery. It also proved useful in Robotic Surgery, a new the reference model.
technique in which surgeon remotely manipulate robotic tool
inside the patient body. In one case, we use intra operative For the user to interact with the graphics there must be
mapping of 3D image overlays on live video provides the software algorithms that can calculate the whereabouts of the
surgeon with something like ‘X-ray vision’. This has been virtual instrument and determines whether it has collided with
used in conjunction with an open MRI scan to allow precise, a body part or anything else. The other thing is, we should
updated views of deformable brain tissues. Other researchers have algorithms to solve how it looks or behave when the
have focused on applications for orthopedic procedures. body part is cut. We need models of how various tissues
Improvements in sensor and imaging technology should behave when cut, prodded, punctured and so on. Here VR
eventually allow updates of patient’s position and intra designers often portray the tissue as polygonal meshes that
operative shape changes in soft tissues with in reasonable time react like an array of masses connected by springs and
frame. dampers. The parameters of this model can then be tweaked to
match what a physician experiences during an actual
D. TELESURGERY procedure. To create graphic that move without flickering
collision detection and tissue deformation must be calculated
Tele-surgery allows surgeons to operate on people who are at least 30 times per second.
physically separated from themselves. This is usually done
through a master-slave robot, with imaging supplies through Advances in medical graphic allows ordinary medical scan
video cameras configured to provide a stereoscopic view. The of a patient anatomy be enhanced into virtual 3D views-a clear
surgeon relies on a 3D virtual representation of the patient and advantage for surgeon who preparing to do complicated
benefit from dexterity enhancement afforded by the robotic procedures. Scans from MRJ and CT produces a series of
apparatus’ prototype tele manipulator has been used to things slices of the anatomy divided into volume data point or
successfully perform basic vascular and urologic procedures voxels, these slices are restacked and turned into 3D images
in swine’s. More advanced system has been used to perform by a computer. These 3D images are color enhanced to
Coronary Anastomosis on exvivo swine hearts and in human highlight, say bone or blood vessels.
undergoing endoscopic Coronary Artery Bypass grafting.
B. TOUCH SIMULATION

IV. VIRTUAL SURGERY SIMULATION

The second step in the simulation of surgery is simulating
Virtual surgery is focused around the following haptic-touch sensation. Physicians rely a great deal on their
simulations. sense of touch for everything from routine diagnosis to
complex, life saving surgical procedure. So haptics, or the
A. 3D IMAGE SIMULATION ability to simulate touch, goes a long way to make virtual
reality simulators more life like.
The first step in this is to generate a 3D model of the part of
the body that undergo surgery Simulating human tissues-beit It also adds a layer of technology that can stump the
tooth enamel, skin or blood vessels-often starts with a sample standard microprocessor. While the brain can be tricked into
from a flesh and blood person that is we should have a 3D seeing seamless motion by flipping through 30 or so images
model of the part of the body. Using computer graphics we per second, touch signals need to be refreshed up to once a
first construct a reference model. Depending on this millisecond. The precise rate at which a computer must update
simulation needed, anatomical images can be derived from a a haptic interface varies depending on what type of virtual
series of patient’s Magnetic Resonance Images (MRI), surface is encountered-soft object require lower update rates
Computed Tomography (CT) or video recording, which are than harder objects.
2D images. These images are segmented using various
 A low update rate may not prevent a user’s surgical complex nonlinear equations. The reaction forces are also
instrument from sinking into the virtual flesh, but in soft calculated.
tissues that sinking is what is expected. If we want something
to come to an abrupt stop that is in the case of born, etc it In coming years, VR designers hope to gain a better
requires a higher update rates than bumping into something a understanding of true mechanical behavior of various tissues
little squishy like skin, liver etc. and organs in the body. If the haptic device is to give a
realistic impression of say pressing the skin on a patient’s arm,
But still, simulating squish is no easy task either. The the mechanical contributions of the skin, the fatty tissue
number of collision point between a virtual squishy object and benefit, muscle and even bone must be summed up. The
a virtual instrument is larger and more variable than between a equations to solve such a complex problem are known, but so
virtual rigid object and an instrument. Most difficult to far the calculations cannot be made fast enough to update a
simulate is two floppy objects interacting with each other-such display at 30Hz, let alone update a haptic interface at 500-
as colon and sigmoid-scope, the long bendable probe used to 1000Hz.
view the colon-because of multiple collision point. In
addition, the mechanics of such interaction are complicated, V. WHAT IS A VIRTUAL SURGER SIMULATOR?
because each object may deform the other.
The VR simulator basically consists of a powerful PC
which runs the software and an interface called haptic-
For simulating touch sensation, we have to calculate the
interfacer for the user to interact with the virtual environment.
forces applied to cut, prodde, puncture the various tissues.
Usually the haptic interfacer works on force feedback loop.
Also how they react or behave when cut, prodded, punctured
using surgical instruments. First we have to make physical
The force feedback systems are haptic interfaces that output
models of various tissues. The major difficulty in modeling
forces reflecting input forces and position information
organs is the physical behavior as they have all kinds of
obtained from the participant. These devices come in the form
complexities-they are anisotropic, non homogeneous and
of gloves, pens, joystick and exoskeletons.
nonlinear. In addition, a great deal more physical
measurement of tissues will be needed to make realistic haptic
maps of complicated parts of the body such as abdomen.

Physical model is made assuming that tissues are polygon

meshes that interact like an array of masses connected by
springs and dampers. The parameter values are derived using
Fig 3 Representation of a Haptic feedback loop and how human sense of touch interacting with a VR system. A human hands moves the end effecter-shown
here with hemostat-of a haptic device causing the device to relay its position via sensors to a computer running a VR simulation

virtual environment. The user interacts with the virtual world

using one hand for navigation and control and other hand to
The computer determines what force should oppose that touch and feel the virtual object. A semitransparent mirror
collision and relays force information to actuators or brakes or creates an interface where graphic and haptics are collocated.
both, which push back against the end effecter. In the left hand The result is the user can see and feel the object in same place.
loop, forces on the end effecter are detected and relayed to Among the medical procedures that can be simulated are
user’s brain. The brain, for example, commands the muscle to catheter insertion, needle injection, suturing and surgical
contract, in order to balance or overcome the force at the end operations.
effecter.

In medical applications, it is important that the haptic

devices convey the entire spectrum of textures from rigid to
elastic to fluid materials. It also essential that force feedback
occur in real time to convey a sense of realism.

The rest of the system consists mostly of off-the-shelf

components. The haptic device’s driver card plugs into usually
a 500MHz PC equipped with a standard graphic card and a
regular color monitor. The software includes a database of
graphical and haptic information representing the surgery part.
The graphics, including deformation of virtual objects is
calculated separately from the haptic feedback, because the
latter must be updated much more frequently.

VI. PHANTOM DESKTOP 3D TOUCH SYSTEM- A

HAPTIC INTERFACER
Fig 4 Phantom Desktop 3D touch screen.

SensAble technologies, a manufacture of force- feedback

interface devices, have developed Phantom Desktop 3D Touch
VII.IMPORTANCE OF VIRTUAL REALITY IN SURGICAL
System, which supports a workspace of 6 x 5 x 5 inch. About
FIELD
the size of a desk lamp, the device resembles a robotic arm
and has either 3 or 6 degrees of freedom and senses for A recent report released by Institute of Medicine in
relaying the arm’s position to PC. The system incorporates Washington DC, estimates that medical errors effects in about
position sensing with 6 degrees of freedom and force- 100,000 patient deaths each year in US alone. Proponent of
feedback with 3 degrees of freedom. A stylus with a range of virtual reality believes that incorporation of this technology
motion that approximates the lower arm pivoting at the user’s into medical training will bring this grim statistic down.
wrist enables-user to feel the point of stylus in all axes and to
track its orientation, including pitch, roll and yaw movement. The main advantages of virtual reality in surgery are:
A number of companies are incorporating haptic interfaces
into VR systems to extent or enhance interactive functionality. • Intelligent computer backup minimizes the number of
medical ‘mistakes’.
The Phantom haptic device has been incorporated into the
desktop display by Reachln Technologies AB Developed for a • More effective use of minimal-access surgical technique,
range of medical simulation and dental training applications; which reduces the long length of hospital stays and rest of
postoperative complications.
the system combines a stereo visual display, haptic interface
and 6 degrees of freedom positioner. A software package aptly • Better training in anatomy and surgical skill, with reduced
named GHOST, translates characteristics such as elasticity need for cadavers.
and roughness into commands for the arm, and the arm’s
actuators in turn produce the force needed to simulate the CONCLUSION
 Medical virtual reality has come a long way in the past 10
years as a result of advances in computer imaging, software,
hardware and display devices. Commercialization of VR
systems will depend on proving that they are cost effective
and can improve the quality of care. One of the current
limitations of VR implementation is shortcomings in the
realism of the simulations. The main Impediment to realistic REFERENCE
simulators is the cost and processing power of available
hardware. Another factor hindering the progress and [1] Daniel Sorid & Samuel K. Moore “The Virtual Surgeon”,IEEE
acceptability of VR applications is the need to improve Spectrum
[2] Paul J Gorman, MD; Andreas H Meler, MD; Thomas M Krummel,
human-computer interfaces, which can involve use of heavy MD, “Simulation and Virtual Reality in Surgical Education Real or
head-mounted displays or bulky VR gloves that impede Unreal ?“, Archives of Surgery
[3] R Satava “The King is Dead” Medicine.
movement. There is also the problem of time delays in the [4] Mandayam Srinivasan; Cagatay Basdogan, “Haptics in Virtual
simulator’s response to the users movements. Conflicts Environments: Taxonomy, Research Status and Challenges”,
Computers and Graphics, vol 21, no4, pp.
between sensory information can result in stimulator sickness, [5] SensAble Devices,Inc., “The PHANTOM’, literature from SensAble
which includes side effects such as eyestrain, nausea, loss of Devices Inc.
[6] http:// touchlab.mit.edu.
balance and disorientation. Commercialization of VR systems [7] science medicine & future virtual reality in surgery,Roy McCloy&
must also address certain legal and regulatory issues. Robert Stone
[8] www.csun.edu/cod/94virt/med-i 1 .html.
Despite these concerns, the benefits of VR systems in
medicines have clearly been established in several areas,
including improved training, better access to services, and
increase cost effectiveness and accuracy in performing certain
conventional surgical procedures.