Literature Survey

Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 3

Literature Survey: Virtual mouse

I. Literature Survey

This section describes various approaches for implementing a virtual mouse.


A REAL-TIME HAND GESTURE RECOGNITION METHOD
Yikai Fang1, Kongqiao Wang2, Jian Cheng1 and Hanqing Lu1
1 National Lab of Pattern Recognition
Institute of Automation, Chinese Academy of Sciences, Beijing 100080,
China
{ykfang, jcheng, luhq}@nlpr.ia.ac.cn
2Nokia Research Center, No.11 He Ping Li Dong Jie, Nokia House
1,Beijing 100013,China 2007[1]
Compared with the traditional interaction approaches, such as keyboard, mouse,
pen, etc, vision based hand interaction is more natural and efficient. In this
paper, we proposed a robust real-time hand gesture recognition method. In our
method, firstly, a specific gesture is required to trigger the hand detection
followed by tracking; then hand is segmented using motion and color cues;
finally, in order to break the limitation of aspect ratio encountered in most of
learning based hand gesture methods, the scale-space feature detection is
integrated into gesture recognition. Applying the proposed method to navigation
of image browsing, experimental results show that our method achieves
satisfactory performance

Real-time Multi-Objective Hand Posture/Gesture Recognition by Using


Distance Classifiers and Finite State Machine for Virtual Mouse
Operations
Alper Aksaç, Orkun Öztürk, and Tansel Özyer
Computer Engineering Department, TOBB University of Economics &
Technology, Ankara, Turkey December 2011 [2]
Cameras that are connected to computers record sequence of digital images of
human hand in order to interpret human posture/gesture. Human hand
posture/gesture recognition has been utilized for providing virtual reality
mechanism and it is still an ongoing research in human-computer interaction
(HCI) community. Virtual reality can be operated on a particular program but it
will be more effective if the entire system can be controlled for the sake of
generality. Another direction is the applicability of virtual reality in real time. In
this paper, we have developed a virtual mouse system that can recognize the
pre-defined mouse movements in real time regardless of the context. Our real
time hand recognition system is three fold. 1) skin detection, 2) feature
extraction and 3) recognition. For recognition, various features with their own
objectives are constructed from hand postures andcompared according to the
1 | Page
similarity measures and the best- matched posture is used as a mouse action to
control the cursor of the computer.

Real Time Hand Gesture recognition system for dynamic applications


Siddharth S. Rautaray1 , Anupam Agrawal2 Indian Institute of
Information Technology Allahabad January 2012[3] Virtual environments
have always been considered as a means for more visceral and efficient human
computer interaction by a diversified range of applications. The spectrum of
applications includes analysis of complex scientific data, medical training,
military simulation, phobia therapy and virtual prototyping. Evolution of
ubiquitous computing, current user interaction approaches with keyboard,
mouse and pen are not sufficient for the still widening spectrum of Human
computer interaction. Gloves and sensor based trackers are unwieldy,
constraining and uncomfortable to use. Due to the limitation of these devices
the useable command set based diligences is also limited. Direct use of hands as
an input device is an innovative method for providing natural Human Computer
Interaction which has its inheritance from textbased interfaces through 2D
graphical-based interfaces, multimedia-supported interfaces, to full-fledged
multi-participant Virtual Environment (VE) systems. Conceiving a future era of
human-computer interaction with the implementations of 3D application where
the user may be able to move and rotate objects simply by moving and rotating
his hand - all without help of any input device.

Control of A Virtual System with Hand Gesture


Dr. Sumit Pundir Associate Professor, Department of Computer Science &
Engineering, Graphic Era Deemed to be University, Dehradun,
Uttarakhand, India, 248002 2023[4]
n the field of Human-Computer Interaction (HCI), significant advancements
have been made. These advancements aim to bridge the gap between the
physical and digital realms by introducing various modules. Traditional
techniques predominantly involve relocating the tracking ball or adding buttons
to the mouse. However, our proposed solution offers novel mouse control
options. Our solution incorporates hand tracking, marker motion tracking, and
colored object tracking to facilitate movement. The primary focus of this
research proposal revolves around mouse cursor movement, as well as click
event-based object detection and marker identification. It demonstrates how
computer vision technologies, using cameras, can perform all the functions that
a mouse currently accomplishes (e.g., left/right click, double-click, scroll, etc.),
including tasks like picture segmentation and gesture recognition. Gesture
identification poses a challenging problem that necessitates a diverse range of
techniques such as motion modeling, motion analysis, pattern recognition, and
machine learning. For instance, the ability to click and move the mouse can be
achieved through the recognition of colored objects. The fundamental objective
2 | Page
of this approach is to utilize a webcam to construct a virtual device for
humancomputer interaction. A method for recognizing hand movements and
their associated gestures has been developed, encompassing all relevant
elements. Consequently, numerous mouse operations can be performed when
motion is recognized

I. Novelty
Our approach to creating a virtual mouse using OpenCV presents a novel departure
from traditional gesture-based methods. Instead of relying solely on hand gestures
to control the cursor, we innovatively utilized parallel mouse movements as
training data. By synchronizing the hand movements with the corresponding cursor
movements recorded by a physical mouse, we effectively captured the intricate
nuances of cursor manipulation. This method not only enhances the accuracy and
responsiveness of the virtual mouse but also eliminates the need for continuous
gesture recognition, thereby streamlining the interaction process. Moreover, by
training the system to replicate the recorded mouse movements, we have created a
more intuitive and seamless user experience, bridging the gap between physical
and virtual interactions. Overall, our approach represents a significant
advancement in virtual mouse technology, offering a novel solution that combines
the familiarity of traditional mouse input with the flexibility of hand gestures.

3 | Page

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy