AI Based Virtual Mouse and Voice Assistant
AI Based Virtual Mouse and Voice Assistant
Group Member:
Guide:
Rutuja Babasaheb Salunkhe (2030330246057)
Mrs. Ektaa Meshram
CONTENT
Introduction to AI based Virtual Mouse
How Hand Gesture Recognition works
Voice Assistant Integration
Features and Benefits of AI based Virtual
Mouse
Classification Model
Voice Assistant Integration
Methodology of Virtual Assistant Using
Python
Conclusion
Introduction to AI based Virtual Mouse
1 2
Seamless Integration Enhanced Accessibility
AI – based virtual mouse systems Integrating voice assistant with the virtual
can be seamlessly integrated with mouse fosters greater accessibility for
voice assistants, enabling users to users with physical disabilities ,
controls using voice commands , empowering them to navigate digital
providing a hands – free computing interfaces more independtly.
experience.
Features and Benefits of AI based Virtual
Mouse
Touchless Control
The AI-based virtual mouse offers touchless control, reducing the risk of hand strain and
providing a hygienic input method.
Enhanced Precision
With advanced tracking capabilities, it provides enhanced precision for tasks requiring
fine cursor movements.
Customizable Gestures
Users can customize gestures for specific commands, enhancing personalization and
efficiency for different use cases.
Adaptive Interfaces
The virtual mouse can adapt to various interfaces and screen sizes, optimizing user
experience across different devices.
Problem Statement Proposed System
I. To design a virtual mouse which
detects hand gestures and performs
mouse operations only using the
fingers.
II. we used different combinations of
fingers to perform various operations
of the mouse according to which
particular combination of fingers is
recognized.
III. Easy to use and cost effective.
Block Diagram
Classification Model
Deep Learning
• Deep Learning is a subset of machine learning. It is basically learning and improving on its own by
examining other algorithm.
• It works on artificial neural network that was designed to imitate human think and learn
capabilities.
Mediapipe
• MediaPipe to recognize the hand and the hand key points.
• MediaPipe returns a total of 21 key points for each detected hand.
Implementation
Voice Assistant Integration
A voice assistant is an intelligent software that responds
to voice commands and can run on any device, including
smartphones, speakers, desktop/laptop computers, tablets,
wearables, gaming consoles, TV consoles, VR headsets,
cars, and internet of things devices. Examples include
Amazon’s Alexa, Apple’s Siri, Google Assistant, and
Microsoft’s Cortana.
How do voice assistants work?
Voice assistants use AI natural language processing
technology to interpret human speech and respond
accordingly in a human-like voice.
Methodology of Virtual Assistant Using Python
Conclusion
The primary goal of the AI virtual mouse system is to allow the user to operate the mouse pointer with hand movements
rather than a hardware mouse. The suggested system may be implemented with the use of a webcam or an integrated
camera by processing the frames to carry out the necessary mouse actions based on the detected hand motions and hand
tip.
This assistant does a good job at carrying out some of the duties the user specifies. In addition, this assistant may
do a wide variety of tasks, including as text message delivery to the user's mobile device, YouTube automation,
and information retrieval from Wikipedia and Google, all in response to a single voice query. The voice assistant
has allowed us to automate several services with a single command. The majority of the user's work, such as
online searching, is simplified by this tool. Our goal is to make this tool so capable that it can take the position
of human server administrators entirely. The project was constructed utilizing modules from open-source
software that have the support of the Anaconda community, so any changes may be implemented
Quickly.