The influence of vision is taking one-step ahead with the introduction of sophisti-cated eye-tracking and gaze-tracking techniques, which track the movement of the eye and the gaze location to control various applications. This paper describes in detail the low-cost hardware development and the software architecture for a real-time eye tracking based on color system using the open-source image-processing framework of AForge.NET. The designed system uses a USB camera to detect the eye movements and uses EuclideanColorFiltering to filter colors, and then it detects the biggest object between them and gets the location of that object. The system shows to the patient some question and answers according to the questions, he will look at one of the answers, then, it will be highlighted. By this way, the doctor will know what is wrong with the patient and what should be done to cure him. This provides a highly useful alternative control system for a person suffering from ALS or in Vegetative state of brain stroke. The software system is in Kurdish language and it is designed for the patient in a way to be relaxed and be as simple as possible. Test results on systems on the correct locations and error percentage shows the per-formance of the developed eye tracking system.
Table of Contents
Chapter One: Introduction
1. Background
2. Eye Tracking Metrics Most Commonly Reported in Usability Studies
3. Problem statement
4. Objectives of the research
5. Questions of the research
6. Scope of the research
7. Motivation of the research
8. Significant of the research
9. Research project outlines
Chapter Two: Literature Review
Chapter Three: Methodology
1. Introduction
2. Participants and Environment
3. Tools
I. Visual Studio
II. Visual C#
III. Aforge.NET
1) Comparing Image-Processing Libraries
A. Documentation and other material
B. Ease of use
C. Performance
4. Materials and instruments
I. Sunglasses
II. Power Plug Adapter
III. Webcam
IV. DATASHOW (Projector)
V. Final Appearance
5. Method
6. Limitations
I. Speed
II. Lighting changes
III. Transformations
1) Scaling
2) Rotation:
7. Ethical considerations
Chapter Four: Software System
1. Log in Form
2. Configuration form
3. Questions Form
4. Help and Sleep
5. About
Chapter Five: Results of the research
1. Theoretical Results
2. EXPERIMENTAL RESULTS
Chapter Six: Conclusions and future works
Research Objectives and Topics
This research aims to develop a low-cost, real-time eye-tracking system, named "Eye-Reaction," designed to assist individuals with physical disabilities—specifically those in a vegetative state or suffering from conditions like ALS—to communicate and interact with doctors using only eye movements.
- Development of a low-cost hardware and software eye-tracking solution.
- Implementation of image processing using the AForge.NET open-source framework.
- Creation of a user-friendly software interface for patient-doctor interaction.
- Evaluation of system performance, including accuracy and response times.
Excerpt from the Book
1. BACKGROUND
Several people around the world suffer from several physical disabilities that prohibit them from leading a normal life. Several conditions like Amyotrophic Lateral Sclerosis (ALS), cerebral palsy, traumatic brain injury, or stroke may result in loss of muscle movements in the body [1], thus rendering the person paralyzed. However, in several cases, not all parts of the body are paralyzed and the person may have limited voluntary movements of the head, eyes or tongue and may even be able to blink, wink or smile [2] [3]. In our case, we have vegetative state; it is an enhanced state of brain store.
Assistive technology systems, that make use of these available movements, can be developed to aid people suffering from these conditions not only communicate with other people, but also control various electronic devices [4]. For people suffering from quadriplegia, one of the only reliable and convenient sources of voluntary movement that may be used by an assistive technology system is the movement of the eye [5]. Hence, the person‘s eye movements may be used to control computers for browsing the internet, simple word processing or even paint like application [3].
In this paper, we present A Real-Time Video Based on Color low-cost Eye-Tracking System for patients With Disabilities called Eye-Reaction. The Eye-Reaction system lets the patient answer questions that are addressed to him by the doctor, and gives the patient a chance to be more comfortable by letting him decide whether someone stays with him or not, and the chance to call the doctor when needed for emergency cases. In the future, the Eye-Reaction system aims to provide a single control system to help people suffering from disabilities to continue with their day-to-day activity, helping them to move around without being dependent on somebody and control various household utilizations.
Summary of Chapters
Chapter One: Introduction: Provides an overview of the need for assistive eye-tracking technology, defines the problem statement, and outlines the research objectives and scope.
Chapter Two: Literature Review: Surveys existing research on various eye-tracking techniques, feature tracking models, and previous efforts to create hands-free interaction systems.
Chapter Three: Methodology: Details the hardware tools used (webcam, projector), the environment, and the implementation process of the Eye-Reaction algorithm using AForge.NET.
Chapter Four: Software System: Explains the architectural design of the application, including the login, configuration, question, and help/sleep forms.
Chapter Five: Results of the research: Presents the experimental findings and testing data, documenting the accuracy and performance of the eye-tracking system.
Chapter Six: Conclusions and future works: Summarizes the project outcomes and suggests future enhancements, such as supporting multiple languages and mobile platform integration.
Keywords
Eye-tracking, Gaze-tracking, Assistive technology, AForge.NET, Image processing, Disability aid, ALS, Vegetative state, Human-computer interaction, Real-time system, EuclideanColorFiltering, Software architecture, Medical communication, Eye-Reaction, Patient care.
Frequently Asked Questions
What is the primary goal of this research?
The primary goal is to develop a low-cost, real-time eye-tracking system to enable patients with severe physical disabilities, such as ALS or vegetative states, to communicate their needs to doctors.
What are the central themes of the work?
The core themes include assistive technology, computer vision, image processing, and human-computer interaction designed specifically for healthcare applications.
What is the main research question?
The research explores how to evaluate and create robust, cost-effective alternative interaction methods for computer input to identify those that function effectively for patients with limited movement.
Which scientific methods were employed?
The researcher utilized color-based object tracking, specifically using the AForge.NET framework for image processing, alongside hardware assembly to capture and interpret eye movement data.
What does the main body of the paper cover?
The main body describes the hardware tools, the selection of image-processing libraries, the algorithm workflow for object detection, and the structure of the software forms used to facilitate patient interaction.
Which keywords best characterize the study?
Key terms include eye-tracking, assistive technology, AForge.NET, image processing, ALS, and human-computer interaction.
How does the system filter colors to detect the eye?
The system uses EuclideanColorFiltering from the AForge.NET library to isolate the target color within the video frame, which is then processed to locate the eye's movement.
What specific limitations did the author face?
The author noted limitations related to processing speed (memory usage), sensitivity to lighting changes (specifically yellow light), and challenges with head rotation/scaling during use.
What is the purpose of the Help and Sleep forms in the application?
These forms allow the patient to express basic needs independently: the "Help" option triggers an alarm, and the "Sleep" option signals to nursing staff that the patient wishes to rest.
- Arbeit zitieren
- Ahmed Yousify (Autor:in), 2014, Eye-Reaction: A Real-Time Video Based on Color Eye-Tracking System for Patients with Disabilities, München, GRIN Verlag, https://www.grin.com/document/283044
