Algorithm Structure

 

About The Project

 

 

 

 

 

 

Now days interactions with computers are done mainly by the well known I/O

 

devices – keyboard & mouse. 


In this project we were looking for an intuitive way to communicate with the

 

computer.      

 

 

The need was to find a transformation between the real world coordinates

 

and the virtual world coordinates and a way of recognizing hand gestures.        

 

it was done by using 3D camera (Zcam 3DV Systems) that produce RGB

 

video and gray scale depth video simultaneously and by using Intel’s

 

OpenCV library functions for image processing .

 

 

This field of recognizing gestures deduces a vast scale of applications from

 

interactive computer games till sign language recognition and virtual

 

computer control .

 

 

We choose to focus on the virtual computer control aspect by simulating a

 

virtual mouse.           

 

 

we implemented a real time algorithm that tracks the hand palm and uses its

 

center mass coordinates as the mouse pointer and recognizing hand

 

gestures to simulate mouse clicks .

 

About the camera

 

 

Z-Cam: 3DV Systems product. the company was bought by Microsoft in the beginning of 2009.
Based on image sensing technology 2 video streams , one generates distance (depth) information for each pixel or object captured by the camera (by IR) and represented in black and white video , the second  is color RGB video.