Documente Academic
Documente Profesional
Documente Cultură
What is Gesture?
A movement of a limb or the body as an expression of thought or feeling.
Small set of user-intuitive gestures are easy to remember, but need some menu reminder
recognition
glove-based method
Using special glove-based device to extract hand posture vision-based method 3D hand/arm modeling
System Overview
User Rendering User Interface Display Image Capture
Update Object
Hand Movement
concerns
Low-light condition Camera field of view Webcam configuration Responsiveness Accuracy
Demonstration
Gesture to Interaction Mapping
JN 2/4/2013
Proposed Approach
Radius 0.19 * ( HandSizeX HandSizeY)
A finger is defined to be any 10+ white pixels separated by 17+ black pixels (salt/pepper tolerance)
JN 2/4/2013
Implementation
Skin Color Training: With images of various lighting Calibration: Learn lighting and coloring Hand Location: Create bounding box from skin color Finger Region Detection: Find connected regions (fingers/palm) Pattern Matching: Compare regions with gesture patterns
Conclusion:Replace mouse and keyboard, Interact with a 3D world, Communicate at a distance, Allows control without having to touch the device.