基于Kinect骨骼跟踪技术的人机交互

基于Kinect提供的深度信息和骨骼跟踪技术进行手势识别,利用手势代替鼠标实现人机交互.首先,引入以人体为参考系的人体坐标系统,将手势位置通过坐标系变换映射到计算机屏幕,实现计算机屏幕上光标的位置显示和跟踪.其次,研究计算机操作系统响应鼠标事件的工作模式,设计固定的手势静态及动态工作模式,通过一定的映射关系将特定的一组手势与计算机系统基本操作指令进行对应.并定义状态机,根据手势状态触发系统操作事件,从而达到对计算机系统的体感控制.实验表明,该人机交互系统自然、合理、有效.

Human-Computer Interaction Based on Kinect Skeletal Tracking

The depth information and skeletal tracking provided by Kinect can be used for hand gesture recognition. A new human-computer interaction method is proposed by replacing mouse operations with hand gestures. Firstly, to display the location of the cursor and tracking it accurately on the computer screen, a human-based coordinate system is introduced and hand gestures are mapped to the computer screen by coordinate transformation. Secondly, the response mode of the computer operating system to mouse events is studied. The fixed modes of static and dynamic hand gestures are designed. A mapping between a specific set of hand gestures and computer responds to basic system controls are defined. And a state machine is described to trigger system events based on hand gestures. Experiments show that the proposed human - computer interaction system based on hand gestures is natural, reasonable and effective.