骆金维 曾德生 张劲波 张仁忠

摘 要 基于Kinect体感器开发一套幼儿认知系统，以激发幼儿认知的兴趣，陶冶幼儿的情操，促进幼儿的智力发展，提高幼儿的认知能力。幼儿认知系统是基于Kinect的体感技术，借助Kinect感应系统来定位捕捉幼儿动作及识别幼儿的语音信息，通过Kinect体感设备与计算机系统连接，将动作及语音信息输入系统，实现幼儿与系统之间互动，带幼儿进入模拟真实的认识环境中，沉浸在虚拟现实中进行认知训练，在娱乐中提高幼儿认知能力。

关键词 体感技术；虚拟技术；幼儿认知；人机交互

中图法分类号： TP391 文献标识码： A

Research on the feasibility of developing infants cognitive system technology based on Kinect somatosensory technology

LUO Jinwei， ZENG Desheng， ZHANG Jinbo， ZHANG Renzhong

（GuangDong Innovative Technical College， Dongguan Guangdong 523960， China）

Abstract： It is an infant cognitive system developed on the basis of Kinect body sensor. It is used to initiate infants interest in cognition， cultivate their temperament， promote their intellectual development， and improve their cognitive ability. The infant cognitive system works on the basis of Kinect somatosensory technology， utilizes Kinect induction system to fix the position of the action messages of the infants and differentiate their voice messages. Through the Kinect somatosensory equipment， the system is connected with the computer. So the messages of the infantsaction and voice are input to the system， and the interaction between the infants and the system is also realized. The conclusion is that the system could bring the infants to the simulated real cognitive environment， so as to immerse the infantsin virtual reality while fulfilling cognitive training and raise their cognitive ability in entertainment.

Key Words： somatosensory technology； virtual technology； infant cognition； human-computer interaction

0 引 言

基于Kinect体感的幼儿认知系统技术可行性研究是用Kinect体感设备作为感知设备捕捉幼儿动作及识别幼儿语音，先部署搭建Kinect SDK开发平台，幼儿认知系统通过调用Kinect SDK的SkeletonFrameReadyAPI对幼儿的形体动作进行捕捉；调用Kinect MSAPI（Microsoft Speech Recognition API）对幼儿的语音进行识别，再根据捕获的动作及语音信息从幼儿认知系统调出不同的图形及各种色彩，让幼儿沉浸在虚拟现实世界中获得对图形与颜色的具体认知。幼儿做出的肢体动作和语音信息作为幼儿认知系统的人机交互的输入部分，由幼儿的肢体动作及语音信息控制幼儿认知系统，实现人机交互，提高认知图形及颜色的能力。

1 Kinect体感设备

Kinect体感设备是微软公司针对游戏主机推出的一款强大功能设计产品，在虚拟现实中的应用较为广泛，而在游戏娱乐方面则尤显突出显著作用。借助Kinect体感器可以实现幼儿与机器之间的真实人机交互，促使幼儿在虚拟现实环境中生动接受成功认知教育。……