Objective:In the development of medical software, to research new human-computer interaction scheme based on wearing virtual reality (VR) helmet so as to change former scheme which using mouse, keyboard and other tools.Methods: LeapMotion, a kind of gesture recognition tool, was used in medical simulation scenes of virtual environment to simulate movement trajectory of real person's gesture. The speech recognition of iFLYTEK, which could implement speech control for developmental medical mobile software, was used to realize new human-computer interaction scheme.Results: Usability of gesture recognition and voice control in medical virtual real software was obviously higher than that of traditional human-computer interaction scheme which adopted button, mouse and keyboard. And its feedback was better than that of traditional scheme. Besides, it verified the effectiveness of new human-computer interaction scheme and enhanced usability and flexibility of software.Conclusion: After human-computer interaction scheme of virtual real is applied, the medical software was developed by adopting virtual reality technique of immersion, and it can obtain better application experience.%目的:在医学软件的开发中,改变原有的利用鼠标、键盘等人机交互方案,研究基于佩带虚拟现实头盔多个新的人机交互方案.方法:采用手势识别工具LeapMotion在虚拟环境中在医学模拟场景中模拟真人的手势移动轨迹,利用科大讯飞语音识别对开发的医学移动软件进行语音控制的新技术来实现新的人机交互方案.结果:在医学虚拟现实软件中应用手势识别以及语音控制后较传统采用按钮、鼠标及键盘等人机交互方案易用性获得显著提升,使用效果反馈较好,验证了新的人机交互方案的有效性,并提高了软件的易用性和灵活性.结论:应用虚拟现实人机交互方案后,采用沉浸式虚拟现实技术开发的医学软件能够获得较好的应用体验.
展开▼
