摘要
多通道界面旨在充分利用一个以上的感觉和动作通道来捕捉用户的意向,提高人机交互的自然性和高效性,其核心问题就是通道整合的问题。该文针对该问题提出了一个基于分层的任务模型的整合算法,该算法处理中涉及到程序运行状态表示、任务结构的设计和交互原语相关性表示等问题。针对以上3个问题展开讨论,在此基础上得到最后的算法。
The aim of multimodal interface is to get the users intent by more than one sense and action modals and to make the interaction of human an computer more natural and more effective. The key of multimodal interface is multimodal integration. In this article an integration algorithm based on task oriented and hierarchical multimodal integration modal is carried out. In this algorithm there are three questions: representation of programme state, desig of task structure and representation of the relativity of interaction primitive to be discussed. At last the algorithm is given.
出处
《计算机工程》
CAS
CSCD
北大核心
2004年第13期67-68,171,共3页
Computer Engineering
基金
国家十五重点军事预研项目资助
关键词
多通道用户界面
有穷自动机
对象属性结构
交互原语
Multimodal interface
Finite automaton
Structure of object attribute
Interaction primitive
