Virtual human is the simulation of human under the synthesis of virtual reality,artificial intelligence,and other technologies.Modern virtual human technology simulates both the external characteristics and the intern...Virtual human is the simulation of human under the synthesis of virtual reality,artificial intelligence,and other technologies.Modern virtual human technology simulates both the external characteristics and the internal emotions and personality of humans.The relationship between virtual human and human is a concrete expression of the modern symbiotic relationship between human and machine.This human-machine symbiosis can either be a fusion of the virtual human and the human or it can cause a split in the human itself.展开更多
Two artificial agents(a humanoid robot and a virtual human) are enriched with various similar intelligence,autonomy, functionalities and interaction modalities. The agents are integrated in the form of a cyber-physica...Two artificial agents(a humanoid robot and a virtual human) are enriched with various similar intelligence,autonomy, functionalities and interaction modalities. The agents are integrated in the form of a cyber-physical-social system(CPSS) through a shared communication platform to create a social ecology. In the ecology, the agents collaborate(assist each other) to perform a real-world task(search for a hidden object)for the benefits of humans. A robot-virtual human bilateral trust model is derived and a real-time trust measurement method is developed. The role of taking initiative in the collaboration is switched between the agents following a finite state machine model triggered by bilateral trust, which results in a mixedinitiative collaboration. A scheme is developed to evaluate the performance of the agents in the ecology through the CPSS.The results show that the robot and the virtual human perform satisfactorily in the collaboration through the CPSS. The results thus prove the effectiveness of the real-world ecology between artificial agents of heterogeneous realities through a shared platform based on trust-triggered mixed-initiatives. The results can help develop adaptive social ecology comprising intelligent agents of heterogeneous realities to assist humans in various tasks through collaboration between the agents in the form of a CPSS.展开更多
This paper presents a skin deformation algorithm for creating 3D characters or virtual human models. The algorithm can be applied to rigid deformation, joint dependent localized deformation, skeleton driven deformatio...This paper presents a skin deformation algorithm for creating 3D characters or virtual human models. The algorithm can be applied to rigid deformation, joint dependent localized deformation, skeleton driven deformation, cross contour deformation, and free-form deformation （FFD）. These deformations are computed and demonstrated with examples and the algorithm is applied to overcome the difficulties in mechanically simulating the motion of the human body by club-shape models. The techniques described in this article enables the reconstruction of dynamic human models that can be used in defining and representing the geometrical and kinematical characteristics of human motion.展开更多
Little by little, we are entering the new era, intelligent interfaces are absorbing us more and more every day, and artificial intelligence makes its presence in a stealthy way. Virtual humans that represent an evolut...Little by little, we are entering the new era, intelligent interfaces are absorbing us more and more every day, and artificial intelligence makes its presence in a stealthy way. Virtual humans that represent an evolution of autonomous virtual agents;they are computer programs and in the future capable of carrying out different activities in certain environments. They will give the illusion of being human;they will have a body, and they will be immersed in an environment. They will have a set of senses that will allow them: 1) Sensations and therefore associated expressions;2) Communication;3) Learning;4) Remembering events, among others. By integrating the above, they will have a personality and autonomy, so they will be able to plan with respect to objectives;allowing them to decide and take actions with their body, in other words, they will count on awareness. The applications will be focused on environments that they will inhabit, or as interfaces that will interact with other systems. The application domains will be multiple;one of them being education. This article shows the design of OANNA like an avatar with the role of pedagogical agent. It was modeled as an affective-cognitive structure related to the teaching-learning process linked to a pedagogical agent that represents the interface of an artilect. OANNA, has the necessary animations for intervention within the teaching-learning process.展开更多
Nowadays,virtual human(VH) is becoming a hot research topic in virtualization.VH dialogue can be categorized as an application of natural language processing(NLP) technology,since it is relational to question and answ...Nowadays,virtual human(VH) is becoming a hot research topic in virtualization.VH dialogue can be categorized as an application of natural language processing(NLP) technology,since it is relational to question and answering(QA) technologies.In order to integrate these technologies,this paper reviews some important work on VH dialogue,and predicts some research points on the view of QA technologies.展开更多
Virtual human is a digital representation of the geometric and behavioral property of human beings in the virtual environment generated by computer. The research goal of virtual human synthesis is to generate realisti...Virtual human is a digital representation of the geometric and behavioral property of human beings in the virtual environment generated by computer. The research goal of virtual human synthesis is to generate realistic human body models and natural human motion behavior. This paper introduces the development of the related researches on these two topics, and some progresses on example based human modeling and motion synthesis, and their applications in Chinese sign language teaching, computeraided sports training and public safety problem studying. Finally, some hot research topics in virtual human synthesis are presented.展开更多
The efficient and reliable human centered design of products and processes is a major goal in manufacturing industries for numerous human factors must be taken into account during the entire life cycle of products. A ...The efficient and reliable human centered design of products and processes is a major goal in manufacturing industries for numerous human factors must be taken into account during the entire life cycle of products. A multi-agents intelligent design system is presented for manufacturing process simulation and products＇ ergonomic analysis. In virtual design environment, the virtual human with high-level intelligence performs tasks＇ operation autonomously and shows optimum posture configuration with ergonomic assessment results in real time. The functions are realized by intelligent agents architecture based on a modem approach derived from fuzzy multi-objects decision-making theory. A case study is presented to demonstrate the feasibility of the suggested methodology.展开更多
Creating realistic virtual humans has been a challenging objective in computer science research for some time. This paper describes an integrated framework for modeling virtual humans with a high level of autonomy. Th...Creating realistic virtual humans has been a challenging objective in computer science research for some time. This paper describes an integrated framework for modeling virtual humans with a high level of autonomy. The framework seeks to reproduce human-like believable behavior and movement in virtual humans in a virtual environment. The framework includes a visual and auditory information perception module, a decision network based behavior decision module, and a hierarchical autonomous motion control module. These cooperate to model realistic autonomous individual behavior for virtual humans in real-time interactive virtual environments. The framework was tested in a simulated virtual environment system to demonstrate the ability of the framework to create autonomous, perceptive and intelligent virtual humans in real-time virtual environments.展开更多
The simulation of human in the distributed virtual environment is different from the simulation of vehicle. Due to the human’s many joints, to implement the real time performance of the interaction between the virtua...The simulation of human in the distributed virtual environment is different from the simulation of vehicle. Due to the human’s many joints, to implement the real time performance of the interaction between the virtual human and the environment, the quantity of information broadcasted in the network will be increased. So with the growing of the quantity of virtual human added to the network, the network burthen would augment rapidly. Therefore, for the simulation of virtual human this paper divides organically the motion parts of the body, which makes those body parts that often interact with the environment are described according to the joints while other parts are described according to the action information. Simultaneity, this paper adopts Dead Reckoning to reduce the quantity of information needed by maintaining the reality motion of virtual human. The experiment indicates that the forecasting display technique can efficiently reduce the network burthen and enhance the interaction of virtual human.展开更多
In order to provide a simple and efficient approach to perform the real-time interactive motion control of virtual human in virtual maintenance environment(VME),the motion control method of virtual human based on limi...In order to provide a simple and efficient approach to perform the real-time interactive motion control of virtual human in virtual maintenance environment(VME),the motion control method of virtual human based on limited input information is proposed.With the space position tracking system with only one sensor the action sequences and motion models of virtual human,the human motions and hand actions in VME are driven by the sensor data in stages and in real time through the transmission condition control in the process of maintenance operation.And the input data and information is processed based on the method of Kalman filtering and wavelet transforming to improve the control effects.An experimental VME is also established to validate the control efficiency,and the experiment results show that the space motion control of virtual human in VME can be performed based on limited information with proposed control strategy.展开更多
The ergonomic digital design and evaluation of man-machine system is the main application fields of virtual human technology. Because of the complexity of physical person and uncertainty of fatigue generation mechanis...The ergonomic digital design and evaluation of man-machine system is the main application fields of virtual human technology. Because of the complexity of physical person and uncertainty of fatigue generation mechanism, it is difficult to express a nd evaluate the Virtual Human's fatigue state. This paper summarizes the characteristics of virtual human's fatigue evaluation, such as undeterminable, invisible, the constraint conditions can been used. Viewed from the strengths and weaknesses of preexisting models, metabolic energy expenditure model, dynamic muscle fatigue model and a model to assess fatigue at joint-level using the half-joint concept, this paper puts forward the future development trend that the combination of subjective and objective,diversificationoftheanalyzablemotion,real-timeandvisualexpression.展开更多
Emotion plays an essential role in the adaptation and social communication of organisms.Similarly,an appro-priately timed and clearly expressed emotion is a central requirement for believable interactive virtual human...Emotion plays an essential role in the adaptation and social communication of organisms.Similarly,an appro-priately timed and clearly expressed emotion is a central requirement for believable interactive virtual humans.Presently,incorporating emotion into virtual humans has gained increasing attention in the academia and industry.This strong interest is driven by a wide spectrum of promising applications in many areas such as virtual reality,e-learning,entertainment,etc.This paper introduces an emotion model of artificial psychology,in which the transition of emotion can be viewed as a Markov process and the relation of emotion,external incentive and personality can be described by a Markov decision process(MDP).In order to demonstrate the approach,this paper integrates the emotion model into a system composed of voice recognition and a realistic facial model.Thus,the model could be used for generating a variety of emotional expressions of autonomous,interactive virtual human beings.展开更多
The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disasse...The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disassembly is built, and the corresponding human-computer system for stable virtual disassembly is developed. In this system, an immersive and interactive virtual disassembly environment has been created to provide planners with a more visual working scene. For cooperative disassembly, an intelligent module of stability analysis of disassembly operations is embedded into the human-computer system to assist planners to implement disassembly tasks better. The supporting matrix for stability analysis of disassembly operations is defined and the method of stability analysis is detailed. Based on the approach, the stability of any disassembly operation can be analyzed to instruct the manual virtual disassembly. At last, a disassembly case in the virtual environment is given to prove the validity of above ideas.展开更多
This paper presents an image processing design flow for virtual fitting room (VFR) applications, targeting both personal computers and mobile devices. The proposed human friendly interface is implemented by a three-st...This paper presents an image processing design flow for virtual fitting room (VFR) applications, targeting both personal computers and mobile devices. The proposed human friendly interface is implemented by a three-stage algorithm: Detection and sizing of the user's body, detection of reference points based on face detection and augmented reality markers, and superimposition of the clothing over the user's image. Compared to other existing VFR systems, key difference is the lack of any proprietary hardware components or peripherals. Proposed VFR is software based and designed to be universally compatible as long as the device has a camera. Furthermore, JAVA implementation on Android based mobile systems is computationally efficient and it can run in real-time on existing mobile devices.展开更多
文摘Virtual human is the simulation of human under the synthesis of virtual reality,artificial intelligence,and other technologies.Modern virtual human technology simulates both the external characteristics and the internal emotions and personality of humans.The relationship between virtual human and human is a concrete expression of the modern symbiotic relationship between human and machine.This human-machine symbiosis can either be a fusion of the virtual human and the human or it can cause a split in the human itself.
文摘Two artificial agents(a humanoid robot and a virtual human) are enriched with various similar intelligence,autonomy, functionalities and interaction modalities. The agents are integrated in the form of a cyber-physical-social system(CPSS) through a shared communication platform to create a social ecology. In the ecology, the agents collaborate(assist each other) to perform a real-world task(search for a hidden object)for the benefits of humans. A robot-virtual human bilateral trust model is derived and a real-time trust measurement method is developed. The role of taking initiative in the collaboration is switched between the agents following a finite state machine model triggered by bilateral trust, which results in a mixedinitiative collaboration. A scheme is developed to evaluate the performance of the agents in the ecology through the CPSS.The results show that the robot and the virtual human perform satisfactorily in the collaboration through the CPSS. The results thus prove the effectiveness of the real-world ecology between artificial agents of heterogeneous realities through a shared platform based on trust-triggered mixed-initiatives. The results can help develop adaptive social ecology comprising intelligent agents of heterogeneous realities to assist humans in various tasks through collaboration between the agents in the form of a CPSS.
基金supported by Shanghai Science and Technology Committee (No. 08515810200)Jiangsu Province Development Foundation (No. BS2007048)
文摘This paper presents a skin deformation algorithm for creating 3D characters or virtual human models. The algorithm can be applied to rigid deformation, joint dependent localized deformation, skeleton driven deformation, cross contour deformation, and free-form deformation （FFD）. These deformations are computed and demonstrated with examples and the algorithm is applied to overcome the difficulties in mechanically simulating the motion of the human body by club-shape models. The techniques described in this article enables the reconstruction of dynamic human models that can be used in defining and representing the geometrical and kinematical characteristics of human motion.
文摘Little by little, we are entering the new era, intelligent interfaces are absorbing us more and more every day, and artificial intelligence makes its presence in a stealthy way. Virtual humans that represent an evolution of autonomous virtual agents;they are computer programs and in the future capable of carrying out different activities in certain environments. They will give the illusion of being human;they will have a body, and they will be immersed in an environment. They will have a set of senses that will allow them: 1) Sensations and therefore associated expressions;2) Communication;3) Learning;4) Remembering events, among others. By integrating the above, they will have a personality and autonomy, so they will be able to plan with respect to objectives;allowing them to decide and take actions with their body, in other words, they will count on awareness. The applications will be focused on environments that they will inhabit, or as interfaces that will interact with other systems. The application domains will be multiple;one of them being education. This article shows the design of OANNA like an avatar with the role of pedagogical agent. It was modeled as an affective-cognitive structure related to the teaching-learning process linked to a pedagogical agent that represents the interface of an artilect. OANNA, has the necessary animations for intervention within the teaching-learning process.
基金National Nature Science Foundations of China(Nos.61170027,61202169,and 61301140)Tianjin"131"Creative Talents Training Project,China(the 3rd level)
文摘Nowadays,virtual human(VH) is becoming a hot research topic in virtualization.VH dialogue can be categorized as an application of natural language processing(NLP) technology,since it is relational to question and answering(QA) technologies.In order to integrate these technologies,this paper reviews some important work on VH dialogue,and predicts some research points on the view of QA technologies.
基金Supported partially by the National High-Tech Research & Development Program of China (Grant Nos. 2006AA01Z336, 2007AA01Z320)the National Natural Science Foundation of China (Grant No. 60533070)
文摘Virtual human is a digital representation of the geometric and behavioral property of human beings in the virtual environment generated by computer. The research goal of virtual human synthesis is to generate realistic human body models and natural human motion behavior. This paper introduces the development of the related researches on these two topics, and some progresses on example based human modeling and motion synthesis, and their applications in Chinese sign language teaching, computeraided sports training and public safety problem studying. Finally, some hot research topics in virtual human synthesis are presented.
文摘The efficient and reliable human centered design of products and processes is a major goal in manufacturing industries for numerous human factors must be taken into account during the entire life cycle of products. A multi-agents intelligent design system is presented for manufacturing process simulation and products＇ ergonomic analysis. In virtual design environment, the virtual human with high-level intelligence performs tasks＇ operation autonomously and shows optimum posture configuration with ergonomic assessment results in real time. The functions are realized by intelligent agents architecture based on a modem approach derived from fuzzy multi-objects decision-making theory. A case study is presented to demonstrate the feasibility of the suggested methodology.
基金Supported by the National Natural Science Foundation of China(No.60801053)the Beijing Natural Science Foundation (No.4082025)+4 种基金the Doctoral Foundation of China (No.20070004037)the Fundamental Research Funds for the Central Universities (Nos.2009JBM135 and 2011JBM023)the BJTU Hongguoyuan Innovative Talent Program (No.151139522)the Beijing Excellent Doctoral Thesis Program (No.YB20081000401)the National Key Basic Research and Development (973) Program of China (No.2006CB303105)
文摘Creating realistic virtual humans has been a challenging objective in computer science research for some time. This paper describes an integrated framework for modeling virtual humans with a high level of autonomy. The framework seeks to reproduce human-like believable behavior and movement in virtual humans in a virtual environment. The framework includes a visual and auditory information perception module, a decision network based behavior decision module, and a hierarchical autonomous motion control module. These cooperate to model realistic autonomous individual behavior for virtual humans in real-time interactive virtual environments. The framework was tested in a simulated virtual environment system to demonstrate the ability of the framework to create autonomous, perceptive and intelligent virtual humans in real-time virtual environments.
文摘The simulation of human in the distributed virtual environment is different from the simulation of vehicle. Due to the human’s many joints, to implement the real time performance of the interaction between the virtual human and the environment, the quantity of information broadcasted in the network will be increased. So with the growing of the quantity of virtual human added to the network, the network burthen would augment rapidly. Therefore, for the simulation of virtual human this paper divides organically the motion parts of the body, which makes those body parts that often interact with the environment are described according to the joints while other parts are described according to the action information. Simultaneity, this paper adopts Dead Reckoning to reduce the quantity of information needed by maintaining the reality motion of virtual human. The experiment indicates that the forecasting display technique can efficiently reduce the network burthen and enhance the interaction of virtual human.
文摘In order to provide a simple and efficient approach to perform the real-time interactive motion control of virtual human in virtual maintenance environment(VME),the motion control method of virtual human based on limited input information is proposed.With the space position tracking system with only one sensor the action sequences and motion models of virtual human,the human motions and hand actions in VME are driven by the sensor data in stages and in real time through the transmission condition control in the process of maintenance operation.And the input data and information is processed based on the method of Kalman filtering and wavelet transforming to improve the control effects.An experimental VME is also established to validate the control efficiency,and the experiment results show that the space motion control of virtual human in VME can be performed based on limited information with proposed control strategy.
基金the Opening Foundation of the Science and Technology on Human Factors Engineering Laboratory,Chinese Astronaut Research and Training Centergrant numder:HF2011-K-04
文摘The ergonomic digital design and evaluation of man-machine system is the main application fields of virtual human technology. Because of the complexity of physical person and uncertainty of fatigue generation mechanism, it is difficult to express a nd evaluate the Virtual Human's fatigue state. This paper summarizes the characteristics of virtual human's fatigue evaluation, such as undeterminable, invisible, the constraint conditions can been used. Viewed from the strengths and weaknesses of preexisting models, metabolic energy expenditure model, dynamic muscle fatigue model and a model to assess fatigue at joint-level using the half-joint concept, this paper puts forward the future development trend that the combination of subjective and objective,diversificationoftheanalyzablemotion,real-timeandvisualexpression.
基金supported by the National Natural Science Foundation of China(Grant No.60573059)Beijing Key Laboratory of Modern Information Science and Network Technology(No.TDXX0503)and Key Foundation of USTB.
文摘Emotion plays an essential role in the adaptation and social communication of organisms.Similarly,an appro-priately timed and clearly expressed emotion is a central requirement for believable interactive virtual humans.Presently,incorporating emotion into virtual humans has gained increasing attention in the academia and industry.This strong interest is driven by a wide spectrum of promising applications in many areas such as virtual reality,e-learning,entertainment,etc.This paper introduces an emotion model of artificial psychology,in which the transition of emotion can be viewed as a Markov process and the relation of emotion,external incentive and personality can be described by a Markov decision process(MDP).In order to demonstrate the approach,this paper integrates the emotion model into a system composed of voice recognition and a realistic facial model.Thus,the model could be used for generating a variety of emotional expressions of autonomous,interactive virtual human beings.
基金This project is supported by National Natural Science Foundation of China (No.59990470-2).
文摘The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disassembly is built, and the corresponding human-computer system for stable virtual disassembly is developed. In this system, an immersive and interactive virtual disassembly environment has been created to provide planners with a more visual working scene. For cooperative disassembly, an intelligent module of stability analysis of disassembly operations is embedded into the human-computer system to assist planners to implement disassembly tasks better. The supporting matrix for stability analysis of disassembly operations is defined and the method of stability analysis is detailed. Based on the approach, the stability of any disassembly operation can be analyzed to instruct the manual virtual disassembly. At last, a disassembly case in the virtual environment is given to prove the validity of above ideas.
文摘This paper presents an image processing design flow for virtual fitting room (VFR) applications, targeting both personal computers and mobile devices. The proposed human friendly interface is implemented by a three-stage algorithm: Detection and sizing of the user's body, detection of reference points based on face detection and augmented reality markers, and superimposition of the clothing over the user's image. Compared to other existing VFR systems, key difference is the lack of any proprietary hardware components or peripherals. Proposed VFR is software based and designed to be universally compatible as long as the device has a camera. Furthermore, JAVA implementation on Android based mobile systems is computationally efficient and it can run in real-time on existing mobile devices.
