This article describes a pilot study aiming at generating social interactions between a humanoid robot and adolescents with autism spectrum disorder (ASD), through the practice of a gesture imitation game. The partici...This article describes a pilot study aiming at generating social interactions between a humanoid robot and adolescents with autism spectrum disorder (ASD), through the practice of a gesture imitation game. The participants were a 17-year-old young lady with ASD and intellectual deficit, and a control participant: a preadolescent with ASD but no intellectual deficit (Asperger syndrome). The game is comprised of four phases: greetings, pairing, imitation, and closing. Field educators were involved, playing specific roles: visual or physical inciter. The use of a robot allows for catching the participants’ attention, playing the imitation game for a longer period of time than with a human partner, and preventing the game partner’s negative facial expressions resulting from tiredness, impatience, or boredom. The participants’ behavior was observed in terms of initial approach towards the robot, positioning relative to the robot in terms of distance and orientation, reactions to the robot’s voice or moves, signs of happiness, and imitation attempts. Results suggest a more and more natural approach towards the robot during the sessions, as well as a higher level of social interaction, based on the variations of the parameters listed above. We use these preliminary results to draw the next steps of our research work as well as identify further perspectives, with this aim in mind: improving social interactions with adolescents with ASD and intellectual deficit, allowing for better integration of these people into our societies.展开更多
With the growing application of intelligent robots in service,manufacturing,and medical fields,efficient and natural interaction between humans and robots has become key to improving collaboration efficiency and user ...With the growing application of intelligent robots in service,manufacturing,and medical fields,efficient and natural interaction between humans and robots has become key to improving collaboration efficiency and user experience.Gesture recognition,as an intuitive and contactless interaction method,can overcome the limitations of traditional interfaces and enable real-time control and feedback of robot movements and behaviors.This study first reviews mainstream gesture recognition algorithms and their application on different sensing platforms(RGB cameras,depth cameras,and inertial measurement units).It then proposes a gesture recognition method based on multimodal feature fusion and a lightweight deep neural network that balances recognition accuracy with computational efficiency.At system level,a modular human-robot interaction architecture is constructed,comprising perception,decision,and execution layers,and gesture commands are transmitted and mapped to robot actions in real time via the ROS communication protocol.Through multiple comparative experiments on public gesture datasets and a self-collected dataset,the proposed method’s superiority is validated in terms of accuracy,response latency,and system robustness,while user-experience tests assess the interface’s usability.The results provide a reliable technical foundation for robot collaboration and service in complex scenarios,offering broad prospects for practical application and deployment.展开更多
Three-dimensional curved shock wave/boundary layer interaction with streamwise and spanwise curvatures widely exists in practical aerodynamic design.To explore the effects of composite shock curvatures on boundary lay...Three-dimensional curved shock wave/boundary layer interaction with streamwise and spanwise curvatures widely exists in practical aerodynamic design.To explore the effects of composite shock curvatures on boundary layer separation,a canonical model with a cone placed above plate was utilized as a reference.Configurations of straight,convex,and concave conical shock waves inducing the curved conical shock wave/boundary layer interactions were studied,using CFD based on Reynolds-averaged numerical simulation method.The flow structure and separation region of each case were discussed quantitively on the symmetry plane,flat plate,and plane perpendicular to flow direction,respectively.The focus of the analysis was on the characteristic patterns of separation scale variation in the streamwise and spanwise directions,which were observed to consistently change with respect to both directions with alterations in the incident shock wave shape.A simplified control volume model was established to qualitatively discuss the influence source of curved shock waves on separation scales,based on mass conservation equations.The results suggest that the curved shock wave has a holistic effect on separation,which is not solely dependent on the shock foot strength.展开更多
Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results ca...Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.展开更多
In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we ...In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we present a magnetic array assisted sliding triboelectric sensor for achieving a real-time gesture interaction between a human hand and robotic hand.With a finger’s traction movement of flexion or extension,the sensor can induce positive/negative pulse signals.Through counting the pulses in unit time,the degree,speed,and direction of finger motion can be judged in realtime.The magnetic array plays an important role in generating the quantifiable pulses.The designed two parts of magnetic array can transform sliding motion into contact-separation and constrain the sliding pathway,respectively,thus improve the durability,low speed signal amplitude,and stability of the system.This direct quantization approach and optimization of wearable gesture sensor provide a new strategy for achieving a natural,intuitive,and real-time human-robotic interaction.展开更多
Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture ...Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.展开更多
The interaction of arbitrarily distributed penny-shaped cracks in three-dimensional solids is analyzed in this paper. Using oblate spheroidal coordinates and displacement functions, an analytic method is devel- oped i...The interaction of arbitrarily distributed penny-shaped cracks in three-dimensional solids is analyzed in this paper. Using oblate spheroidal coordinates and displacement functions, an analytic method is devel- oped in which the opening and the sliding displacements on each crack surface are taken as the basic unknown functions. The basic unknown functions can be expanded in series of Legendre polynomials with unknown coefficients. Based on superposition technique, a set of governing equations for the unknown coefficients are formulated from the traction free conditions on each crack surface. The boundary collocation procedure and the average method for crack-surface tractions are used for solving the governing equations. The solution can be obtained for quite closely located cracks. Numerical examples are given for several crack problems. By comparing the present results with other existing results, one can conclude that the present method provides a direct and efficient approach to deal with three-dimensional solids containing multiple cracks.展开更多
Understanding the pore water pressure distribution in unsaturated soil is crucial in predicting shallow landslides triggered by rainfall,mainly when dealing with different temporal patterns of rainfall intensity.Howev...Understanding the pore water pressure distribution in unsaturated soil is crucial in predicting shallow landslides triggered by rainfall,mainly when dealing with different temporal patterns of rainfall intensity.However,the hydrological response of vegetated slopes,especially three-dimensional(3D)slopes covered with shrubs,under different rainfall patterns remains unclear and requires further investigation.To address this issue,this study adopts a novel 3D numerical model for simulating hydraulic interactions between the root system of the shrub and the surrounding soil.Three series of numerical parametric studies are conducted to investigate the influences of slope inclination,rainfall pattern and rainfall duration.Four rainfall patterns(advanced,bimodal,delayed,and uniform)and two rainfall durations(4-h intense and 168-h mild rainfall)are considered to study the hydrological response of the slope.The computed results show that 17%higher transpiration-induced suction is found for a steeper slope,which remains even after a short,intense rainfall with a 100-year return period.The extreme rainfalls with advanced(PA),bimodal(PB)and uniform(PU)rainfall patterns need to be considered for the short rainfall duration(4 h),while the delayed(PD)and uniform(PU)rainfall patterns are highly recommended for long rainfall durations(168 h).The presence of plants can improve slope stability markedly under extreme rainfall with a short duration(4 h).For the long duration(168 h),the benefit of the plant in preserving pore-water pressure(PWP)and slope stability may not be sufficient.展开更多
With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of research.Gesture is one of...With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of research.Gesture is one of the most important communication methods of human beings,which can effectively express users'demands.In the past few decades,gesture-based interaction has made significant progress.This article focuses on the gesture interaction technology and discusses the definition and classification of gestures,input devices for gesture interaction,and gesture interaction recognition technology.The application of gesture interaction technology in virtual reality is studied,the existing problems in the current gesture interaction are summarized,and the future development is prospected.展开更多
Three-dimensional holographic vector of atomic interaction field（3D-HoVAIF） is used to describe the chemical structures of polychlorinated naphthalenes（PCNs）.After variable screening by stepwise multiple regressio...Three-dimensional holographic vector of atomic interaction field（3D-HoVAIF） is used to describe the chemical structures of polychlorinated naphthalenes（PCNs）.After variable screening by stepwise multiple regression（SMR） technique,the liner relationships between gas-chromatographic relative retention time（RRT）,298 K supercooled liquid pressures（logPL）,n-octanol/air partition coefficient（logKOA）,n-octanol/water partition coefficient（logKOW）,aqueous solubilities（logSW）,relative in vitro potency values（-logEROD） of PCNs and 3D-HoVAIF descriptors have been established by partial least-square（PLS） regression.The result shows that the 3D-HoVAIF descriptors can be well used to express the quantitative structure-property（activity） relationships of PCNs.Predictive capability of the models has also been demonstrated by leave-one-out cross-validation.Moreover,the predicted values have been presented for those PCNs which are lack of experimentally physico-chemical properties and biological activity by the optimum models.展开更多
Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based ...Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.展开更多
Changes in the water cycle on the Tibetan Plateau(TP)have a significant impact on local agricultural production and livelihoods and its downstream regions.Against the background of widely reported warming and wetting,...Changes in the water cycle on the Tibetan Plateau(TP)have a significant impact on local agricultural production and livelihoods and its downstream regions.Against the background of widely reported warming and wetting,the hydrological cycle has accelerated and the likelihood of extreme weather events and natural disasters occurring(i.e.,snowstorms,floods,landslides,mudslides,and ice avalanches)has also intensified,especially in the highelevation mountainous regions.Thus,an accurate estimation of the intensity and variation of each component of the water cycle is an urgent scientific question for the assessment of plateau environmental changes.Following the transformation and movement of water between the atmosphere,biosphere and hydrosphere,the authors highlight the urgent need to strengthen the three-dimensional comprehensive observation system(including the eddy covariance system;planetary boundary layer tower;profile measurements of temperature,humidity,and wind by microwave radiometers,wind profiler,and radiosonde system;and cloud and precipitation radars)in the TP region and propose a practical implementation plan.The construction of such a three-dimensional observation system is expected to promote the study of environmental changes and natural hazards prevention.展开更多
EyeScreen is a vision-based interaction system which provides a natural gesture interface for humancomputer interaction （HCI） by tracking human fingers and recognizing gestures. Multi-view video images are captured ...EyeScreen is a vision-based interaction system which provides a natural gesture interface for humancomputer interaction （HCI） by tracking human fingers and recognizing gestures. Multi-view video images are captured by two cameras facing a computer screen, which can be used to detect clicking actions of a fingertip and improve the recognition rate. The system enables users to directly interact with rendered objects on the screen. Robustness of the system has been verified by extensive experiments with different user scenarios. EyeScreen can be used in many applications such as intelligent interaction and digital entertainment.展开更多
Although scientific and policy bodies have stated that nanomaterials are not intrinsically toxic, there is interest in evaluating if and how many engineered nanomaterials may do harm to the health of mankind and the e...Although scientific and policy bodies have stated that nanomaterials are not intrinsically toxic, there is interest in evaluating if and how many engineered nanomaterials may do harm to the health of mankind and the ecological environment. The interaction between nano-TiO2 and bovine serum albumin (BSA) was studied by using TDFS and UV methods in this research.展开更多
To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of th...To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.展开更多
In view of the current gesture recognition algorithm based on skin color segmentation is not flexible and has weak resistance to the environment, this paper puts forward a new method of skin color modeling to improve ...In view of the current gesture recognition algorithm based on skin color segmentation is not flexible and has weak resistance to the environment, this paper puts forward a new method of skin color modeling to improve the adaptability of gesture segmentation when it face to different states. The modeling built by double color space instead of only one is compatible both in YCbCr and HSV color space to training the Gaussian model which can update the threshold value for binarization. Finally, this paper designed a natural gesture recognition and interactive systems based on the double color space model. It has shown that the system has a good interactive experience in different environments.展开更多
Hand gesture recognition is a popular topic in computer vision and makes human-computer interaction more flexible and convenient.The representation of hand gestures is critical for recognition.In this paper,we propose...Hand gesture recognition is a popular topic in computer vision and makes human-computer interaction more flexible and convenient.The representation of hand gestures is critical for recognition.In this paper,we propose a new method to measure the similarity between hand gestures and exploit it for hand gesture recognition.The depth maps of hand gestures captured via the Kinect sensors are used in our method,where the 3D hand shapes can be segmented from the cluttered backgrounds.To extract the pattern of salient 3D shape features,we propose a new descriptor-3D Shape Context,for 3D hand gesture representation.The 3D Shape Context information of each 3D point is obtained in multiple scales because both local shape context and global shape distribution are necessary for recognition.The description of all the 3D points constructs the hand gesture representation,and hand gesture recognition is explored via dynamic time warping algorithm.Extensive experiments are conducted on multiple benchmark datasets.The experimental results verify that the proposed method is robust to noise,articulated variations,and rigid transformations.Our method outperforms state-of-the-art methods in the comparisons of accuracy and efficiency.展开更多
In this paper,the authors present airflow field characteristics of human upper airway and soft palate movement attitude during breathing.On the basis of the data taken from the spiral computerized tomography images of...In this paper,the authors present airflow field characteristics of human upper airway and soft palate movement attitude during breathing.On the basis of the data taken from the spiral computerized tomography images of a healthy person and a patient with Obstructive Sleep Apnea-Hypopnea Syndrome(OSAHS),three-dimensional models of upper airway cavity and soft palate are reconstructed by the method of surface rendering.Numerical simulation is performed for airflow in the upper airway and displacement of soft palate by fluid-structure interaction analysis.The reconstructed threedimensional models precisely preserve the original configuration of upper airways and soft palate.The results of the pressure and velocity distributions in the airflow field are quantitatively determined,and the displacement of soft palate is presented.Pressure gradients of airway are lower for the healthy person and the airflow distribution is quite uniform in the case of free breathing.However,the OSAHS patient remarkably escalates both the pressure and velocity in the upper airway,and causes higher displacement of the soft palate.The present study is useful in revealing pathogenesis and quantitative mutual relationship between configuration and function of the upper airway as well as in diagnosingdiseases related to anatomical structure and function of the upper airway.展开更多
Similar to hydraulic fracturing(HF), the coalescence and fracture of cracks are induced within a rock under the action of an ultrasonic field, known as ultrasonic fracturing(UF). Investigating UF is important in both ...Similar to hydraulic fracturing(HF), the coalescence and fracture of cracks are induced within a rock under the action of an ultrasonic field, known as ultrasonic fracturing(UF). Investigating UF is important in both hard rock drilling and oil and gas recovery. A three-dimensional internal laser-engraved crack(3D-ILC) method was introduced to prefabricate two parallel internal cracks within the samples without any damage to the surface. The samples were subjected to UF. The mechanism of UF was elucidated by analyzing the characteristics of fracture surfaces. The crack propagation path under different ultrasonic parameters was obtained by numerical simulation based on the Paris fatigue model and compared to the experimental results of UF. The results show that the 3D-ILC method is a powerful tool for UF research.Under the action of an ultrasonic field, the fracture surface shows the characteristics of beach marks and contains powder locally, indicating that the UF mechanism includes high-cycle fatigue fracture, shear and friction, and temperature load. The two internal cracks become close under UF. The numerical result obtained by the Paris fatigue model also shows the attraction of the two cracks, consistent with the test results. The 3D-ILC method provides a new tool for the experimental study of UF. Compared to the conventional numerical methods based on the analysis of stress-strain and plastic zone, numerical simulation can be a good alternative method to obtain the crack path under UF.展开更多
In daily life,people use their hands in various ways for most daily activities.There are many applications based on the position,direction,and joints of the hand,including gesture recognition,gesture prediction,roboti...In daily life,people use their hands in various ways for most daily activities.There are many applications based on the position,direction,and joints of the hand,including gesture recognition,gesture prediction,robotics and so on.This paper proposes a gesture prediction system that uses hand joint coordinate features collected by the Leap Motion to predict dynamic hand gestures.The model is applied to the NAO robot to verify the effectiveness of the proposed method.First of all,in order to reduce jitter or jump generated in the process of data acquisition by the Leap Motion,the Kalman filter is applied to the original data.Then some new feature descriptors are introduced.The length feature,angle feature and angular velocity feature are extracted from the filtered data.These features are fed into the long-short time memory recurrent neural network(LSTM-RNN)with different combinations.Experimental results show that the combination of coordinate,length and angle features achieves the highest accuracy of 99.31%,and it can also run in real time.Finally,the trained model is applied to the NAO robot to play the finger-guessing game.Based on the predicted gesture,the NAO robot can respond in advance.展开更多
文摘This article describes a pilot study aiming at generating social interactions between a humanoid robot and adolescents with autism spectrum disorder (ASD), through the practice of a gesture imitation game. The participants were a 17-year-old young lady with ASD and intellectual deficit, and a control participant: a preadolescent with ASD but no intellectual deficit (Asperger syndrome). The game is comprised of four phases: greetings, pairing, imitation, and closing. Field educators were involved, playing specific roles: visual or physical inciter. The use of a robot allows for catching the participants’ attention, playing the imitation game for a longer period of time than with a human partner, and preventing the game partner’s negative facial expressions resulting from tiredness, impatience, or boredom. The participants’ behavior was observed in terms of initial approach towards the robot, positioning relative to the robot in terms of distance and orientation, reactions to the robot’s voice or moves, signs of happiness, and imitation attempts. Results suggest a more and more natural approach towards the robot during the sessions, as well as a higher level of social interaction, based on the variations of the parameters listed above. We use these preliminary results to draw the next steps of our research work as well as identify further perspectives, with this aim in mind: improving social interactions with adolescents with ASD and intellectual deficit, allowing for better integration of these people into our societies.
文摘With the growing application of intelligent robots in service,manufacturing,and medical fields,efficient and natural interaction between humans and robots has become key to improving collaboration efficiency and user experience.Gesture recognition,as an intuitive and contactless interaction method,can overcome the limitations of traditional interfaces and enable real-time control and feedback of robot movements and behaviors.This study first reviews mainstream gesture recognition algorithms and their application on different sensing platforms(RGB cameras,depth cameras,and inertial measurement units).It then proposes a gesture recognition method based on multimodal feature fusion and a lightweight deep neural network that balances recognition accuracy with computational efficiency.At system level,a modular human-robot interaction architecture is constructed,comprising perception,decision,and execution layers,and gesture commands are transmitted and mapped to robot actions in real time via the ROS communication protocol.Through multiple comparative experiments on public gesture datasets and a self-collected dataset,the proposed method’s superiority is validated in terms of accuracy,response latency,and system robustness,while user-experience tests assess the interface’s usability.The results provide a reliable technical foundation for robot collaboration and service in complex scenarios,offering broad prospects for practical application and deployment.
基金the support of the National Natural Science Foundation of China(Nos.12372295,U21B6003,U20A2069,12302389 and 123B2037)。
文摘Three-dimensional curved shock wave/boundary layer interaction with streamwise and spanwise curvatures widely exists in practical aerodynamic design.To explore the effects of composite shock curvatures on boundary layer separation,a canonical model with a cone placed above plate was utilized as a reference.Configurations of straight,convex,and concave conical shock waves inducing the curved conical shock wave/boundary layer interactions were studied,using CFD based on Reynolds-averaged numerical simulation method.The flow structure and separation region of each case were discussed quantitively on the symmetry plane,flat plate,and plane perpendicular to flow direction,respectively.The focus of the analysis was on the characteristic patterns of separation scale variation in the streamwise and spanwise directions,which were observed to consistently change with respect to both directions with alterations in the incident shock wave shape.A simplified control volume model was established to qualitatively discuss the influence source of curved shock waves on separation scales,based on mass conservation equations.The results suggest that the curved shock wave has a holistic effect on separation,which is not solely dependent on the shock foot strength.
基金supported by the National Key R&D Program of China(No.2023YFC3081200)the National Natural Science Foundation of China(No.42077264)the Scientific Research Project of PowerChina Huadong Engineering Corporation Limited(HDEC-2022-0301).
文摘Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.
基金This work was supported by National Natural Science Foundation of China(51902035 and 52073037)Natural Science Foundation of Chongqing(cstc2020jcyj-msxmX0807)+1 种基金the Fundamental Research Funds for the Central Universities(2020CDJ-LHSS-001 and 2019CDXZWL001)Chongqing graduate tutor team construction project(ydstd1832).
文摘In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we present a magnetic array assisted sliding triboelectric sensor for achieving a real-time gesture interaction between a human hand and robotic hand.With a finger’s traction movement of flexion or extension,the sensor can induce positive/negative pulse signals.Through counting the pulses in unit time,the degree,speed,and direction of finger motion can be judged in realtime.The magnetic array plays an important role in generating the quantifiable pulses.The designed two parts of magnetic array can transform sliding motion into contact-separation and constrain the sliding pathway,respectively,thus improve the durability,low speed signal amplitude,and stability of the system.This direct quantization approach and optimization of wearable gesture sensor provide a new strategy for achieving a natural,intuitive,and real-time human-robotic interaction.
基金Supported by the National Natural Science Foundation of China(61773205,61773219)the Fundamental Research Funds for the Central Universities(NS2016032,NS2019018,Nanjing University of Aeronautics and Astronautics)+1 种基金the Scholarship from China Scholarship Council(201906835020)the Fundamental Research Funds for the Central Universities(the Graduate Student Innovation Base Open Fund Project of NUAA,kfjj20190307)。
文摘Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.
文摘The interaction of arbitrarily distributed penny-shaped cracks in three-dimensional solids is analyzed in this paper. Using oblate spheroidal coordinates and displacement functions, an analytic method is devel- oped in which the opening and the sliding displacements on each crack surface are taken as the basic unknown functions. The basic unknown functions can be expanded in series of Legendre polynomials with unknown coefficients. Based on superposition technique, a set of governing equations for the unknown coefficients are formulated from the traction free conditions on each crack surface. The boundary collocation procedure and the average method for crack-surface tractions are used for solving the governing equations. The solution can be obtained for quite closely located cracks. Numerical examples are given for several crack problems. By comparing the present results with other existing results, one can conclude that the present method provides a direct and efficient approach to deal with three-dimensional solids containing multiple cracks.
文摘Understanding the pore water pressure distribution in unsaturated soil is crucial in predicting shallow landslides triggered by rainfall,mainly when dealing with different temporal patterns of rainfall intensity.However,the hydrological response of vegetated slopes,especially three-dimensional(3D)slopes covered with shrubs,under different rainfall patterns remains unclear and requires further investigation.To address this issue,this study adopts a novel 3D numerical model for simulating hydraulic interactions between the root system of the shrub and the surrounding soil.Three series of numerical parametric studies are conducted to investigate the influences of slope inclination,rainfall pattern and rainfall duration.Four rainfall patterns(advanced,bimodal,delayed,and uniform)and two rainfall durations(4-h intense and 168-h mild rainfall)are considered to study the hydrological response of the slope.The computed results show that 17%higher transpiration-induced suction is found for a steeper slope,which remains even after a short,intense rainfall with a 100-year return period.The extreme rainfalls with advanced(PA),bimodal(PB)and uniform(PU)rainfall patterns need to be considered for the short rainfall duration(4 h),while the delayed(PD)and uniform(PU)rainfall patterns are highly recommended for long rainfall durations(168 h).The presence of plants can improve slope stability markedly under extreme rainfall with a short duration(4 h).For the long duration(168 h),the benefit of the plant in preserving pore-water pressure(PWP)and slope stability may not be sufficient.
基金National Key Research and Development(2016YFB1001405)Frontier Subject Key Research(QYZDY-SSW-JSC041)Chinese Academy of Sciences hundred people,National Natural Science Foundation of China(61572479)project support.
文摘With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of research.Gesture is one of the most important communication methods of human beings,which can effectively express users'demands.In the past few decades,gesture-based interaction has made significant progress.This article focuses on the gesture interaction technology and discusses the definition and classification of gestures,input devices for gesture interaction,and gesture interaction recognition technology.The application of gesture interaction technology in virtual reality is studied,the existing problems in the current gesture interaction are summarized,and the future development is prospected.
基金supported by the Ministry of Science and Technology of China (2010DFA32680)the National Natural Science Foundation of China (21005062)the Fundamental Research Funds for the Central Universities (CDJRC10220010)
文摘Three-dimensional holographic vector of atomic interaction field（3D-HoVAIF） is used to describe the chemical structures of polychlorinated naphthalenes（PCNs）.After variable screening by stepwise multiple regression（SMR） technique,the liner relationships between gas-chromatographic relative retention time（RRT）,298 K supercooled liquid pressures（logPL）,n-octanol/air partition coefficient（logKOA）,n-octanol/water partition coefficient（logKOW）,aqueous solubilities（logSW）,relative in vitro potency values（-logEROD） of PCNs and 3D-HoVAIF descriptors have been established by partial least-square（PLS） regression.The result shows that the 3D-HoVAIF descriptors can be well used to express the quantitative structure-property（activity） relationships of PCNs.Predictive capability of the models has also been demonstrated by leave-one-out cross-validation.Moreover,the predicted values have been presented for those PCNs which are lack of experimentally physico-chemical properties and biological activity by the optimum models.
基金National Innovation and Entrepreneurship Program for College Students(202218213001)Science and Technology Innovation Strategy of Guangdong Province(Science and Technology Innovation Cultivation of University Students 2020329182130C000002).
文摘Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.
基金This research was jointly funded by the Second Tibetan Plateau Scientific Expedition and Research Program(Grant Nos.2019QZKK0103 and 2019QZKK0105)the National Natural Science Foundation of China(Grant Nos.91837208 and 42075085).
文摘Changes in the water cycle on the Tibetan Plateau(TP)have a significant impact on local agricultural production and livelihoods and its downstream regions.Against the background of widely reported warming and wetting,the hydrological cycle has accelerated and the likelihood of extreme weather events and natural disasters occurring(i.e.,snowstorms,floods,landslides,mudslides,and ice avalanches)has also intensified,especially in the highelevation mountainous regions.Thus,an accurate estimation of the intensity and variation of each component of the water cycle is an urgent scientific question for the assessment of plateau environmental changes.Following the transformation and movement of water between the atmosphere,biosphere and hydrosphere,the authors highlight the urgent need to strengthen the three-dimensional comprehensive observation system(including the eddy covariance system;planetary boundary layer tower;profile measurements of temperature,humidity,and wind by microwave radiometers,wind profiler,and radiosonde system;and cloud and precipitation radars)in the TP region and propose a practical implementation plan.The construction of such a three-dimensional observation system is expected to promote the study of environmental changes and natural hazards prevention.
基金Sponsored by the National Natural Science Foundation of China(60473049)the National Hi-Tech R&D programof China(2006AA01Z120)
文摘EyeScreen is a vision-based interaction system which provides a natural gesture interface for humancomputer interaction （HCI） by tracking human fingers and recognizing gestures. Multi-view video images are captured by two cameras facing a computer screen, which can be used to detect clicking actions of a fingertip and improve the recognition rate. The system enables users to directly interact with rendered objects on the screen. Robustness of the system has been verified by extensive experiments with different user scenarios. EyeScreen can be used in many applications such as intelligent interaction and digital entertainment.
基金Suppoted by National Nature Science Foundation of China (Grant Nos. 41130746, 41272371)the Doctor Foundation of SWUST of China (Grant No. 11zx7139)
文摘Although scientific and policy bodies have stated that nanomaterials are not intrinsically toxic, there is interest in evaluating if and how many engineered nanomaterials may do harm to the health of mankind and the ecological environment. The interaction between nano-TiO2 and bovine serum albumin (BSA) was studied by using TDFS and UV methods in this research.
基金The National Natural Science Foundation of China(No.51875332)the Capacity Building Projects of Some Local Universities of Shanghai Science and Technology Commission(No.18040501600).
文摘To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.
文摘In view of the current gesture recognition algorithm based on skin color segmentation is not flexible and has weak resistance to the environment, this paper puts forward a new method of skin color modeling to improve the adaptability of gesture segmentation when it face to different states. The modeling built by double color space instead of only one is compatible both in YCbCr and HSV color space to training the Gaussian model which can update the threshold value for binarization. Finally, this paper designed a natural gesture recognition and interactive systems based on the double color space model. It has shown that the system has a good interactive experience in different environments.
基金supported by the National Natural Science Foundation of China(61773272,61976191)the Six Talent Peaks Project of Jiangsu Province,China(XYDXX-053)Suzhou Research Project of Technical Innovation,Jiangsu,China(SYG201711)。
文摘Hand gesture recognition is a popular topic in computer vision and makes human-computer interaction more flexible and convenient.The representation of hand gestures is critical for recognition.In this paper,we propose a new method to measure the similarity between hand gestures and exploit it for hand gesture recognition.The depth maps of hand gestures captured via the Kinect sensors are used in our method,where the 3D hand shapes can be segmented from the cluttered backgrounds.To extract the pattern of salient 3D shape features,we propose a new descriptor-3D Shape Context,for 3D hand gesture representation.The 3D Shape Context information of each 3D point is obtained in multiple scales because both local shape context and global shape distribution are necessary for recognition.The description of all the 3D points constructs the hand gesture representation,and hand gesture recognition is explored via dynamic time warping algorithm.Extensive experiments are conducted on multiple benchmark datasets.The experimental results verify that the proposed method is robust to noise,articulated variations,and rigid transformations.Our method outperforms state-of-the-art methods in the comparisons of accuracy and efficiency.
基金The project supported by the National Natural Science Foundation of China(10672036,10472025 and 10421002)the Natural Science Foundation of Liaoning Province(20032109)
文摘In this paper,the authors present airflow field characteristics of human upper airway and soft palate movement attitude during breathing.On the basis of the data taken from the spiral computerized tomography images of a healthy person and a patient with Obstructive Sleep Apnea-Hypopnea Syndrome(OSAHS),three-dimensional models of upper airway cavity and soft palate are reconstructed by the method of surface rendering.Numerical simulation is performed for airflow in the upper airway and displacement of soft palate by fluid-structure interaction analysis.The reconstructed threedimensional models precisely preserve the original configuration of upper airways and soft palate.The results of the pressure and velocity distributions in the airflow field are quantitatively determined,and the displacement of soft palate is presented.Pressure gradients of airway are lower for the healthy person and the airflow distribution is quite uniform in the case of free breathing.However,the OSAHS patient remarkably escalates both the pressure and velocity in the upper airway,and causes higher displacement of the soft palate.The present study is useful in revealing pathogenesis and quantitative mutual relationship between configuration and function of the upper airway as well as in diagnosingdiseases related to anatomical structure and function of the upper airway.
基金supported by the National Natural Science Foundation of China (Grant Nos. 52104125, U1765204 and 51739008)
文摘Similar to hydraulic fracturing(HF), the coalescence and fracture of cracks are induced within a rock under the action of an ultrasonic field, known as ultrasonic fracturing(UF). Investigating UF is important in both hard rock drilling and oil and gas recovery. A three-dimensional internal laser-engraved crack(3D-ILC) method was introduced to prefabricate two parallel internal cracks within the samples without any damage to the surface. The samples were subjected to UF. The mechanism of UF was elucidated by analyzing the characteristics of fracture surfaces. The crack propagation path under different ultrasonic parameters was obtained by numerical simulation based on the Paris fatigue model and compared to the experimental results of UF. The results show that the 3D-ILC method is a powerful tool for UF research.Under the action of an ultrasonic field, the fracture surface shows the characteristics of beach marks and contains powder locally, indicating that the UF mechanism includes high-cycle fatigue fracture, shear and friction, and temperature load. The two internal cracks become close under UF. The numerical result obtained by the Paris fatigue model also shows the attraction of the two cracks, consistent with the test results. The 3D-ILC method provides a new tool for the experimental study of UF. Compared to the conventional numerical methods based on the analysis of stress-strain and plastic zone, numerical simulation can be a good alternative method to obtain the crack path under UF.
基金supported in part by National Nature Science Foundation of China(NSFC)(U20A20200,61861136009)in part by Guangdong Basic and Applied Basic Research Foundation(2019B1515120076,2020B1515120054)in part by Industrial Key Technologies R&D Program of Foshan(2020001006308)。
文摘In daily life,people use their hands in various ways for most daily activities.There are many applications based on the position,direction,and joints of the hand,including gesture recognition,gesture prediction,robotics and so on.This paper proposes a gesture prediction system that uses hand joint coordinate features collected by the Leap Motion to predict dynamic hand gestures.The model is applied to the NAO robot to verify the effectiveness of the proposed method.First of all,in order to reduce jitter or jump generated in the process of data acquisition by the Leap Motion,the Kalman filter is applied to the original data.Then some new feature descriptors are introduced.The length feature,angle feature and angular velocity feature are extracted from the filtered data.These features are fed into the long-short time memory recurrent neural network(LSTM-RNN)with different combinations.Experimental results show that the combination of coordinate,length and angle features achieves the highest accuracy of 99.31%,and it can also run in real time.Finally,the trained model is applied to the NAO robot to play the finger-guessing game.Based on the predicted gesture,the NAO robot can respond in advance.
