This paper is devoted to the two-dimensional nonlinear modeling of the fluid-solid interaction (FSI) between fabric and air flow, which is based on the Automatic Incremental Dynamic Nonlinear Analysis (AIDNA)-FSI prog...This paper is devoted to the two-dimensional nonlinear modeling of the fluid-solid interaction (FSI) between fabric and air flow, which is based on the Automatic Incremental Dynamic Nonlinear Analysis (AIDNA)-FSI program in order to study the dynamic bending features of fabrics in a specific air flow filed. The computational fluid dynamics (CFD) model for flow and the finite element model (FEM) for fabric was set up to constitute an FSI model in which the geometric nonlinear behavior and the dynamic stress-strain variation of the relatively soft fabric material were taken into account. Several FSI cases with different time-dependent wind load and the model frequency analysis for fabric were carried out. The dynamic response of fabric and the distribution of fluid variables were investigated. The results of numerical simulation and experiments fit quite well. Hence, this work contributes to the research of modeling the dynamic bending behavior of fabrics in air field.展开更多
In recent years,deep learning has been widely applied in the fields of recommendation systems and click-through rate(CTR)prediction,and thus recommendation models incorporating deep learning have emerged.In addition,t...In recent years,deep learning has been widely applied in the fields of recommendation systems and click-through rate(CTR)prediction,and thus recommendation models incorporating deep learning have emerged.In addition,the design and implementation of recommendation models using information related to user behavior sequences is an important direction of current research in recommendation systems,and models calculate the likelihood of users clicking on target items based on their behavior sequence information.In order to explore the relationship between features,this paper improves and optimizes on the basis of deep interest network(DIN)proposed by Ali’s team.Based on the user behavioral sequences information,the attentional factorization machine(AFM)is integrated to obtain richer and more accurate behavioral sequence information.In addition,this paper designs a new way of calculating attention weights,which uses the relationship between the cosine similarity of any two vectors and the absolute value of their modal length difference to measure their relevance degree.Thus,a novel deep learning CTR prediction mode is proposed,that is,the CTR prediction network based on user behavior sequence and feature interactions deep interest and machines network(DIMN).We conduct extensive comparison experiments on three public datasets and one private music dataset,which are more recognized in the industry,and the results show that the DIMN obtains a better performance compared with the classical CTR prediction model.展开更多
With the rapid expansion of social media,analyzing emotions and their causes in texts has gained significant importance.Emotion-cause pair extraction enables the identification of causal relationships between emotions...With the rapid expansion of social media,analyzing emotions and their causes in texts has gained significant importance.Emotion-cause pair extraction enables the identification of causal relationships between emotions and their triggers within a text,facilitating a deeper understanding of expressed sentiments and their underlying reasons.This comprehension is crucial for making informed strategic decisions in various business and societal contexts.However,recent research approaches employing multi-task learning frameworks for modeling often face challenges such as the inability to simultaneouslymodel extracted features and their interactions,or inconsistencies in label prediction between emotion-cause pair extraction and independent assistant tasks like emotion and cause extraction.To address these issues,this study proposes an emotion-cause pair extraction methodology that incorporates joint feature encoding and task alignment mechanisms.The model consists of two primary components:First,joint feature encoding simultaneously generates features for emotion-cause pairs and clauses,enhancing feature interactions between emotion clauses,cause clauses,and emotion-cause pairs.Second,the task alignment technique is applied to reduce the labeling distance between emotion-cause pair extraction and the two assistant tasks,capturing deep semantic information interactions among tasks.The proposed method is evaluated on a Chinese benchmark corpus using 10-fold cross-validation,assessing key performance metrics such as precision,recall,and F1 score.Experimental results demonstrate that the model achieves an F1 score of 76.05%,surpassing the state-of-the-art by 1.03%.The proposed model exhibits significant improvements in emotion-cause pair extraction(ECPE)and cause extraction(CE)compared to existing methods,validating its effectiveness.This research introduces a novel approach based on joint feature encoding and task alignment mechanisms,contributing to advancements in emotion-cause pair extraction.However,the study’s limitation lies in the data sources,potentially restricting the generalizability of the findings.展开更多
Semantic segmentation of remote sensing images is a critical research area in the field of remote sensing.Despite the success of Convolutional Neural Networks(CNNs),they often fail to capture inter-layer feature relat...Semantic segmentation of remote sensing images is a critical research area in the field of remote sensing.Despite the success of Convolutional Neural Networks(CNNs),they often fail to capture inter-layer feature relationships and fully leverage contextual information,leading to the loss of important details.Additionally,due to significant intraclass variation and small inter-class differences in remote sensing images,CNNs may experience class confusion.To address these issues,we propose a novel Category-Guided Feature Collaborative Learning Network(CG-FCLNet),which enables fine-grained feature extraction and adaptive fusion.Specifically,we design a Feature Collaborative Learning Module(FCLM)to facilitate the tight interaction of multi-scale features.We also introduce a Scale-Aware Fusion Module(SAFM),which iteratively fuses features from different layers using a spatial attention mechanism,enabling deeper feature fusion.Furthermore,we design a Category-Guided Module(CGM)to extract category-aware information that guides feature fusion,ensuring that the fused featuresmore accurately reflect the semantic information of each category,thereby improving detailed segmentation.The experimental results show that CG-FCLNet achieves a Mean Intersection over Union(mIoU)of 83.46%,an mF1 of 90.87%,and an Overall Accuracy(OA)of 91.34% on the Vaihingen dataset.On the Potsdam dataset,it achieves a mIoU of 86.54%,an mF1 of 92.65%,and an OA of 91.29%.These results highlight the superior performance of CG-FCLNet compared to existing state-of-the-art methods.展开更多
Heart disease includes a multiplicity of medical conditions that affect the structure,blood vessels,and general operation of the heart.Numerous researchers have made progress in correcting and predicting early heart d...Heart disease includes a multiplicity of medical conditions that affect the structure,blood vessels,and general operation of the heart.Numerous researchers have made progress in correcting and predicting early heart disease,but more remains to be accomplished.The diagnostic accuracy of many current studies is inadequate due to the attempt to predict patients with heart disease using traditional approaches.By using data fusion from several regions of the country,we intend to increase the accuracy of heart disease prediction.A statistical approach that promotes insights triggered by feature interactions to reveal the intricate pattern in the data,which cannot be adequately captured by a single feature.We processed the data using techniques including feature scaling,outlier detection and replacement,null and missing value imputation,and more to improve the data quality.Furthermore,the proposed feature engineering method uses the correlation test for numerical features and the chi-square test for categorical features to interact with the feature.To reduce the dimensionality,we subsequently used PCA with 95%variation.To identify patients with heart disease,hyperparameter-based machine learning algorithms like RF,XGBoost,Gradient Boosting,LightGBM,CatBoost,SVM,and MLP are utilized,along with ensemble models.The model’s overall prediction performance ranges from 88%to 92%.In order to attain cutting-edge results,we then used a 1D CNN model,which significantly enhanced the prediction with an accuracy score of 96.36%,precision of 96.45%,recall of 96.36%,specificity score of 99.51%and F1 score of 96.34%.The RF model produces the best results among all the classifiers in the evaluation matrix without feature interaction,with accuracy of 90.21%,precision of 90.40%,recall of 90.86%,specificity of 90.91%,and F1 score of 90.63%.Our proposed 1D CNN model is 7%superior to the one without feature engineering when compared to the suggested approach.This illustrates how interaction-focused feature analysis can produce precise and useful insights for heart disease diagnosis.展开更多
Identifying drug-drug interactions(DDIs)is essential to prevent adverse effects from polypharmacy.Although deep learning has advanced DDI identification,the gap between powerful models and their lack of clinical appli...Identifying drug-drug interactions(DDIs)is essential to prevent adverse effects from polypharmacy.Although deep learning has advanced DDI identification,the gap between powerful models and their lack of clinical application and evaluation has hindered clinical benefits.Here,we developed a Multi-Dimensional Feature Fusion model named MDFF,which integrates one-dimensional simplified molec-ular input line entry system sequence features,two-dimensional molecular graph features,and three-dimensional geometric features to enhance drug representations for predicting DDIs.MDFF was trained and validated on two DDI datasets,evaluated across three distinct scenarios,and compared with advanced DDI prediction models using accuracy,precision,recall,area under the curve,and F1 score metrics.MDFF achieved state-of-the-art performance across all metrics.Ablation experiments showed that integrating multi-dimensional drug features yielded the best results.More importantly,we obtained adverse drug reaction reports uploaded by Xiangya Hospital of Central South University from 2021 to 2023 and used MDFF to identify potential adverse DDIs.Among 12 real-world adverse drug reaction reports,the predictions of 9 reports were supported by relevant evidence.Additionally,MDFF demon-strated the ability to explain adverse DDI mechanisms,providing insights into the mechanisms behind one specific report and highlighting its potential to assist practitioners in improving medical practice.展开更多
This paper focuses on the connection between the Flourishing Tang Features and Li Bai’s landscape poems,exploring their interactive relationship from three main dimensions.Firstly,the Flourishing Tang Dynasty,charact...This paper focuses on the connection between the Flourishing Tang Features and Li Bai’s landscape poems,exploring their interactive relationship from three main dimensions.Firstly,the Flourishing Tang Dynasty,characterized by political stability,economic prosperity,and cultural openness,nourished Li Bai’s landscape poems.Geographically,the expanded territory and smooth transportation broadened his creative vision,enabling his works to break away from the narrow local landscape and present a cosmic perspective covering landscapes like the Yellow River,Yangtze River,and Tianshan Mountains;spiritually,the era’s emphasis on active engagement in society shaped the core of his poems,transforming landscape writing from a tool for seclusion to a medium for expressing lofty aspirations.Secondly,Li Bai’s landscape poems projected the Flourishing Tang Features:Grand landscape images echoed the dynasty’s vast territory and national confidence;free artistic conceptions reflected the dynasty’s cultural inclusiveness and ideological emancipation;the integration of landscapes with ideals manifested the scholars’commitment to serving the country.Finally,the two achieved spiritual interaction:In spatial terms,the dynasty’s vast territory aligned with Li Bai’s broad spatial vision;in values,the era’s balance between engagement and freedom matched his combination of wandering and ambition;in spirit,the dynasty’s confidence resonated with his heroic and free emotions.In summary,the Flourishing Tang Features provided a creative foundation for Li Bai,while his landscape poems materialized and spread the Tang spirit,jointly forming a unique cultural legacy of the Tang Dynasty.展开更多
With the growing application of intelligent robots in service,manufacturing,and medical fields,efficient and natural interaction between humans and robots has become key to improving collaboration efficiency and user ...With the growing application of intelligent robots in service,manufacturing,and medical fields,efficient and natural interaction between humans and robots has become key to improving collaboration efficiency and user experience.Gesture recognition,as an intuitive and contactless interaction method,can overcome the limitations of traditional interfaces and enable real-time control and feedback of robot movements and behaviors.This study first reviews mainstream gesture recognition algorithms and their application on different sensing platforms(RGB cameras,depth cameras,and inertial measurement units).It then proposes a gesture recognition method based on multimodal feature fusion and a lightweight deep neural network that balances recognition accuracy with computational efficiency.At system level,a modular human-robot interaction architecture is constructed,comprising perception,decision,and execution layers,and gesture commands are transmitted and mapped to robot actions in real time via the ROS communication protocol.Through multiple comparative experiments on public gesture datasets and a self-collected dataset,the proposed method’s superiority is validated in terms of accuracy,response latency,and system robustness,while user-experience tests assess the interface’s usability.The results provide a reliable technical foundation for robot collaboration and service in complex scenarios,offering broad prospects for practical application and deployment.展开更多
Interactivity in online newspapers is the focus of this chapter in eliciting readers’evaluation of Zambian online newspapers.This aspect of the study investigates and characterises the motivations(gratification sough...Interactivity in online newspapers is the focus of this chapter in eliciting readers’evaluation of Zambian online newspapers.This aspect of the study investigates and characterises the motivations(gratification sought)for use of interactivity features(“process motivation”)and how widely they are used.It also attempts to ascertain the gratification obtained from their use among readers.The probable relationships between use of the interactivity features(“audience interactivity”)and gratification obtained from them(“process gratification”)and the impact of the perceived credibility of the online newspapers on gratification are also examined.Past studies present mixed results on use of interactivity and gratification obtained from it.This study finds that use of interactivity in Zambian online newspapers is at a low level,although among the three broad categorisations of features of online newspapers,interactivity attracts greater use than hyper-textuality and multi-mediality.Human interactivity features-“knowing what others think about an issue”,“chat on the Facebook page of the newspaper”,“ability to navigate on the Facebook page of the newspaper”,and“posting own comments on stories”-are the main motivations for use of online newspapers,the most frequently used,and the most gratifying to the readers.While readers express an interest in interacting with other readers via online newspapers,they seem less interested in posting their own stories as“citizen journalists”and linking up with the publishers and editors.This finding challenges the notion that all new media are catalysts of participatory and cyclic communication.展开更多
The dynamical features of air-sea coupling waves and their stabilities in a simple coupled air-sea model in the tropics have been studied with respect to interaction occurring among different types of the free waves i...The dynamical features of air-sea coupling waves and their stabilities in a simple coupled air-sea model in the tropics have been studied with respect to interaction occurring among different types of the free waves in the o-cean and in the atmosphere. It is pointed out that there exist a stable and an unstable air-sea interaction modes in the tropical coupled system , respectively. The propagation of the unstable mode relies greatly on the zonal space scale, i. e. only for wave length ranging from 5 000 km to 10 000 km can the disturbance unstably move slowly eastward. The waves that slowly propagate unstably eastward agree well with the observational facts. Finally,it is also proposed that the interaction between Kelvin wave in one medium and Rossby wave in another medium is a necessary condition for the occurrence of destabilization of the coupled air-sea system in the tropics.展开更多
Scene perception and trajectory forecasting are two fundamental challenges that are crucial to a safe and reliable autonomous driving(AD)system.However,most proposed methods aim at addressing one of the two challenges...Scene perception and trajectory forecasting are two fundamental challenges that are crucial to a safe and reliable autonomous driving(AD)system.However,most proposed methods aim at addressing one of the two challenges mentioned above with a single model.To tackle this dilemma,this paper proposes spatio-temporal semantics and interaction graph aggregation for multi-agent perception and trajectory forecasting(STSIGMA),an efficient end-to-end method to jointly and accurately perceive the AD environment and forecast the trajectories of the surrounding traffic agents within a unified framework.ST-SIGMA adopts a trident encoder-decoder architecture to learn scene semantics and agent interaction information on bird’s-eye view(BEV)maps simultaneously.Specifically,an iterative aggregation network is first employed as the scene semantic encoder(SSE)to learn diverse scene information.To preserve dynamic interactions of traffic agents,ST-SIGMA further exploits a spatio-temporal graph network as the graph interaction encoder.Meanwhile,a simple yet efficient feature fusion method to fuse semantic and interaction features into a unified feature space as the input to a novel hierarchical aggregation decoder for downstream prediction tasks is designed.Extensive experiments on the nuScenes data set have demonstrated that the proposed ST-SIGMA achieves significant improvements compared to the state-of-theart(SOTA)methods in terms of scene perception and trajectory forecasting,respectively.Therefore,the proposed approach outperforms SOTA in terms of model generalisation and robustness and is therefore more feasible for deployment in realworld AD scenarios.展开更多
Three materials(agar,konjac glucomannan(KGM)andκ-carrageenan)were used to prepare ternary systems,i.e.,sol-gels and their dried composites conditioned at varied relative humidity(RH)(33%,54%and 75%).Combined methods,...Three materials(agar,konjac glucomannan(KGM)andκ-carrageenan)were used to prepare ternary systems,i.e.,sol-gels and their dried composites conditioned at varied relative humidity(RH)(33%,54%and 75%).Combined methods,e.g.,scanning electron microscopy,small-angle X-ray scattering,infrared spectroscopy(IR)and X-ray diffraction(XRD),were used to disclose howκ-carrageenan addition tailors the features of agar/KGM/κ-carrageenan ternary system.As affirmed by IR and XRD,the ternary systems withκ-carrageenan below 25%(agar/KGM/carrageenan,50:25:25,m/m)displayed proper component interactions,which increased the sol-gel transition temperature and the hardness of obtained gels.For instance,the ternary composites could show hardness about 3 to 4 times higher than that for binary counterpart.These gels were dehydrated to acquire ternary composites.Compared to agar/KGM composite,the ternary composites showed fewer crystallites and nanoscale orders,and newly-formed nanoscale structures from chain assembly.Such multi-scale structures,for composites withκ-carrageenan below 25%,showed weaker changes with RH,as revealed by especially morphologic and crystalline features.Consequently,the ternary composites with lessκ-carrageenan(below 25%)exhibited stabilized elongation at break and hydrophilicity at different RHs.This hints to us that agar/KGM/κ-carrageenan composite systems can display series applications with improved features,e.g.,increased sol-gel transition point.展开更多
Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture ...Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.展开更多
This paper proposed a novel multi-view interactive behavior recognition method based on local self-similarity descriptors and graph shared multi-task learning. First, we proposed the composite interactive feature repr...This paper proposed a novel multi-view interactive behavior recognition method based on local self-similarity descriptors and graph shared multi-task learning. First, we proposed the composite interactive feature representation which encodes both the spatial distribution of local motion of interest points and their contexts. Furthermore, local self-similarity descriptor represented by temporal-pyramid bag of words(BOW) was applied to decreasing the influence of observation angle change on recognition and retaining the temporal information. For the purpose of exploring latent correlation between different interactive behaviors from different views and retaining specific information of each behaviors, graph shared multi-task learning was used to learn the corresponding interactive behavior recognition model. Experiment results showed the effectiveness of the proposed method in comparison with other state-of-the-art methods on the public databases CASIA, i3Dpose dataset and self-built database for interactive behavior recognition.展开更多
Offshore carbon dioxide(CO_(2)) geological storage(OCGS) represents a significant strategy for addressing climate change by curtailing greenhouse gas emissions. Nonetheless, the risk of CO_(2) leakage poses a substant...Offshore carbon dioxide(CO_(2)) geological storage(OCGS) represents a significant strategy for addressing climate change by curtailing greenhouse gas emissions. Nonetheless, the risk of CO_(2) leakage poses a substantial concern associated with this technology. This study introduces an innovative approach for establishing OCGS leakage scenarios, involving four pivotal stages, namely, interactive matrix establishment, risk matrix evaluation, cause–effect analysis, and scenario development, which has been implemented in the Pearl River Estuary Basin in China. The initial phase encompassed the establishment of an interaction matrix for OCGS systems based on features, events, and processes. Subsequent risk matrix evaluation and cause–effect analysis identified key system components, specifically CO_(2) injection and faults/features. Building upon this analysis, two leakage risk scenarios were successfully developed, accompanied by the corresponding mitigation measures. In addition, this study introduces the application of scenario development to risk assessment, including scenario numerical simulation and quantitative assessment. Overall, this research positively contributes to the sustainable development and safe operation of OCGS projects and holds potential for further refinement and broader application to diverse geographical environments and project requirements. This comprehensive study provides valuable insights into the establishment of OCGS leakage scenarios and demonstrates their practical application to risk assessment, laying the foundation for promoting the sustainable development and safe operation of ocean CO_(2) geological storage projects while proposing possibilities for future improvements and broader applications to different contexts.展开更多
Gestures are one of the most natural and intuitive approach for human-computer interaction.Compared with traditional camera-based or wearable sensors-based solutions,gesture recognition using the millimeter wave radar...Gestures are one of the most natural and intuitive approach for human-computer interaction.Compared with traditional camera-based or wearable sensors-based solutions,gesture recognition using the millimeter wave radar has attracted growing attention for its characteristics of contact-free,privacy-preserving and less environmentdependence.Although there have been many recent studies on hand gesture recognition,the existing hand gesture recognition methods still have recognition accuracy and generalization ability shortcomings in shortrange applications.In this paper,we present a hand gesture recognition method named multiscale feature fusion(MSFF)to accurately identify micro hand gestures.In MSFF,not only the overall action recognition of the palm but also the subtle movements of the fingers are taken into account.Specifically,we adopt hand gesture multiangle Doppler-time and gesture trajectory range-angle map multi-feature fusion to comprehensively extract hand gesture features and fuse high-level deep neural networks to make it pay more attention to subtle finger movements.We evaluate the proposed method using data collected from 10 users and our proposed solution achieves an average recognition accuracy of 99.7%.Extensive experiments on a public mmWave gesture dataset demonstrate the superior effectiveness of the proposed system.展开更多
The lost information caused by feature interaction is restored by using auxiliary faces (AF) and virtual links (VL). The delta volume of the interacted features represented by concave attachable connected graph (CACG)...The lost information caused by feature interaction is restored by using auxiliary faces (AF) and virtual links (VL). The delta volume of the interacted features represented by concave attachable connected graph (CACG) can be decomposed into several isolated features represented by complete concave adjacency graph (CCAG). We can recognize the feature’s sketchy type by using CCAG as a hint; the exact type of the feature can be attained by deleting the auxiliary faces from the isolated feature. United machining feature (UMF) is used to represent the features that can be machined in the same machining process. It is important to the rationalizing of the process plans and reduce the time costing in machining. An example is given to demonstrate the effectiveness of this method.展开更多
In this article,we consider the(3+1)-dimensional generalized Kadomtsev–Petviashvili(GKP)equation in fluids.We show that a variety of nonlinear localized waves can be produced by the breath wave of the GKP model,such ...In this article,we consider the(3+1)-dimensional generalized Kadomtsev–Petviashvili(GKP)equation in fluids.We show that a variety of nonlinear localized waves can be produced by the breath wave of the GKP model,such as the(oscillating-)W-and M-shaped waves,rational W-shaped waves,multi-peak solitary waves,(quasi-)Bell-shaped and W-shaped waves and(quasi-)periodic waves.Based on the characteristic line analysis and nonlinear superposition principle,we give the transition conditions analytically.We find the interesting dynamic behavior of the converted nonlinear waves,which is known as the time-varying feature.We further offer explanations for such phenomenon.We then discuss the classification of the converted solutions.We finally investigate the interactions of the converted waves including the semi-elastic collision,perfectly elastic collision,inelastic collision and one-off collision.And the mechanisms of the collisions are analyzed in detail.The results could enrich the dynamic features of the high-dimensional nonlinear waves in fluids.展开更多
Nowadays,smart healthcare and biomedical research have marked a substantial growth rate in terms of their presence in the literature,computational approaches,and discoveries,owing to which a massive quantity of experi...Nowadays,smart healthcare and biomedical research have marked a substantial growth rate in terms of their presence in the literature,computational approaches,and discoveries,owing to which a massive quantity of experimental datasets was published and generated(Big Data)for describing and validating such novelties.Drug-drug interaction(DDI)significantly contributed to drug administration and development.It continues as the main obstacle in offering inexpensive and safe healthcare.It normally happens for patients with extensive medication,leading them to take many drugs simultaneously.DDI may cause side effects,either mild or severe health problems.This reduced victims’quality of life and increased hospital healthcare expenses by increasing their recovery time.Several efforts were made to formulate new methods for DDI prediction to overcome this issue.In this aspect,this study designs a new Spotted Hyena Optimizer Driven Deep Learning based Drug-Drug Interaction Prediction(SHODL-DDIP)model in a big data environment.In the presented SHODL-DDIP technique,the relativity and characteristics of the drugs can be identified from different sources for prediction.The input data is preprocessed at the primary level to improve its quality.Next,the salp swarm optimization algorithm(SSO)is used to select features.In this study,the deep belief network(DBN)model is exploited to predict the DDI accurately.The SHO algorithm is involved in improvising the DBN model’s predictive outcomes,showing the novelty of the work.The experimental result analysis of the SHODL-DDIP technique is tested using drug databases,and the results signified the improvements of the SHODLDDIP technique over other recent models in terms of different performance measures.展开更多
Identifying human actions and interactions finds its use in manyareas, such as security, surveillance, assisted living, patient monitoring, rehabilitation,sports, and e-learning. This wide range of applications has at...Identifying human actions and interactions finds its use in manyareas, such as security, surveillance, assisted living, patient monitoring, rehabilitation,sports, and e-learning. This wide range of applications has attractedmany researchers to this field. Inspired by the existing recognition systems,this paper proposes a new and efficient human-object interaction recognition(HOIR) model which is based on modeling human pose and scene featureinformation. There are different aspects involved in an interaction, includingthe humans, the objects, the various body parts of the human, and the backgroundscene. Themain objectives of this research include critically examiningthe importance of all these elements in determining the interaction, estimatinghuman pose through image foresting transform (IFT), and detecting the performedinteractions based on an optimizedmulti-feature vector. The proposedmethodology has six main phases. The first phase involves preprocessing theimages. During preprocessing stages, the videos are converted into imageframes. Then their contrast is adjusted, and noise is removed. In the secondphase, the human-object pair is detected and extracted from each image frame.The third phase involves the identification of key body parts of the detectedhumans using IFT. The fourth phase relates to three different kinds of featureextraction techniques. Then these features are combined and optimized duringthe fifth phase. The optimized vector is used to classify the interactions in thelast phase. TheMSRDaily Activity 3D dataset has been used to test this modeland to prove its efficiency. The proposed system obtains an average accuracyof 91.7% on this dataset.展开更多
基金National Natural Science Foundations of China(No.50803010,No.60904056)
文摘This paper is devoted to the two-dimensional nonlinear modeling of the fluid-solid interaction (FSI) between fabric and air flow, which is based on the Automatic Incremental Dynamic Nonlinear Analysis (AIDNA)-FSI program in order to study the dynamic bending features of fabrics in a specific air flow filed. The computational fluid dynamics (CFD) model for flow and the finite element model (FEM) for fabric was set up to constitute an FSI model in which the geometric nonlinear behavior and the dynamic stress-strain variation of the relatively soft fabric material were taken into account. Several FSI cases with different time-dependent wind load and the model frequency analysis for fabric were carried out. The dynamic response of fabric and the distribution of fluid variables were investigated. The results of numerical simulation and experiments fit quite well. Hence, this work contributes to the research of modeling the dynamic bending behavior of fabrics in air field.
文摘In recent years,deep learning has been widely applied in the fields of recommendation systems and click-through rate(CTR)prediction,and thus recommendation models incorporating deep learning have emerged.In addition,the design and implementation of recommendation models using information related to user behavior sequences is an important direction of current research in recommendation systems,and models calculate the likelihood of users clicking on target items based on their behavior sequence information.In order to explore the relationship between features,this paper improves and optimizes on the basis of deep interest network(DIN)proposed by Ali’s team.Based on the user behavioral sequences information,the attentional factorization machine(AFM)is integrated to obtain richer and more accurate behavioral sequence information.In addition,this paper designs a new way of calculating attention weights,which uses the relationship between the cosine similarity of any two vectors and the absolute value of their modal length difference to measure their relevance degree.Thus,a novel deep learning CTR prediction mode is proposed,that is,the CTR prediction network based on user behavior sequence and feature interactions deep interest and machines network(DIMN).We conduct extensive comparison experiments on three public datasets and one private music dataset,which are more recognized in the industry,and the results show that the DIMN obtains a better performance compared with the classical CTR prediction model.
文摘With the rapid expansion of social media,analyzing emotions and their causes in texts has gained significant importance.Emotion-cause pair extraction enables the identification of causal relationships between emotions and their triggers within a text,facilitating a deeper understanding of expressed sentiments and their underlying reasons.This comprehension is crucial for making informed strategic decisions in various business and societal contexts.However,recent research approaches employing multi-task learning frameworks for modeling often face challenges such as the inability to simultaneouslymodel extracted features and their interactions,or inconsistencies in label prediction between emotion-cause pair extraction and independent assistant tasks like emotion and cause extraction.To address these issues,this study proposes an emotion-cause pair extraction methodology that incorporates joint feature encoding and task alignment mechanisms.The model consists of two primary components:First,joint feature encoding simultaneously generates features for emotion-cause pairs and clauses,enhancing feature interactions between emotion clauses,cause clauses,and emotion-cause pairs.Second,the task alignment technique is applied to reduce the labeling distance between emotion-cause pair extraction and the two assistant tasks,capturing deep semantic information interactions among tasks.The proposed method is evaluated on a Chinese benchmark corpus using 10-fold cross-validation,assessing key performance metrics such as precision,recall,and F1 score.Experimental results demonstrate that the model achieves an F1 score of 76.05%,surpassing the state-of-the-art by 1.03%.The proposed model exhibits significant improvements in emotion-cause pair extraction(ECPE)and cause extraction(CE)compared to existing methods,validating its effectiveness.This research introduces a novel approach based on joint feature encoding and task alignment mechanisms,contributing to advancements in emotion-cause pair extraction.However,the study’s limitation lies in the data sources,potentially restricting the generalizability of the findings.
基金funded by National Natural Science Foundation of China(61603245).
文摘Semantic segmentation of remote sensing images is a critical research area in the field of remote sensing.Despite the success of Convolutional Neural Networks(CNNs),they often fail to capture inter-layer feature relationships and fully leverage contextual information,leading to the loss of important details.Additionally,due to significant intraclass variation and small inter-class differences in remote sensing images,CNNs may experience class confusion.To address these issues,we propose a novel Category-Guided Feature Collaborative Learning Network(CG-FCLNet),which enables fine-grained feature extraction and adaptive fusion.Specifically,we design a Feature Collaborative Learning Module(FCLM)to facilitate the tight interaction of multi-scale features.We also introduce a Scale-Aware Fusion Module(SAFM),which iteratively fuses features from different layers using a spatial attention mechanism,enabling deeper feature fusion.Furthermore,we design a Category-Guided Module(CGM)to extract category-aware information that guides feature fusion,ensuring that the fused featuresmore accurately reflect the semantic information of each category,thereby improving detailed segmentation.The experimental results show that CG-FCLNet achieves a Mean Intersection over Union(mIoU)of 83.46%,an mF1 of 90.87%,and an Overall Accuracy(OA)of 91.34% on the Vaihingen dataset.On the Potsdam dataset,it achieves a mIoU of 86.54%,an mF1 of 92.65%,and an OA of 91.29%.These results highlight the superior performance of CG-FCLNet compared to existing state-of-the-art methods.
基金supported by the Competitive Research Fund of the University of Aizu,Japan(Grant No.P-13).
文摘Heart disease includes a multiplicity of medical conditions that affect the structure,blood vessels,and general operation of the heart.Numerous researchers have made progress in correcting and predicting early heart disease,but more remains to be accomplished.The diagnostic accuracy of many current studies is inadequate due to the attempt to predict patients with heart disease using traditional approaches.By using data fusion from several regions of the country,we intend to increase the accuracy of heart disease prediction.A statistical approach that promotes insights triggered by feature interactions to reveal the intricate pattern in the data,which cannot be adequately captured by a single feature.We processed the data using techniques including feature scaling,outlier detection and replacement,null and missing value imputation,and more to improve the data quality.Furthermore,the proposed feature engineering method uses the correlation test for numerical features and the chi-square test for categorical features to interact with the feature.To reduce the dimensionality,we subsequently used PCA with 95%variation.To identify patients with heart disease,hyperparameter-based machine learning algorithms like RF,XGBoost,Gradient Boosting,LightGBM,CatBoost,SVM,and MLP are utilized,along with ensemble models.The model’s overall prediction performance ranges from 88%to 92%.In order to attain cutting-edge results,we then used a 1D CNN model,which significantly enhanced the prediction with an accuracy score of 96.36%,precision of 96.45%,recall of 96.36%,specificity score of 99.51%and F1 score of 96.34%.The RF model produces the best results among all the classifiers in the evaluation matrix without feature interaction,with accuracy of 90.21%,precision of 90.40%,recall of 90.86%,specificity of 90.91%,and F1 score of 90.63%.Our proposed 1D CNN model is 7%superior to the one without feature engineering when compared to the suggested approach.This illustrates how interaction-focused feature analysis can produce precise and useful insights for heart disease diagnosis.
基金supported by the National Key R&D Program of China(Grant No.:2023YFC2604400)the National Natural Science Foundation of China(Grant No.:62103436).
文摘Identifying drug-drug interactions(DDIs)is essential to prevent adverse effects from polypharmacy.Although deep learning has advanced DDI identification,the gap between powerful models and their lack of clinical application and evaluation has hindered clinical benefits.Here,we developed a Multi-Dimensional Feature Fusion model named MDFF,which integrates one-dimensional simplified molec-ular input line entry system sequence features,two-dimensional molecular graph features,and three-dimensional geometric features to enhance drug representations for predicting DDIs.MDFF was trained and validated on two DDI datasets,evaluated across three distinct scenarios,and compared with advanced DDI prediction models using accuracy,precision,recall,area under the curve,and F1 score metrics.MDFF achieved state-of-the-art performance across all metrics.Ablation experiments showed that integrating multi-dimensional drug features yielded the best results.More importantly,we obtained adverse drug reaction reports uploaded by Xiangya Hospital of Central South University from 2021 to 2023 and used MDFF to identify potential adverse DDIs.Among 12 real-world adverse drug reaction reports,the predictions of 9 reports were supported by relevant evidence.Additionally,MDFF demon-strated the ability to explain adverse DDI mechanisms,providing insights into the mechanisms behind one specific report and highlighting its potential to assist practitioners in improving medical practice.
基金supported by the projects:Guangxi Philosophy and Social Sciences Research Projects:“A Study on the Imagery System of Yuexi Poetry Collection and the Mechanism of Generating Ecological Beauty Signs of Charming Scenery in Guangxi”,and Wuzhou University Education and Teaching Reform Projects:“Research on Innovative Teaching Mode and Evaluation of‘Poetry and Ritual Interaction’Under the Background of Skill and Emotional Deficiency(Wyjg2022A033)”“Research on Improving the Quality of Ancient Literature Curriculum Centered on Student Cognitive Ladder(Wyjg2023B016)”“Research on Innovative Integration of Information Technology and Ancient Literature Curriculum Under the Goal of New Literature Construction(Wyjg2024A018)”.
文摘This paper focuses on the connection between the Flourishing Tang Features and Li Bai’s landscape poems,exploring their interactive relationship from three main dimensions.Firstly,the Flourishing Tang Dynasty,characterized by political stability,economic prosperity,and cultural openness,nourished Li Bai’s landscape poems.Geographically,the expanded territory and smooth transportation broadened his creative vision,enabling his works to break away from the narrow local landscape and present a cosmic perspective covering landscapes like the Yellow River,Yangtze River,and Tianshan Mountains;spiritually,the era’s emphasis on active engagement in society shaped the core of his poems,transforming landscape writing from a tool for seclusion to a medium for expressing lofty aspirations.Secondly,Li Bai’s landscape poems projected the Flourishing Tang Features:Grand landscape images echoed the dynasty’s vast territory and national confidence;free artistic conceptions reflected the dynasty’s cultural inclusiveness and ideological emancipation;the integration of landscapes with ideals manifested the scholars’commitment to serving the country.Finally,the two achieved spiritual interaction:In spatial terms,the dynasty’s vast territory aligned with Li Bai’s broad spatial vision;in values,the era’s balance between engagement and freedom matched his combination of wandering and ambition;in spirit,the dynasty’s confidence resonated with his heroic and free emotions.In summary,the Flourishing Tang Features provided a creative foundation for Li Bai,while his landscape poems materialized and spread the Tang spirit,jointly forming a unique cultural legacy of the Tang Dynasty.
文摘With the growing application of intelligent robots in service,manufacturing,and medical fields,efficient and natural interaction between humans and robots has become key to improving collaboration efficiency and user experience.Gesture recognition,as an intuitive and contactless interaction method,can overcome the limitations of traditional interfaces and enable real-time control and feedback of robot movements and behaviors.This study first reviews mainstream gesture recognition algorithms and their application on different sensing platforms(RGB cameras,depth cameras,and inertial measurement units).It then proposes a gesture recognition method based on multimodal feature fusion and a lightweight deep neural network that balances recognition accuracy with computational efficiency.At system level,a modular human-robot interaction architecture is constructed,comprising perception,decision,and execution layers,and gesture commands are transmitted and mapped to robot actions in real time via the ROS communication protocol.Through multiple comparative experiments on public gesture datasets and a self-collected dataset,the proposed method’s superiority is validated in terms of accuracy,response latency,and system robustness,while user-experience tests assess the interface’s usability.The results provide a reliable technical foundation for robot collaboration and service in complex scenarios,offering broad prospects for practical application and deployment.
文摘Interactivity in online newspapers is the focus of this chapter in eliciting readers’evaluation of Zambian online newspapers.This aspect of the study investigates and characterises the motivations(gratification sought)for use of interactivity features(“process motivation”)and how widely they are used.It also attempts to ascertain the gratification obtained from their use among readers.The probable relationships between use of the interactivity features(“audience interactivity”)and gratification obtained from them(“process gratification”)and the impact of the perceived credibility of the online newspapers on gratification are also examined.Past studies present mixed results on use of interactivity and gratification obtained from it.This study finds that use of interactivity in Zambian online newspapers is at a low level,although among the three broad categorisations of features of online newspapers,interactivity attracts greater use than hyper-textuality and multi-mediality.Human interactivity features-“knowing what others think about an issue”,“chat on the Facebook page of the newspaper”,“ability to navigate on the Facebook page of the newspaper”,and“posting own comments on stories”-are the main motivations for use of online newspapers,the most frequently used,and the most gratifying to the readers.While readers express an interest in interacting with other readers via online newspapers,they seem less interested in posting their own stories as“citizen journalists”and linking up with the publishers and editors.This finding challenges the notion that all new media are catalysts of participatory and cyclic communication.
文摘The dynamical features of air-sea coupling waves and their stabilities in a simple coupled air-sea model in the tropics have been studied with respect to interaction occurring among different types of the free waves in the o-cean and in the atmosphere. It is pointed out that there exist a stable and an unstable air-sea interaction modes in the tropical coupled system , respectively. The propagation of the unstable mode relies greatly on the zonal space scale, i. e. only for wave length ranging from 5 000 km to 10 000 km can the disturbance unstably move slowly eastward. The waves that slowly propagate unstably eastward agree well with the observational facts. Finally,it is also proposed that the interaction between Kelvin wave in one medium and Rossby wave in another medium is a necessary condition for the occurrence of destabilization of the coupled air-sea system in the tropics.
基金Basic and Advanced Research Projects of CSTC,Grant/Award Number:cstc2019jcyj-zdxmX0008Science and Technology Research Program of Chongqing Municipal Education Commission,Grant/Award Numbers:KJQN202100634,KJZDK201900605National Natural Science Foundation of China,Grant/Award Number:62006065。
文摘Scene perception and trajectory forecasting are two fundamental challenges that are crucial to a safe and reliable autonomous driving(AD)system.However,most proposed methods aim at addressing one of the two challenges mentioned above with a single model.To tackle this dilemma,this paper proposes spatio-temporal semantics and interaction graph aggregation for multi-agent perception and trajectory forecasting(STSIGMA),an efficient end-to-end method to jointly and accurately perceive the AD environment and forecast the trajectories of the surrounding traffic agents within a unified framework.ST-SIGMA adopts a trident encoder-decoder architecture to learn scene semantics and agent interaction information on bird’s-eye view(BEV)maps simultaneously.Specifically,an iterative aggregation network is first employed as the scene semantic encoder(SSE)to learn diverse scene information.To preserve dynamic interactions of traffic agents,ST-SIGMA further exploits a spatio-temporal graph network as the graph interaction encoder.Meanwhile,a simple yet efficient feature fusion method to fuse semantic and interaction features into a unified feature space as the input to a novel hierarchical aggregation decoder for downstream prediction tasks is designed.Extensive experiments on the nuScenes data set have demonstrated that the proposed ST-SIGMA achieves significant improvements compared to the state-of-theart(SOTA)methods in terms of scene perception and trajectory forecasting,respectively.Therefore,the proposed approach outperforms SOTA in terms of model generalisation and robustness and is therefore more feasible for deployment in realworld AD scenarios.
基金the National Natural Science Foundation of China(32172240)BL19U2 beamline of National Facility for Protein Science in Shanghai(NFPS)at Shanghai Synchrotron Radiation Facility,for their assistance during data collection。
文摘Three materials(agar,konjac glucomannan(KGM)andκ-carrageenan)were used to prepare ternary systems,i.e.,sol-gels and their dried composites conditioned at varied relative humidity(RH)(33%,54%and 75%).Combined methods,e.g.,scanning electron microscopy,small-angle X-ray scattering,infrared spectroscopy(IR)and X-ray diffraction(XRD),were used to disclose howκ-carrageenan addition tailors the features of agar/KGM/κ-carrageenan ternary system.As affirmed by IR and XRD,the ternary systems withκ-carrageenan below 25%(agar/KGM/carrageenan,50:25:25,m/m)displayed proper component interactions,which increased the sol-gel transition temperature and the hardness of obtained gels.For instance,the ternary composites could show hardness about 3 to 4 times higher than that for binary counterpart.These gels were dehydrated to acquire ternary composites.Compared to agar/KGM composite,the ternary composites showed fewer crystallites and nanoscale orders,and newly-formed nanoscale structures from chain assembly.Such multi-scale structures,for composites withκ-carrageenan below 25%,showed weaker changes with RH,as revealed by especially morphologic and crystalline features.Consequently,the ternary composites with lessκ-carrageenan(below 25%)exhibited stabilized elongation at break and hydrophilicity at different RHs.This hints to us that agar/KGM/κ-carrageenan composite systems can display series applications with improved features,e.g.,increased sol-gel transition point.
基金Supported by the National Natural Science Foundation of China(61773205,61773219)the Fundamental Research Funds for the Central Universities(NS2016032,NS2019018,Nanjing University of Aeronautics and Astronautics)+1 种基金the Scholarship from China Scholarship Council(201906835020)the Fundamental Research Funds for the Central Universities(the Graduate Student Innovation Base Open Fund Project of NUAA,kfjj20190307)。
文摘Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.
基金Project(51678075)supported by the National Natural Science Foundation of ChinaProject(2017GK2271)supported by Hunan Provincial Science and Technology Department,China
文摘This paper proposed a novel multi-view interactive behavior recognition method based on local self-similarity descriptors and graph shared multi-task learning. First, we proposed the composite interactive feature representation which encodes both the spatial distribution of local motion of interest points and their contexts. Furthermore, local self-similarity descriptor represented by temporal-pyramid bag of words(BOW) was applied to decreasing the influence of observation angle change on recognition and retaining the temporal information. For the purpose of exploring latent correlation between different interactive behaviors from different views and retaining specific information of each behaviors, graph shared multi-task learning was used to learn the corresponding interactive behavior recognition model. Experiment results showed the effectiveness of the proposed method in comparison with other state-of-the-art methods on the public databases CASIA, i3Dpose dataset and self-built database for interactive behavior recognition.
文摘Offshore carbon dioxide(CO_(2)) geological storage(OCGS) represents a significant strategy for addressing climate change by curtailing greenhouse gas emissions. Nonetheless, the risk of CO_(2) leakage poses a substantial concern associated with this technology. This study introduces an innovative approach for establishing OCGS leakage scenarios, involving four pivotal stages, namely, interactive matrix establishment, risk matrix evaluation, cause–effect analysis, and scenario development, which has been implemented in the Pearl River Estuary Basin in China. The initial phase encompassed the establishment of an interaction matrix for OCGS systems based on features, events, and processes. Subsequent risk matrix evaluation and cause–effect analysis identified key system components, specifically CO_(2) injection and faults/features. Building upon this analysis, two leakage risk scenarios were successfully developed, accompanied by the corresponding mitigation measures. In addition, this study introduces the application of scenario development to risk assessment, including scenario numerical simulation and quantitative assessment. Overall, this research positively contributes to the sustainable development and safe operation of OCGS projects and holds potential for further refinement and broader application to diverse geographical environments and project requirements. This comprehensive study provides valuable insights into the establishment of OCGS leakage scenarios and demonstrates their practical application to risk assessment, laying the foundation for promoting the sustainable development and safe operation of ocean CO_(2) geological storage projects while proposing possibilities for future improvements and broader applications to different contexts.
基金supported by the National Natural Science Foundation of China under grant no.62272242.
文摘Gestures are one of the most natural and intuitive approach for human-computer interaction.Compared with traditional camera-based or wearable sensors-based solutions,gesture recognition using the millimeter wave radar has attracted growing attention for its characteristics of contact-free,privacy-preserving and less environmentdependence.Although there have been many recent studies on hand gesture recognition,the existing hand gesture recognition methods still have recognition accuracy and generalization ability shortcomings in shortrange applications.In this paper,we present a hand gesture recognition method named multiscale feature fusion(MSFF)to accurately identify micro hand gestures.In MSFF,not only the overall action recognition of the palm but also the subtle movements of the fingers are taken into account.Specifically,we adopt hand gesture multiangle Doppler-time and gesture trajectory range-angle map multi-feature fusion to comprehensively extract hand gesture features and fuse high-level deep neural networks to make it pay more attention to subtle finger movements.We evaluate the proposed method using data collected from 10 users and our proposed solution achieves an average recognition accuracy of 99.7%.Extensive experiments on a public mmWave gesture dataset demonstrate the superior effectiveness of the proposed system.
文摘The lost information caused by feature interaction is restored by using auxiliary faces (AF) and virtual links (VL). The delta volume of the interacted features represented by concave attachable connected graph (CACG) can be decomposed into several isolated features represented by complete concave adjacency graph (CCAG). We can recognize the feature’s sketchy type by using CCAG as a hint; the exact type of the feature can be attained by deleting the auxiliary faces from the isolated feature. United machining feature (UMF) is used to represent the features that can be machined in the same machining process. It is important to the rationalizing of the process plans and reduce the time costing in machining. An example is given to demonstrate the effectiveness of this method.
基金supported by the National Natural Science Foundation of China(Grant Nos.11875126,61705006,and 11947230)the China Postdoctoral Science Foundation(No.2019M660430).
文摘In this article,we consider the(3+1)-dimensional generalized Kadomtsev–Petviashvili(GKP)equation in fluids.We show that a variety of nonlinear localized waves can be produced by the breath wave of the GKP model,such as the(oscillating-)W-and M-shaped waves,rational W-shaped waves,multi-peak solitary waves,(quasi-)Bell-shaped and W-shaped waves and(quasi-)periodic waves.Based on the characteristic line analysis and nonlinear superposition principle,we give the transition conditions analytically.We find the interesting dynamic behavior of the converted nonlinear waves,which is known as the time-varying feature.We further offer explanations for such phenomenon.We then discuss the classification of the converted solutions.We finally investigate the interactions of the converted waves including the semi-elastic collision,perfectly elastic collision,inelastic collision and one-off collision.And the mechanisms of the collisions are analyzed in detail.The results could enrich the dynamic features of the high-dimensional nonlinear waves in fluids.
文摘Nowadays,smart healthcare and biomedical research have marked a substantial growth rate in terms of their presence in the literature,computational approaches,and discoveries,owing to which a massive quantity of experimental datasets was published and generated(Big Data)for describing and validating such novelties.Drug-drug interaction(DDI)significantly contributed to drug administration and development.It continues as the main obstacle in offering inexpensive and safe healthcare.It normally happens for patients with extensive medication,leading them to take many drugs simultaneously.DDI may cause side effects,either mild or severe health problems.This reduced victims’quality of life and increased hospital healthcare expenses by increasing their recovery time.Several efforts were made to formulate new methods for DDI prediction to overcome this issue.In this aspect,this study designs a new Spotted Hyena Optimizer Driven Deep Learning based Drug-Drug Interaction Prediction(SHODL-DDIP)model in a big data environment.In the presented SHODL-DDIP technique,the relativity and characteristics of the drugs can be identified from different sources for prediction.The input data is preprocessed at the primary level to improve its quality.Next,the salp swarm optimization algorithm(SSO)is used to select features.In this study,the deep belief network(DBN)model is exploited to predict the DDI accurately.The SHO algorithm is involved in improvising the DBN model’s predictive outcomes,showing the novelty of the work.The experimental result analysis of the SHODL-DDIP technique is tested using drug databases,and the results signified the improvements of the SHODLDDIP technique over other recent models in terms of different performance measures.
基金This research was supported by the MSIT(Ministry of Science and ICT),Korea,under the ITRC(Information Technology Research Center)support program(IITP-2023-2018-0-01426)supervised by the IITP(Institute for Information&Communications Technology Planning&Evaluation)This work has also been supported by PrincessNourah bint Abdulrahman UniversityResearchers Supporting Project Number(PNURSP2022R239),Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.Alsothis work was partially supported by the Taif University Researchers Supporting Project Number(TURSP-2020/115),Taif University,Taif,Saudi Arabia.
文摘Identifying human actions and interactions finds its use in manyareas, such as security, surveillance, assisted living, patient monitoring, rehabilitation,sports, and e-learning. This wide range of applications has attractedmany researchers to this field. Inspired by the existing recognition systems,this paper proposes a new and efficient human-object interaction recognition(HOIR) model which is based on modeling human pose and scene featureinformation. There are different aspects involved in an interaction, includingthe humans, the objects, the various body parts of the human, and the backgroundscene. Themain objectives of this research include critically examiningthe importance of all these elements in determining the interaction, estimatinghuman pose through image foresting transform (IFT), and detecting the performedinteractions based on an optimizedmulti-feature vector. The proposedmethodology has six main phases. The first phase involves preprocessing theimages. During preprocessing stages, the videos are converted into imageframes. Then their contrast is adjusted, and noise is removed. In the secondphase, the human-object pair is detected and extracted from each image frame.The third phase involves the identification of key body parts of the detectedhumans using IFT. The fourth phase relates to three different kinds of featureextraction techniques. Then these features are combined and optimized duringthe fifth phase. The optimized vector is used to classify the interactions in thelast phase. TheMSRDaily Activity 3D dataset has been used to test this modeland to prove its efficiency. The proposed system obtains an average accuracyof 91.7% on this dataset.
