A common but flawed design in existing CNN architectures is using strided convolutions and/or pooling layer,which will result in the loss of fine-grained feature information,especially for low-resolution images and sm...A common but flawed design in existing CNN architectures is using strided convolutions and/or pooling layer,which will result in the loss of fine-grained feature information,especially for low-resolution images and small objects.In this paper,a new CNN building block named SPD-Conv was used,which completely eliminated stride and pooling operations and replaced them with a space-to-depth convolution and a non-strided convolution.Such new design has the advantage of downsampling feature maps while retaining discriminant feature information.It also represents a general unified method,which can be easily applied to any CNN architectures,and can also be applied to strided conversion and pooling in the same way.展开更多
The aerial deployment method enables Unmanned Aerial Vehicles(UAVs)to be directly positioned at the required altitude for their mission.This method typically employs folding technology to improve loading efficiency,wi...The aerial deployment method enables Unmanned Aerial Vehicles(UAVs)to be directly positioned at the required altitude for their mission.This method typically employs folding technology to improve loading efficiency,with applications such as the gravity-only aerial deployment of high-aspect-ratio solar-powered UAVs,and aerial takeoff of fixed-wing drones in Mars research.However,the significant morphological changes during deployment are accompanied by strong nonlinear dynamic aerodynamic forces,which result in multiple degrees of freedom and an unstable character.This hinders the description and analysis of unknown dynamic behaviors,further leading to difficulties in the design of deployment strategies and flight control.To address this issue,this paper proposes an analysis method for dynamic behaviors during aerial deployment based on the Variational Autoencoder(VAE).Focusing on the gravity-only deployment problem of highaspect-ratio foldable-wing UAVs,the method encodes the multi-degree-of-freedom unstable motion signals into a low-dimensional feature space through a data-driven approach.By clustering in the feature space,this paper identifies and studies several dynamic behaviors during aerial deployment.The research presented in this paper offers a new method and perspective for feature extraction and analysis of complex and difficult-to-describe extreme flight dynamics,guiding the research on aerial deployment drones design and control strategies.展开更多
To address the issue of low recognition accuracy for eight types of behaviors including standing,walking,drinking,lying,eating,mounting,fighting and limping in complex multi-cow farm environments,a multi-target cow be...To address the issue of low recognition accuracy for eight types of behaviors including standing,walking,drinking,lying,eating,mounting,fighting and limping in complex multi-cow farm environments,a multi-target cow behavior recognition method based on an improved YOLOv11n algorithm was proposed.The detection capability for small targets in images was enhanced by incorporating a DASI module into the backbone network and a MDCR module into the neck network,based on YOLOv11.The improved YOLOv11 algorithm increased the mean average precision from the original 89.5%to 93%,with particularly notable improvements of 8.7%and 6.3%in the average precision for recognizing drinking and walking behaviors,respectively.These results fully demonstrate that the proposed method enhances the model s ability to recognize cow behaviors.展开更多
Frequency-modulated continuous-wave radar enables the non-contact and privacy-preserving recognition of human behavior.However,the accuracy of behavior recognition is directly influenced by the spatial relationship be...Frequency-modulated continuous-wave radar enables the non-contact and privacy-preserving recognition of human behavior.However,the accuracy of behavior recognition is directly influenced by the spatial relationship between human posture and the radar.To address the issue of low accuracy in behavior recognition when the human body is not directly facing the radar,a method combining local outlier factor with Doppler information is proposed for the correction of multi-classifier recognition results.Initially,the information such as distance,velocity,and micro-Doppler spectrogram of the target is obtained using the fast Fourier transform and histogram of oriented gradients-support vector machine methods,followed by preliminary recognition.Subsequently,Platt scaling is employed to transform recognition results into confidence scores,and finally,the Doppler-local outlier factor method is utilized to calibrate the confidence scores,with the highest confidence classifier result considered as the recognition outcome.Experimental results demonstrate that this approach achieves an average recognition accuracy of 96.23%for comprehensive human behavior recognition in various orientations.展开更多
Communication behavior recognition is an issue with increasingly importance in the antiterrorism and national defense area.However,the sensing data obtained in actual environment is often not sufficient to accurately ...Communication behavior recognition is an issue with increasingly importance in the antiterrorism and national defense area.However,the sensing data obtained in actual environment is often not sufficient to accurately analyze the communication behavior.Traditional means can hardly utilize the scarce and crude spectrum sensing data captured in a real scene.Thus,communication behavior recognition using raw sensing data under smallsample condition has become a new challenge.In this paper,a data enhanced communication behavior recognition(DECBR)scheme is proposed to meet this challenge.Firstly,a preprocessing method is designed to make the raw spectrum data suitable for the proposed scheme.Then,an adaptive convolutional neural network structure is exploited to carry out communication behavior recognition.Moreover,DCGAN is applied to support data enhancement,which realize communication behavior recognition under small-sample condition.Finally,the scheme is verified by experiments under different data size.The results show that the DECBR scheme can greatly improve the accuracy and efficiency of behavior recognition under smallsample condition.展开更多
In recent years,skeleton-based action recognition has made great achievements in Computer Vision.A graph convolutional network(GCN)is effective for action recognition,modelling the human skeleton as a spatio-temporal ...In recent years,skeleton-based action recognition has made great achievements in Computer Vision.A graph convolutional network(GCN)is effective for action recognition,modelling the human skeleton as a spatio-temporal graph.Most GCNs define the graph topology by physical relations of the human joints.However,this predefined graph ignores the spatial relationship between non-adjacent joint pairs in special actions and the behavior dependence between joint pairs,resulting in a low recognition rate for specific actions with implicit correlation between joint pairs.In addition,existing methods ignore the trend correlation between adjacent frames within an action and context clues,leading to erroneous action recognition with similar poses.Therefore,this study proposes a learnable GCN based on behavior dependence,which considers implicit joint correlation by constructing a dynamic learnable graph with extraction of specific behavior dependence of joint pairs.By using the weight relationship between the joint pairs,an adaptive model is constructed.It also designs a self-attention module to obtain their inter-frame topological relationship for exploring the context of actions.Combining the shared topology and the multi-head self-attention map,the module obtains the context-based clue topology to update the dynamic graph convolution,achieving accurate recognition of different actions with similar poses.Detailed experiments on public datasets demonstrate that the proposed method achieves better results and realizes higher quality representation of actions under various evaluation protocols compared to state-of-the-art methods.展开更多
The core technology in an intelligent video surveillance system is that detecting and recognizing abnormal behaviors timely and accurately.The key breakthrough point in recognizing abnormal behaviors is how to obtain ...The core technology in an intelligent video surveillance system is that detecting and recognizing abnormal behaviors timely and accurately.The key breakthrough point in recognizing abnormal behaviors is how to obtain the effective features of the picture,so as to solve the problem of recognizing them.In response to this difficulty,this paper introduces an adjustable jump link coefficients model based on the residual network.The effective coefficients for each layer of the network can be set after using this model to further improving the recognition accuracy of abnormal behavior.A convolution kernel of 1×1 size is added to reduce the number of parameters for the purpose of improving the speed of the model in this paper.In order to reduce the noise of the data edge,and at the same time,improve the accuracy of the data and speed up the training,a BN(Batch Normalization)layer is added before the activation function in this network.This paper trains this network model on the public ImageNet dataset,and then uses the transfer learning method to recognize these abnormal behaviors of human in the UTI behavior dataset processed by the YOLO_v3 target detection network.Under the same experimental conditions,compared with the original ResNet-50 model,the improved model in this paper has a 2.8%higher accuracy in recognition of abnormal behaviors on the public UTI dataset.展开更多
In the process of human behavior recognition, the traditional dense optical flow method has too many pixels and too much overhead, which limits the running speed. This paper proposed a method combing YOLOv3 (You Only ...In the process of human behavior recognition, the traditional dense optical flow method has too many pixels and too much overhead, which limits the running speed. This paper proposed a method combing YOLOv3 (You Only Look Once v3) and local optical flow method. Based on the dense optical flow method, the optical flow modulus of the area where the human target is detected is calculated to reduce the amount of computation and save the cost in terms of time. And then, a threshold value is set to complete the human behavior identification. Through design algorithm, experimental verification and other steps, the walking, running and falling state of human body in real life indoor sports video was identified. Experimental results show that this algorithm is more advantageous for jogging behavior recognition.展开更多
In order to effectively solve the problems of low accuracy and large amount of calculation of current human behavior recognition,a behavior recognition algorithm based on squeeze-and-excitation network(SENet) combined...In order to effectively solve the problems of low accuracy and large amount of calculation of current human behavior recognition,a behavior recognition algorithm based on squeeze-and-excitation network(SENet) combined with 3 D Inception network(I3 D) and gated recurrent unit(GRU) network is proposed.The algorithm first expands the Inception module to three-dimensional,and builds a network based on the three-dimensional module,and expands SENet to three-dimensional,making it an attention mechanism that can pay attention to the three-dimensional channel.Then SENet is introduced into the 13 D network,named SE-I3 D,and SENet is introduced into the CRU network,named SE-GRU.And,SE-13 D and SE-GRU are merged,named SE-13 D-GRU.Finally,the network uses Softmax to classify the results in the UCF-101 dataset.The experimental results show that the SE-I3 D-GRU network achieves a recognition rate of 93.2% on the UCF-101 dataset.展开更多
With the intensifying aging of the population,the phenomenon of the elderly living alone is also increasing.Therefore,using modern internet of things technology to monitor the daily behavior of the elderly in indoors ...With the intensifying aging of the population,the phenomenon of the elderly living alone is also increasing.Therefore,using modern internet of things technology to monitor the daily behavior of the elderly in indoors is a meaningful study.Video-based action recognition tasks are easily affected by object occlusion and weak ambient light,resulting in poor recognition performance.Therefore,this paper proposes an indoor human behavior recognition method based on wireless fidelity(Wi-Fi)perception and video feature fusion by utilizing the ability of Wi-Fi signals to carry environmental information during the propagation process.This paper uses the public WiFi-based activity recognition dataset(WIAR)containing Wi-Fi channel state information and essential action videos,and then extracts video feature vectors and Wi-Fi signal feature vectors in the datasets through the two-stream convolutional neural network and standard statistical algorithms,respectively.Then the two sets of feature vectors are fused,and finally,the action classification and recognition are performed by the support vector machine(SVM).The experiments in this paper contrast experiments between the two-stream network model and the methods in this paper under three different environments.And the accuracy of action recognition after adding Wi-Fi signal feature fusion is improved by 10%on average.展开更多
In order to effectively solve the problems of low accuracy,large amount of computation and complex logic of deep learning algorithms in behavior recognition,a kind of behavior recognition based on the fusion of 3 dime...In order to effectively solve the problems of low accuracy,large amount of computation and complex logic of deep learning algorithms in behavior recognition,a kind of behavior recognition based on the fusion of 3 dimensional batch normalization visual geometry group(3D-BN-VGG)and long short-term memory(LSTM)network is designed.In this network,3D convolutional layer is used to extract the spatial domain features and time domain features of video sequence at the same time,multiple small convolution kernels are stacked to replace large convolution kernels,thus the depth of neural network is deepened and the number of network parameters is reduced.In addition,the latest batch normalization algorithm is added to the 3-dimensional convolutional network to improve the training speed.Then the output of the full connection layer is sent to LSTM network as the feature vectors to extract the sequence information.This method,which directly uses the output of the whole base level without passing through the full connection layer,reduces the parameters of the whole fusion network to 15324485,nearly twice as much as those of 3D-BN-VGG.Finally,it reveals that the proposed network achieves 96.5%and 74.9%accuracy in the UCF-101 and HMDB-51 respectively,and the algorithm has a calculation speed of 1066 fps and an acceleration ratio of 1,which has a significant predominance in velocity.展开更多
Compared with RGB videos and images,human bone data is less vulnerable to external factors and has stronger robustness.Therefore,behavior recognition methods based on skeletons are widely studied.Because graph convolu...Compared with RGB videos and images,human bone data is less vulnerable to external factors and has stronger robustness.Therefore,behavior recognition methods based on skeletons are widely studied.Because graph convolution network(GCN)can deal with the irregular topology data of hu-man skeletons very well,more and more researchers apply GCN to human behavior recognition.Tra-ditional graph convolution methods only consider the joints with physical connectivity or the same type when building the behavior recognition model based on human skeletons structure,which cannot capture higher-order information better.To solve this problem,Motif-GCN is used in this paper to ex-tract spatial features.The relationship between the joints with natural connection in the human body is encoded by the first Motif-GCN,and the possible relationship between the unconnected joints in the human skeleton is encoded by the second Motif-GCN.In this way,the relationship between non-physical joints can be strengthened.Then a two stream framework combining joint and bone informa-tion is used to capture more action information.Finally,experiments are conducted on two subdata-sets X-Sub and X-View of NTU-RGB+D,and the accuracy shown in Top-1 classification results is 89.5%and 95.4%respectively.The experimental results are 1.0%and 0.3%higher than those of the 2S-AGCN model respectively.The superiority of this method is also proved by the experimental results.展开更多
Building indoor dangerous behavior recognition is a specific application in the field of abnormal human recognition.A human dangerous behavior recognition method based on LSTM-GCN with attention mechanism(GLA)model wa...Building indoor dangerous behavior recognition is a specific application in the field of abnormal human recognition.A human dangerous behavior recognition method based on LSTM-GCN with attention mechanism(GLA)model was proposed aiming at the problem that the existing human skeleton-based action recognition methods cannot fully extract the temporal and spatial features.The network connects GCN and LSTMnetwork in series,and inputs the skeleton sequence extracted by GCN that contains spatial information into the LSTM layer for time sequence feature extraction,which fully excavates the temporal and spatial features of the skeleton sequence.Finally,an attention layer is designed to enhance the features of key bone points,and Softmax is used to classify and identify dangerous behaviors.The dangerous behavior datasets are derived from NTU-RGB+D and Kinetics data sets.Experimental results show that the proposed method can effectively identify some dangerous behaviors in the building,and its accuracy is higher than those of other similar methods.展开更多
Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the...Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the residual module is extended to three dimensions,which can extract features in the time and space domain at the same time.Second,by changing the size of the pooling layer window the integrity of the time domain features is preserved,at the same time,in order to overcome the difficulty of network training and over-fitting problems,the batch normalization(BN)layer and the dropout layer are added.After that,because the global average pooling layer(GAP)is affected by the size of the feature map,the network cannot be further deepened,so the convolution layer and maxpool layer are added to the R3D network.Finally,because LSTM has the ability to memorize information and can extract more abstract timing features,the LSTM network is introduced into the R3D network.Experimental results show that the R3D+LSTM network achieves 91%recognition rate on the UCF-101 dataset.展开更多
Video action recognition(VAR)aims to analyze dynamic behaviors in videos and achieve semantic understanding.VAR faces challenges such as temporal dynamics,action-scene coupling,and the complexity of human interactions...Video action recognition(VAR)aims to analyze dynamic behaviors in videos and achieve semantic understanding.VAR faces challenges such as temporal dynamics,action-scene coupling,and the complexity of human interactions.Existing methods can be categorized into motion-level,event-level,and story-level ones based on spatiotemporal granularity.However,single-modal approaches struggle to capture complex behavioral semantics and human factors.Therefore,in recent years,vision-language models(VLMs)have been introduced into this field,providing new research perspectives for VAR.In this paper,we systematically review spatiotemporal hierarchical methods in VAR and explore how the introduction of large models has advanced the field.Additionally,we propose the concept of“Factor”to identify and integrate key information from both visual and textual modalities,enhancing multimodal alignment.We also summarize various multimodal alignment methods and provide in-depth analysis and insights into future research directions.展开更多
Rank recognition allows social animals to adapt to complex and changeable environments and to cope with hierarchical relationships within their societies(Crone 2017).Rank recognition can improve the distribution of ad...Rank recognition allows social animals to adapt to complex and changeable environments and to cope with hierarchical relationships within their societies(Crone 2017).Rank recognition can improve the distribution of advantageous resources,individual adaptation,and social cohesion among group-living animals(Marmolejo-Ramos and Angiulli 2014).Empirical evidence suggests that rank recognition is a basic behavioral manifestation of social cognition adopted by a wide range of insects,birds,and mammals,including nonhuman primates(Schmitt and Fischer 2011;Smith et al.2017).Unlike most other vertebrates,primates have unusually large brains and form complex social groups.展开更多
User behavior prediction has become a core element to Internet of Things(IoT)and received promising attention in the related fields.Many existing IoT systems(e.g.smart home systems)have been deployed various sensors a...User behavior prediction has become a core element to Internet of Things(IoT)and received promising attention in the related fields.Many existing IoT systems(e.g.smart home systems)have been deployed various sensors and the user’s behavior can be predicted through the sensor data.However,most of the existing sensor-based systems use the annotated behavior data which requires human intervention to achieve the behavior prediction.Therefore,it is a challenge to provide an automatic behavior prediction model based on the original sensor data.To solve the problem,this paper proposed a novel automatic annotated user behavior prediction(AAUBP)model.The proposed AAUBP model combined the Discontinuous Solving Order Sequence Mining(DVSM)behavior recognition model and behavior prediction model based on the Long Short Term Memory(LSTM)network.To evaluate the model,we performed several experiments on a real-world dataset tuning the parameters.The results showed that the AAUBP model can effectively recognize behaviors and had a good performance for behavior prediction.展开更多
Nurse managers play a critical role in improving the work environment. Important leadership characteristics for nurse managers include visibility, accessibility, communication, recognition, and support. The nurse mana...Nurse managers play a critical role in improving the work environment. Important leadership characteristics for nurse managers include visibility, accessibility, communication, recognition, and support. The nurse manager’s recognition behaviors strongly influence the job satisfaction of staff nurses. In our previous study, we investigated how staff nurses perceived the nurse manager’s recognition behaviors and revealed that there was a divergence in practical approaches to these behaviors between the nurse manager and the staff. We assume that one factor causing this divergence could be perception gaps between the nurse manager and the staff. The aim of this study, therefore, was to uncover what types of perception gaps exist between the nurse manager and staff nurses and whether the background of staff nurses, such as years of experience or academic background, could affect the staff nurses’ perceptions. This quantitative, cross-sectional study involved 10 hospitals in Japan. A total of 1425 nurses completed the questionnaire. The results showed that staff nurses considered “Respect job schedule preferences” to be the most important of the recognition behaviors. In contrast, nurse managers gave “Nurse manager meets with the staff nurses to discuss patient care and unit management” the highest score for importance. Four factors (marriage status, age, years of clinical experience, and training background) affected the professional awareness of recognition behaviors. Our results suggest that nurse managers need to consider these factors when they conduct recognition behaviors.展开更多
Objective: The purpose of this qualitative study was to obtain a better understanding of nurse manager’s recognition behavior. Methods: This study, consisting of semi-structured interviews, was conducted in five hosp...Objective: The purpose of this qualitative study was to obtain a better understanding of nurse manager’s recognition behavior. Methods: This study, consisting of semi-structured interviews, was conducted in five hospitals with 100 beds or more in the Kanto, Kansai, and Kyushu regions of Japan. Fifteen nurse managers, who each had more than one year of professional work experience as a nurse manager, participated in this study. Results: We extracted four categories and fourteen subcategories as the factors related to the recognition behaviors in nurse managers. The first category is the basis of the recognition behaviors, which were divided into the following four subcategories: recognition behaviors that they received, perception of recognition behaviors, construction of confidential relationships with staff nurses, and the organizational climate. The second category is the issues that make recognition behaviors difficult, which were classified into the following three subcategories: multiple duties, number of staff nurses, and characteristics of the recent staff nurses. The third category is the factors regarding the staff nurses that must be considered, which consist of the following two subcategories: the characteristics and motivation of staff nurses and recognition behaviors that the staff nurses expect. The forth category is the methods of the recognition behaviors, which consist of the following five categories: watching over and consideration of individuals, evaluation of routine work, development as a professional, opinion sharing and delegating work, and promotion of work-life balance. Conclusions: The recognition behavior by nurse managers is influenced by their own experience, and nurse managers practice recognition behaviors in response to the characteristics of their staff nurses in a busy environment. Our results suggest that nurse managers need expertise in management for them to identity appropriate recognition behavior.展开更多
Recently,human healthcare from body sensor data has gained considerable interest from a wide variety of human-computer communication and pattern analysis research owing to their real-time applications namely smart hea...Recently,human healthcare from body sensor data has gained considerable interest from a wide variety of human-computer communication and pattern analysis research owing to their real-time applications namely smart healthcare systems.Even though there are various forms of utilizing distributed sensors to monitor the behavior of people and vital signs,physical human action recognition(HAR)through body sensors gives useful information about the lifestyle and functionality of an individual.This article concentrates on the design of an Improved Transient Search Optimization with Machine Learning based BehaviorRecognition(ITSOMLBR)technique using body sensor data.The presented ITSOML-BR technique collects data from different body sensors namely electrocardiography(ECG),accelerometer,and magnetometer.In addition,the ITSOML-BR technique extract features like variance,mean,skewness,and standard deviation.Moreover,the presented ITSOML-BR technique executes a micro neural network(MNN)which can be employed for long term healthcare monitoring and classification.Furthermore,the parameters related to the MNN model are optimally selected via the ITSO algorithm.The experimental result analysis of the ITSOML-BR technique is tested on the MHEALTH dataset.The comprehensive comparison study reported a higher result for the ITSOMLBR approach over other existing approaches with maximum accuracy of 99.60%.展开更多
文摘A common but flawed design in existing CNN architectures is using strided convolutions and/or pooling layer,which will result in the loss of fine-grained feature information,especially for low-resolution images and small objects.In this paper,a new CNN building block named SPD-Conv was used,which completely eliminated stride and pooling operations and replaced them with a space-to-depth convolution and a non-strided convolution.Such new design has the advantage of downsampling feature maps while retaining discriminant feature information.It also represents a general unified method,which can be easily applied to any CNN architectures,and can also be applied to strided conversion and pooling in the same way.
基金co-supported by the Natural Science Basic Research Program of Shaanxi,China(No.2023-JC-QN-0043)the ND Basic Research Funds,China(No.G2022WD).
文摘The aerial deployment method enables Unmanned Aerial Vehicles(UAVs)to be directly positioned at the required altitude for their mission.This method typically employs folding technology to improve loading efficiency,with applications such as the gravity-only aerial deployment of high-aspect-ratio solar-powered UAVs,and aerial takeoff of fixed-wing drones in Mars research.However,the significant morphological changes during deployment are accompanied by strong nonlinear dynamic aerodynamic forces,which result in multiple degrees of freedom and an unstable character.This hinders the description and analysis of unknown dynamic behaviors,further leading to difficulties in the design of deployment strategies and flight control.To address this issue,this paper proposes an analysis method for dynamic behaviors during aerial deployment based on the Variational Autoencoder(VAE).Focusing on the gravity-only deployment problem of highaspect-ratio foldable-wing UAVs,the method encodes the multi-degree-of-freedom unstable motion signals into a low-dimensional feature space through a data-driven approach.By clustering in the feature space,this paper identifies and studies several dynamic behaviors during aerial deployment.The research presented in this paper offers a new method and perspective for feature extraction and analysis of complex and difficult-to-describe extreme flight dynamics,guiding the research on aerial deployment drones design and control strategies.
基金Supported by The Three Vertical Basic Cultivation Project of Heilongjiang Bayi Agricultural University(ZRCPY202314).
文摘To address the issue of low recognition accuracy for eight types of behaviors including standing,walking,drinking,lying,eating,mounting,fighting and limping in complex multi-cow farm environments,a multi-target cow behavior recognition method based on an improved YOLOv11n algorithm was proposed.The detection capability for small targets in images was enhanced by incorporating a DASI module into the backbone network and a MDCR module into the neck network,based on YOLOv11.The improved YOLOv11 algorithm increased the mean average precision from the original 89.5%to 93%,with particularly notable improvements of 8.7%and 6.3%in the average precision for recognizing drinking and walking behaviors,respectively.These results fully demonstrate that the proposed method enhances the model s ability to recognize cow behaviors.
基金the National Key Research and Development Program of China(No.2022YFC3601400)。
文摘Frequency-modulated continuous-wave radar enables the non-contact and privacy-preserving recognition of human behavior.However,the accuracy of behavior recognition is directly influenced by the spatial relationship between human posture and the radar.To address the issue of low accuracy in behavior recognition when the human body is not directly facing the radar,a method combining local outlier factor with Doppler information is proposed for the correction of multi-classifier recognition results.Initially,the information such as distance,velocity,and micro-Doppler spectrogram of the target is obtained using the fast Fourier transform and histogram of oriented gradients-support vector machine methods,followed by preliminary recognition.Subsequently,Platt scaling is employed to transform recognition results into confidence scores,and finally,the Doppler-local outlier factor method is utilized to calibrate the confidence scores,with the highest confidence classifier result considered as the recognition outcome.Experimental results demonstrate that this approach achieves an average recognition accuracy of 96.23%for comprehensive human behavior recognition in various orientations.
基金supported by the National Natural Science Foundation of China(No.61971439 and No.61702543)the Natural Science Foundation of the Jiangsu Province of China(No.BK20191329)+1 种基金the China Postdoctoral Science Foundation Project(No.2019T120987)the Startup Foundation for Introducing Talent of NUIST(No.2020r100).
文摘Communication behavior recognition is an issue with increasingly importance in the antiterrorism and national defense area.However,the sensing data obtained in actual environment is often not sufficient to accurately analyze the communication behavior.Traditional means can hardly utilize the scarce and crude spectrum sensing data captured in a real scene.Thus,communication behavior recognition using raw sensing data under smallsample condition has become a new challenge.In this paper,a data enhanced communication behavior recognition(DECBR)scheme is proposed to meet this challenge.Firstly,a preprocessing method is designed to make the raw spectrum data suitable for the proposed scheme.Then,an adaptive convolutional neural network structure is exploited to carry out communication behavior recognition.Moreover,DCGAN is applied to support data enhancement,which realize communication behavior recognition under small-sample condition.Finally,the scheme is verified by experiments under different data size.The results show that the DECBR scheme can greatly improve the accuracy and efficiency of behavior recognition under smallsample condition.
基金supported in part by the 2023 Key Supported Project of the 14th Five Year Plan for Education and Science in Hunan Province with No.ND230795.
文摘In recent years,skeleton-based action recognition has made great achievements in Computer Vision.A graph convolutional network(GCN)is effective for action recognition,modelling the human skeleton as a spatio-temporal graph.Most GCNs define the graph topology by physical relations of the human joints.However,this predefined graph ignores the spatial relationship between non-adjacent joint pairs in special actions and the behavior dependence between joint pairs,resulting in a low recognition rate for specific actions with implicit correlation between joint pairs.In addition,existing methods ignore the trend correlation between adjacent frames within an action and context clues,leading to erroneous action recognition with similar poses.Therefore,this study proposes a learnable GCN based on behavior dependence,which considers implicit joint correlation by constructing a dynamic learnable graph with extraction of specific behavior dependence of joint pairs.By using the weight relationship between the joint pairs,an adaptive model is constructed.It also designs a self-attention module to obtain their inter-frame topological relationship for exploring the context of actions.Combining the shared topology and the multi-head self-attention map,the module obtains the context-based clue topology to update the dynamic graph convolution,achieving accurate recognition of different actions with similar poses.Detailed experiments on public datasets demonstrate that the proposed method achieves better results and realizes higher quality representation of actions under various evaluation protocols compared to state-of-the-art methods.
基金This research was funded by the Science and Technology Department of Shaanxi Province,China,Grant Number 2019GY-036.
文摘The core technology in an intelligent video surveillance system is that detecting and recognizing abnormal behaviors timely and accurately.The key breakthrough point in recognizing abnormal behaviors is how to obtain the effective features of the picture,so as to solve the problem of recognizing them.In response to this difficulty,this paper introduces an adjustable jump link coefficients model based on the residual network.The effective coefficients for each layer of the network can be set after using this model to further improving the recognition accuracy of abnormal behavior.A convolution kernel of 1×1 size is added to reduce the number of parameters for the purpose of improving the speed of the model in this paper.In order to reduce the noise of the data edge,and at the same time,improve the accuracy of the data and speed up the training,a BN(Batch Normalization)layer is added before the activation function in this network.This paper trains this network model on the public ImageNet dataset,and then uses the transfer learning method to recognize these abnormal behaviors of human in the UTI behavior dataset processed by the YOLO_v3 target detection network.Under the same experimental conditions,compared with the original ResNet-50 model,the improved model in this paper has a 2.8%higher accuracy in recognition of abnormal behaviors on the public UTI dataset.
文摘In the process of human behavior recognition, the traditional dense optical flow method has too many pixels and too much overhead, which limits the running speed. This paper proposed a method combing YOLOv3 (You Only Look Once v3) and local optical flow method. Based on the dense optical flow method, the optical flow modulus of the area where the human target is detected is calculated to reduce the amount of computation and save the cost in terms of time. And then, a threshold value is set to complete the human behavior identification. Through design algorithm, experimental verification and other steps, the walking, running and falling state of human body in real life indoor sports video was identified. Experimental results show that this algorithm is more advantageous for jogging behavior recognition.
基金Supported by the Shaanxi Province Key Research and Development Project(No.2021 GY-280)the Natural Science Foundation of Shaanxi Province(No.2021JM-459)the National Natural Science Foundation of China(No.61772417,61634004,61602377).
文摘In order to effectively solve the problems of low accuracy and large amount of calculation of current human behavior recognition,a behavior recognition algorithm based on squeeze-and-excitation network(SENet) combined with 3 D Inception network(I3 D) and gated recurrent unit(GRU) network is proposed.The algorithm first expands the Inception module to three-dimensional,and builds a network based on the three-dimensional module,and expands SENet to three-dimensional,making it an attention mechanism that can pay attention to the three-dimensional channel.Then SENet is introduced into the 13 D network,named SE-I3 D,and SENet is introduced into the CRU network,named SE-GRU.And,SE-13 D and SE-GRU are merged,named SE-13 D-GRU.Finally,the network uses Softmax to classify the results in the UCF-101 dataset.The experimental results show that the SE-I3 D-GRU network achieves a recognition rate of 93.2% on the UCF-101 dataset.
基金supported by the National Natural Science Foundation of China(No.62006135)the Natural Science Foundation of Shandong Province(No.ZR2020QF116)。
文摘With the intensifying aging of the population,the phenomenon of the elderly living alone is also increasing.Therefore,using modern internet of things technology to monitor the daily behavior of the elderly in indoors is a meaningful study.Video-based action recognition tasks are easily affected by object occlusion and weak ambient light,resulting in poor recognition performance.Therefore,this paper proposes an indoor human behavior recognition method based on wireless fidelity(Wi-Fi)perception and video feature fusion by utilizing the ability of Wi-Fi signals to carry environmental information during the propagation process.This paper uses the public WiFi-based activity recognition dataset(WIAR)containing Wi-Fi channel state information and essential action videos,and then extracts video feature vectors and Wi-Fi signal feature vectors in the datasets through the two-stream convolutional neural network and standard statistical algorithms,respectively.Then the two sets of feature vectors are fused,and finally,the action classification and recognition are performed by the support vector machine(SVM).The experiments in this paper contrast experiments between the two-stream network model and the methods in this paper under three different environments.And the accuracy of action recognition after adding Wi-Fi signal feature fusion is improved by 10%on average.
基金the National Natural Science Foundation of China(No.61772417,61634004,61602377)Key R&D Program Projects in Shaanxi Province(No.2017GY-060)Shaanxi Natural Science Basic Research Project(No.2018JM4018).
文摘In order to effectively solve the problems of low accuracy,large amount of computation and complex logic of deep learning algorithms in behavior recognition,a kind of behavior recognition based on the fusion of 3 dimensional batch normalization visual geometry group(3D-BN-VGG)and long short-term memory(LSTM)network is designed.In this network,3D convolutional layer is used to extract the spatial domain features and time domain features of video sequence at the same time,multiple small convolution kernels are stacked to replace large convolution kernels,thus the depth of neural network is deepened and the number of network parameters is reduced.In addition,the latest batch normalization algorithm is added to the 3-dimensional convolutional network to improve the training speed.Then the output of the full connection layer is sent to LSTM network as the feature vectors to extract the sequence information.This method,which directly uses the output of the whole base level without passing through the full connection layer,reduces the parameters of the whole fusion network to 15324485,nearly twice as much as those of 3D-BN-VGG.Finally,it reveals that the proposed network achieves 96.5%and 74.9%accuracy in the UCF-101 and HMDB-51 respectively,and the algorithm has a calculation speed of 1066 fps and an acceleration ratio of 1,which has a significant predominance in velocity.
基金the National Natural Science Foundation of China(No.61834005,61772417,61802304)the Shaanxi Province Key Research and Development Project(2021GY280).
文摘Compared with RGB videos and images,human bone data is less vulnerable to external factors and has stronger robustness.Therefore,behavior recognition methods based on skeletons are widely studied.Because graph convolution network(GCN)can deal with the irregular topology data of hu-man skeletons very well,more and more researchers apply GCN to human behavior recognition.Tra-ditional graph convolution methods only consider the joints with physical connectivity or the same type when building the behavior recognition model based on human skeletons structure,which cannot capture higher-order information better.To solve this problem,Motif-GCN is used in this paper to ex-tract spatial features.The relationship between the joints with natural connection in the human body is encoded by the first Motif-GCN,and the possible relationship between the unconnected joints in the human skeleton is encoded by the second Motif-GCN.In this way,the relationship between non-physical joints can be strengthened.Then a two stream framework combining joint and bone informa-tion is used to capture more action information.Finally,experiments are conducted on two subdata-sets X-Sub and X-View of NTU-RGB+D,and the accuracy shown in Top-1 classification results is 89.5%and 95.4%respectively.The experimental results are 1.0%and 0.3%higher than those of the 2S-AGCN model respectively.The superiority of this method is also proved by the experimental results.
文摘Building indoor dangerous behavior recognition is a specific application in the field of abnormal human recognition.A human dangerous behavior recognition method based on LSTM-GCN with attention mechanism(GLA)model was proposed aiming at the problem that the existing human skeleton-based action recognition methods cannot fully extract the temporal and spatial features.The network connects GCN and LSTMnetwork in series,and inputs the skeleton sequence extracted by GCN that contains spatial information into the LSTM layer for time sequence feature extraction,which fully excavates the temporal and spatial features of the skeleton sequence.Finally,an attention layer is designed to enhance the features of key bone points,and Softmax is used to classify and identify dangerous behaviors.The dangerous behavior datasets are derived from NTU-RGB+D and Kinetics data sets.Experimental results show that the proposed method can effectively identify some dangerous behaviors in the building,and its accuracy is higher than those of other similar methods.
基金Supported by the Shaanxi Province Key Research and Development Project (No. 2021GY-280)Shaanxi Province Natural Science Basic Research Program (No. 2021JM-459)the National Natural Science Foundation of China (No. 61772417)
文摘Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the residual module is extended to three dimensions,which can extract features in the time and space domain at the same time.Second,by changing the size of the pooling layer window the integrity of the time domain features is preserved,at the same time,in order to overcome the difficulty of network training and over-fitting problems,the batch normalization(BN)layer and the dropout layer are added.After that,because the global average pooling layer(GAP)is affected by the size of the feature map,the network cannot be further deepened,so the convolution layer and maxpool layer are added to the R3D network.Finally,because LSTM has the ability to memorize information and can extract more abstract timing features,the LSTM network is introduced into the R3D network.Experimental results show that the R3D+LSTM network achieves 91%recognition rate on the UCF-101 dataset.
基金supported by the Zhejiang Provincial Natural Science Foundation of China(No.LQ23F030001)the National Natural Science Foundation of China(No.62406280)+5 种基金the Autism Research Special Fund of Zhejiang Foundation for Disabled Persons(No.2023008)the Liaoning Province Higher Education Innovative Talents Program Support Project(No.LR2019058)the Liaoning Province Joint Open Fund for Key Scientific and Technological Innovation Bases(No.2021-KF-12-05)the Central Guidance on Local Science and Technology Development Fund of Liaoning Province(No.2023JH6/100100066)the Key Laboratory for Biomedical Engineering of Ministry of Education,Zhejiang University,Chinain part by the Open Research Fund of the State Key Laboratory of Cognitive Neuroscience and Learning.
文摘Video action recognition(VAR)aims to analyze dynamic behaviors in videos and achieve semantic understanding.VAR faces challenges such as temporal dynamics,action-scene coupling,and the complexity of human interactions.Existing methods can be categorized into motion-level,event-level,and story-level ones based on spatiotemporal granularity.However,single-modal approaches struggle to capture complex behavioral semantics and human factors.Therefore,in recent years,vision-language models(VLMs)have been introduced into this field,providing new research perspectives for VAR.In this paper,we systematically review spatiotemporal hierarchical methods in VAR and explore how the introduction of large models has advanced the field.Additionally,we propose the concept of“Factor”to identify and integrate key information from both visual and textual modalities,enhancing multimodal alignment.We also summarize various multimodal alignment methods and provide in-depth analysis and insights into future research directions.
基金supported by the Key Program of the National Natural Science Foundation of China(31730104)National Natural Science Foundation of China(31801981,31800319)+4 种基金Strategic Priority Research Program of the Chinese Academy of Sciences(XDB31020302)Shaanxi Innovation Capability Support Plan(2020KJXX-008)Special Foundation of Shaanxi Academy of Sciences,China(2021k-5,2018K-16-04,2017K-06)Shaanxi Key Research and Development Program(2018PT-04)Open Foundation of Key Laboratory of Beijing Zoo(ZDK202004).
文摘Rank recognition allows social animals to adapt to complex and changeable environments and to cope with hierarchical relationships within their societies(Crone 2017).Rank recognition can improve the distribution of advantageous resources,individual adaptation,and social cohesion among group-living animals(Marmolejo-Ramos and Angiulli 2014).Empirical evidence suggests that rank recognition is a basic behavioral manifestation of social cognition adopted by a wide range of insects,birds,and mammals,including nonhuman primates(Schmitt and Fischer 2011;Smith et al.2017).Unlike most other vertebrates,primates have unusually large brains and form complex social groups.
基金supported by the National Natural Science Foundation of China(62071069)。
文摘User behavior prediction has become a core element to Internet of Things(IoT)and received promising attention in the related fields.Many existing IoT systems(e.g.smart home systems)have been deployed various sensors and the user’s behavior can be predicted through the sensor data.However,most of the existing sensor-based systems use the annotated behavior data which requires human intervention to achieve the behavior prediction.Therefore,it is a challenge to provide an automatic behavior prediction model based on the original sensor data.To solve the problem,this paper proposed a novel automatic annotated user behavior prediction(AAUBP)model.The proposed AAUBP model combined the Discontinuous Solving Order Sequence Mining(DVSM)behavior recognition model and behavior prediction model based on the Long Short Term Memory(LSTM)network.To evaluate the model,we performed several experiments on a real-world dataset tuning the parameters.The results showed that the AAUBP model can effectively recognize behaviors and had a good performance for behavior prediction.
文摘Nurse managers play a critical role in improving the work environment. Important leadership characteristics for nurse managers include visibility, accessibility, communication, recognition, and support. The nurse manager’s recognition behaviors strongly influence the job satisfaction of staff nurses. In our previous study, we investigated how staff nurses perceived the nurse manager’s recognition behaviors and revealed that there was a divergence in practical approaches to these behaviors between the nurse manager and the staff. We assume that one factor causing this divergence could be perception gaps between the nurse manager and the staff. The aim of this study, therefore, was to uncover what types of perception gaps exist between the nurse manager and staff nurses and whether the background of staff nurses, such as years of experience or academic background, could affect the staff nurses’ perceptions. This quantitative, cross-sectional study involved 10 hospitals in Japan. A total of 1425 nurses completed the questionnaire. The results showed that staff nurses considered “Respect job schedule preferences” to be the most important of the recognition behaviors. In contrast, nurse managers gave “Nurse manager meets with the staff nurses to discuss patient care and unit management” the highest score for importance. Four factors (marriage status, age, years of clinical experience, and training background) affected the professional awareness of recognition behaviors. Our results suggest that nurse managers need to consider these factors when they conduct recognition behaviors.
文摘Objective: The purpose of this qualitative study was to obtain a better understanding of nurse manager’s recognition behavior. Methods: This study, consisting of semi-structured interviews, was conducted in five hospitals with 100 beds or more in the Kanto, Kansai, and Kyushu regions of Japan. Fifteen nurse managers, who each had more than one year of professional work experience as a nurse manager, participated in this study. Results: We extracted four categories and fourteen subcategories as the factors related to the recognition behaviors in nurse managers. The first category is the basis of the recognition behaviors, which were divided into the following four subcategories: recognition behaviors that they received, perception of recognition behaviors, construction of confidential relationships with staff nurses, and the organizational climate. The second category is the issues that make recognition behaviors difficult, which were classified into the following three subcategories: multiple duties, number of staff nurses, and characteristics of the recent staff nurses. The third category is the factors regarding the staff nurses that must be considered, which consist of the following two subcategories: the characteristics and motivation of staff nurses and recognition behaviors that the staff nurses expect. The forth category is the methods of the recognition behaviors, which consist of the following five categories: watching over and consideration of individuals, evaluation of routine work, development as a professional, opinion sharing and delegating work, and promotion of work-life balance. Conclusions: The recognition behavior by nurse managers is influenced by their own experience, and nurse managers practice recognition behaviors in response to the characteristics of their staff nurses in a busy environment. Our results suggest that nurse managers need expertise in management for them to identity appropriate recognition behavior.
文摘Recently,human healthcare from body sensor data has gained considerable interest from a wide variety of human-computer communication and pattern analysis research owing to their real-time applications namely smart healthcare systems.Even though there are various forms of utilizing distributed sensors to monitor the behavior of people and vital signs,physical human action recognition(HAR)through body sensors gives useful information about the lifestyle and functionality of an individual.This article concentrates on the design of an Improved Transient Search Optimization with Machine Learning based BehaviorRecognition(ITSOMLBR)technique using body sensor data.The presented ITSOML-BR technique collects data from different body sensors namely electrocardiography(ECG),accelerometer,and magnetometer.In addition,the ITSOML-BR technique extract features like variance,mean,skewness,and standard deviation.Moreover,the presented ITSOML-BR technique executes a micro neural network(MNN)which can be employed for long term healthcare monitoring and classification.Furthermore,the parameters related to the MNN model are optimally selected via the ITSO algorithm.The experimental result analysis of the ITSOML-BR technique is tested on the MHEALTH dataset.The comprehensive comparison study reported a higher result for the ITSOMLBR approach over other existing approaches with maximum accuracy of 99.60%.
