This paper proposes five indicators to evaluate the effectiveness and viability for adverse glycemic events detection based on predicted blood glucose(BG)values.False negative rate(FNR)and false positive rate(FPR)are ...This paper proposes five indicators to evaluate the effectiveness and viability for adverse glycemic events detection based on predicted blood glucose(BG)values.False negative rate(FNR)and false positive rate(FPR)are defined to evaluate whether it can detect adverse glycemic events(AGEs)based on the predicted value.The temporal overlap(TO)and time difference(TD)are proposed to evaluate whether the predicted model can capture the accurate time duration of AGEs.The sum of squared percent(SSP)measures comprehensive similarity between prediction values and true values.We examined 328 patients with type 2 diabetes,containing real continuous glucose monitoring data with 5-minute time intervals.Autoregressive integrated moving average model has lower FNR and FPR.The gated recurrent unit has better temporal behavior where the mean TO with standard deviation is calculated as 0.84±0.18,and the mean TD with standard deviation is(4.39±4.01)min.Neural models have better effects on SSP(for hypoglycemia,long-short tern memory possesses 0.149 and 0.246).These five indicators are able to evaluate whether we can detect abnormal BG levels and reveal the temporal behavior of AGEs effectively.The proposed neural predictive models have more promising application in AGE detection.展开更多
The occurrence of microseismic is not random but is related to the physical properties of the underground medium.Due to the low intensity and the influence of noise,microseismic eventually lead to poor signal-to-noise...The occurrence of microseismic is not random but is related to the physical properties of the underground medium.Due to the low intensity and the influence of noise,microseismic eventually lead to poor signal-to-noise ratio.We proposed a method for automatic detection of microseismic events by adoption of multiscale top-hat transformation.The method is based on the difference between the signal and noise in the multiscale top-hat transform section and achieves the detection on a specific section.The microseismic data are decomposed into different scales by multiscale morphology top-hat transformation firstly.Then the potential microseismic events could be detected by picking up the peak value in the multiscale top-hat section,and the characteristic profile obtains the start point with a specific threshold value.Finally,the synthetic data experiences demonstrate the advantages of this method under strong and weak noisy conditions,and the filed data example also shows its reliability and adaptability.展开更多
Artificial intelligence for science(AI4S)has emerged as a new horizon in state-of-the-art scientific research,and single-molecule electronics could be considered an ideal prototype in AI4S due to the opportunities in ...Artificial intelligence for science(AI4S)has emerged as a new horizon in state-of-the-art scientific research,and single-molecule electronics could be considered an ideal prototype in AI4S due to the opportunities in correlating highthroughput and high-quality data with clear physical mechanisms.Towards using artificial intelligence for single-molecule electronics(AI4SME),the unsupervised extraction of lowprobability events from the massive experimental data becomes the key step,which has emerged for accurate detection of different configurations and even structural changes in singlemolecule junctions.However,the present algorithms suffer from the“uniform effect”,in which the majority events are erroneously allocated to minority ones,resulting in a relatively equal spread of cluster sizes and hindering the investigations for charge transport mechanisms with subtle and complex behaviors in single-molecule electronics.In this work,we propose a new multi-prototype clustering technique for precisely discriminating molecular events during the break junction process,especially those occurring with a probability below 10%,and further precisely extract the product species at the onset of the electric field-driven single-molecule keto-enol reaction with a probability as low as 1.5%.Our work tackles the long-term bottleneck of uniform effect for the precise detection of low-probability single-molecule events.展开更多
1 Introduction Sound event detection(SED)aims to identify and locate specific sound event categories and their corresponding timestamps within continuous audio streams.To overcome the limitations posed by the scarcity...1 Introduction Sound event detection(SED)aims to identify and locate specific sound event categories and their corresponding timestamps within continuous audio streams.To overcome the limitations posed by the scarcity of strongly labeled training data,researchers have increasingly turned to semi-supervised learning(SSL)[1],which leverages unlabeled data to augment training and improve detection performance.Among many SSL methods[2-4].展开更多
Microseismic monitoring is essential for understanding subsurface dynamics and optimizing oil and gas pro-duction.However,traditional methods for the automatic detection of microseismic events rely heavily on characte...Microseismic monitoring is essential for understanding subsurface dynamics and optimizing oil and gas pro-duction.However,traditional methods for the automatic detection of microseismic events rely heavily on characteristic functions and human intervention,often resulting in suboptimal performance when dealing with complex and noisy data.In this study,we propose a novel approach that leverages deep learning frame to extract multiscale features from microseismic data using a TransUNet neural network.Our model integrates the ad-vantages of Transformer and UNet architectures to achieve high accuracy in multivariate image segmentation and precise picking of P-wave and S-wave first arrivals simultaneously.We validate our approach using both synthetic and field microseismic datasets recorded from gas storage monitoring and roof fracturing in a coal seam.The robustness of the proposed method has been verified in the testing of synthetic data with various levels of Gaussian and real background noises extracted from field data.The comparisons of the proposed method with UNet and SwinUNet in terms of the model architecture and classification performance demonstrate the Tran-sUNet achieves the optimal balance in its architecture and inference speed.With relatively low inference time and network complexity,it operates effectively in high-precision microseismic phase pickings.This advancement holds significant promise for enhancing microseismic monitoring technology in hydraulic fracturing and reser-voir monitoring applications.展开更多
Acoustic source localization(ASL)and sound event detection(SED)are two widely pursued independent research fields.In recent years,in order to achieve a more complete spatial and temporal representation of sound field,...Acoustic source localization(ASL)and sound event detection(SED)are two widely pursued independent research fields.In recent years,in order to achieve a more complete spatial and temporal representation of sound field,sound event localization and detection(SELD)has become a very active research topic.This paper presents a deep learning-based multioverlapping sound event localization and detection algorithm in three-dimensional space.Log-Mel spectrum and generalized cross-correlation spectrum are joined together in channel dimension as input features.These features are classified and regressed in parallel after training by a neural network to obtain sound recognition and localization results respectively.The channel attention mechanism is also introduced in the network to selectively enhance the features containing essential information and suppress the useless features.Finally,a thourough comparison confirms the efficiency and effectiveness of the proposed SELD algorithm.Field experiments show that the proposed algorithm is robust to reverberation and environment and can achieve higher recognition and localization accuracy compared with the baseline method.展开更多
To improve the detection accuracy and robustness of crowd anomaly detection,especially crowd emergency evacuation detection,the abnormal crowd behavior detection method is proposed.This method is based on the improved...To improve the detection accuracy and robustness of crowd anomaly detection,especially crowd emergency evacuation detection,the abnormal crowd behavior detection method is proposed.This method is based on the improved statistical global optical flow entropy which can better describe the degree of chaos of crowd.First,the optical flow field is extracted from the video sequences and a 2D optical flow histogram is gained.Then,the improved optical flow entropy,combining information theory with statistical physics is calculated from 2D optical flow histograms.Finally,the anomaly can be detected according to the abnormality judgment formula.The experimental results show that the detection accuracy achieved over 95%in three public video datasets,which indicates that the proposed algorithm outperforms other state-of-the-art algorithms.展开更多
Marine heatwave(MHW)events refer to periods of significantly elevated sea surface temperatures(SST),persisting from days to months,with significant impacts on marine ecosystems,including increased mortality among mari...Marine heatwave(MHW)events refer to periods of significantly elevated sea surface temperatures(SST),persisting from days to months,with significant impacts on marine ecosystems,including increased mortality among marine life and coral bleaching.Forecasting MHW events are crucial to mitigate their harmful effects.This study presents a twostep forecasting process:short-term SST prediction followed by MHW event detection based on the forecasted SST.Firstly,we developed the“SST-MHW-DL”model using the ConvLSTM architecture,which incorporates an attention mechanism to enhance both SST forecasting and MHW event detection.The model utilizes SST data from the preceding 60 d to forecast SST and detect MHW events for the subsequent 15 d.Verification results for SST forecasting demonstrate a root mean square error(RMSE)of 0.64℃,a mean absolute percentage error(MAPE)of 2.05%,and a coefficient of determination(R^(2))of 0.85,indicating the model’s ability to accurately predict future temperatures by leveraging historical sea temperature information.For MHW event detection using forecasted SST,the evaluation metrics of“accuracy”,“precision”,and“recall”achieved values of 0.77,0.73,and 0.43,respectively,demonstrating the model’s capability to capture the occurrence of MHW events accurately.Furthermore,the attention-enhanced mechanism reveals that recent SST variations within the past 10 days have the most significant impact on forecasting accuracy,while variations in deep-sea regions and along the Taiwan Strait significantly contribute to the model’s efficacy in capturing spatial characteristics.Additionally,the proposed model and temporal mechanism were applied to detect MHWs in the Atlantic Ocean.By inputting 30 d of SST data,the model predicted SST with an RMSE of 1.02℃and an R^(2)of 0.94.The accuracy,precision,and recall for MHW detection were 0.79,0.78,and 0.62,respectively,further demonstrating the model’s robustness and usability.展开更多
Current Chinese event detection methods commonly use word embedding to capture semantic representation,but these methods find it difficult to capture the dependence relationship between the trigger words and other wor...Current Chinese event detection methods commonly use word embedding to capture semantic representation,but these methods find it difficult to capture the dependence relationship between the trigger words and other words in the same sentence.Based on the simple evaluation,it is known that a dependency parser can effectively capture dependency relationships and improve the accuracy of event categorisation.This study proposes a novel architecture that models a hybrid representation to summarise semantic and structural information from both characters and words.This model can capture rich semantic features for the event detection task by incorporating the semantic representation generated from the dependency parser.The authors evaluate different models on kbp 2017 corpus.The experimental results show that the proposed method can significantly improve performance in Chinese event detection.展开更多
Online social media networks are gaining attention worldwide,with an increasing number of people relying on them to connect,communicate and share their daily pertinent event-related information.Event detection is now ...Online social media networks are gaining attention worldwide,with an increasing number of people relying on them to connect,communicate and share their daily pertinent event-related information.Event detection is now increasingly leveraging online social networks for highlighting events happening around the world via the Internet of People.In this paper,a novel Event Detection model based on Scoring and Word Embedding(ED-SWE)is proposed for discovering key events from a large volume of data streams of tweets and for generating an event summary using keywords and top-k tweets.The proposed ED-SWE model can distill high-quality tweets,reduce the negative impact of the advent of spam,and identify latent events in the data streams automatically.Moreover,a word embedding algorithm is used to learn a real-valued vector representation for a predefined fixed-sized vocabulary from a corpus of Twitter data.In order to further improve the performance of the Expectation-Maximization(EM)iteration algorithm,a novel initialization method based on the authority values of the tweets is also proposed in this paper to detect live events efficiently and precisely.Finally,a novel automatic identification method based on the cosine measure is used to automatically evaluate whether a given topic can form a live event.Experiments conducted on a real-world dataset demonstrate that the ED-SWE model exhibits better efficiency and accuracy than several state-of-art event detection models.展开更多
Online social media exhibit massive organizational event relevant messages, and the well categorized event information can be useful in many real-world applications. In this paper, we propose a research framework to e...Online social media exhibit massive organizational event relevant messages, and the well categorized event information can be useful in many real-world applications. In this paper, we propose a research framework to extract high quality event information from massive online media data. The main contributions lie in two aspects: First, we present an event-extraction and event-categorization system for online media data; second, we present a novel approach for both discovering important event categories and classifying extracted events based on word representation and clustering model. Experimental results with real dataset show that the proposed framework is effective to extract high quality event information.展开更多
Event detection(ED)is aimed at detecting event occurrences and categorizing them.This task has been previously solved via recognition and classification of event triggers(ETs),which are defined as the phrase or word m...Event detection(ED)is aimed at detecting event occurrences and categorizing them.This task has been previously solved via recognition and classification of event triggers(ETs),which are defined as the phrase or word most clearly expressing event occurrence.Thus,current approaches require both annotated triggers as well as event types in training data.Nevertheless,triggers are non-essential in ED,and it is time-wasting for annotators to identify the“most clearly”word from a sentence,particularly in longer sentences.To decrease manual effort,we evaluate event detectionwithout triggers.We propose a novel framework that combines Type-aware Attention and Graph Convolutional Networks(TA-GCN)for event detection.Specifically,the task is identified as a multi-label classification problem.We first encode the input sentence using a novel type-aware neural network with attention mechanisms.Then,a Graph Convolutional Networks(GCN)-based multilabel classification model is exploited for event detection.Experimental results demonstrate the effectiveness.展开更多
Recently, the Internet of Things (loT) has attracted more and more attention. Multimedia sensor network plays an important role in the IoT, and audio event detection in the multimedia sensor net- works is one of the...Recently, the Internet of Things (loT) has attracted more and more attention. Multimedia sensor network plays an important role in the IoT, and audio event detection in the multimedia sensor net- works is one of the most important applications for the Internet of Things. In practice, it is hard to get enough real-world samples to generate the classifi- ers for some special audio events (e.g., car-crash- ing in the smart traffic system). In this paper, we introduce a TrAdaBoost-based method to solve the above problem. By using the proposed approach, we can train a strong classifier by using only a tiny amount of real-world data and a large number of more easily collected samples (e.g., collected from TV programs), even when the real-world data is not sufficient to train a model alone. We deploy this ap- proach in a smart traffic system to evaluate its per- formance, and the experiment evaluations demonstrate that our method can achieve satisfying results.展开更多
Semantic video analysis plays an important role in the field of machine intelligence and pattern recognition. In this paper, based on the Hidden Markov Model (HMM), a semantic recognition framework on compressed video...Semantic video analysis plays an important role in the field of machine intelligence and pattern recognition. In this paper, based on the Hidden Markov Model (HMM), a semantic recognition framework on compressed videos is proposed to analyze the video events according to six low-level features. After the detailed analysis of video events, the pattern of global motion and five features in foreground—the principal parts of videos, are employed as the observations of the Hidden Markov Model to classify events in videos. The applications of the proposed framework in some video event detections demonstrate the promising success of the proposed framework on semantic video analysis.展开更多
How to quickly and accurately detect new topics from massive data online becomes a main problem of public opinion monitoring in cyberspace. This paperpresents a new event detection method for the current new event det...How to quickly and accurately detect new topics from massive data online becomes a main problem of public opinion monitoring in cyberspace. This paperpresents a new event detection method for the current new event detection system, based on sorted subtopic matching algorithm and constructs the entire design framework. In this p^per, the subtopics contained in old topics (or news stories) are sorted in descending order according to their importance to the topic(or news stories), and form a sorted subtopic sequence. In the process of subtopic matching, subtopic scoring matrix is used to determine whether a new story is reporting a new event. Experimental results show that the sorted subtopic matching model improved the accuracy and effectiveness ofthenew event detection system in cyberspace.展开更多
In this paper,we consider unusual event detection problem in a novel viewpoint and provide an algorithm to solve the problem.The actions or events in the scene is usual or not will eventually be reflected on the chang...In this paper,we consider unusual event detection problem in a novel viewpoint and provide an algorithm to solve the problem.The actions or events in the scene is usual or not will eventually be reflected on the changes of some basic features.We summarize these basic event features and propose special representation for each of them.Thus we can model these features in a uniform mode using adaptive Gaussian mixture model.Supervised and unsupervised unusual event detection algorithm can be designed to fit various situations based on this model.The superiority of our model is that it can detect unusual event automatically without to know the determinate model of unusual events.In conclusion,we provide two applications to verify the effectiveness of our model.展开更多
Crowd Anomaly Detection has become a challenge in intelligent video surveillance system and security.Intelligent video surveillance systems make extensive use of data mining,machine learning and deep learning methods....Crowd Anomaly Detection has become a challenge in intelligent video surveillance system and security.Intelligent video surveillance systems make extensive use of data mining,machine learning and deep learning methods.In this paper a novel approach is proposed to identify abnormal occurrences in crowded situations using deep learning.In this approach,Adaptive GoogleNet Neural Network Classifier with Multi-Objective Whale Optimization Algorithm are applied to predict the abnormal video frames in the crowded scenes.We use multiple instance learning(MIL)to dynamically develop a deep anomalous ranking framework.This technique predicts higher anomalous values for abnormal video frames by treating regular and irregular video bags and video sections.We use the multi-objective whale optimization algorithm to optimize the entire process and get the best results.The performance parameters such as accuracy,precision,recall,and F-score are considered to evaluate the proposed technique using the Python simulation tool.Our simulation results show that the proposed method performs better than the conventional methods on the public live video dataset.展开更多
Social media like Twitter who serves as a novel news medium and has become increasingly popular since its establishment. Large scale first-hand user-generated tweets motivate automatic event detection on Twitter. Prev...Social media like Twitter who serves as a novel news medium and has become increasingly popular since its establishment. Large scale first-hand user-generated tweets motivate automatic event detection on Twitter. Previous unsupervised approaches detected events by clustering words. These methods detect events using burstiness,which measures surging frequencies of words at certain time windows. However,event clusters represented by a set of individual words are difficult to understand. This issue is addressed by building a document-level event detection model that directly calculates the burstiness of tweets,leveraging distributed word representations for modeling semantic information,thereby avoiding sparsity. Results show that the document-level model not only offers event summaries that are directly human-readable,but also gives significantly improved accuracies compared to previous methods on unsupervised tweet event detection,which are based on words/segments.展开更多
Focusing on the problem of goal event detection in soccer videos,a novel method based on Hidden Markov Model(HMM) and the semantic rule is proposed.Firstly,a HMM for a goal event is constructed.Then a Normalized Seman...Focusing on the problem of goal event detection in soccer videos,a novel method based on Hidden Markov Model(HMM) and the semantic rule is proposed.Firstly,a HMM for a goal event is constructed.Then a Normalized Semantic Weighted Sum(NSWS) rule is established by defining a new feature of shots,semantic observation weight.The test video is detected based on the HMM and the NSWS rule,respectively.Finally,a fusion scheme based on logic distance is proposed and the detection results of the HMM and the NSWS rule are fused by optimal weights in the decision level,obtaining the final result.Experimental results indicate that the proposed method achieves 96.43% precision and 100% recall,which shows the effectiveness of this letter.展开更多
Falls are the most common concern among older adults or disabled peo-ple who use scooters and wheelchairs.The early detection of disabled persons’falls is required to increase the living rate of an individual or prov...Falls are the most common concern among older adults or disabled peo-ple who use scooters and wheelchairs.The early detection of disabled persons’falls is required to increase the living rate of an individual or provide support to them whenever required.In recent times,the arrival of the Internet of Things(IoT),smartphones,Artificial Intelligence(AI),wearables and so on make it easy to design fall detection mechanisms for smart homecare.The current study devel-ops an Automated Disabled People Fall Detection using Cuckoo Search Optimi-zation with Mobile Networks(ADPFD-CSOMN)model.The proposed model’s major aim is to detect and distinguish fall events from non-fall events automati-cally.To attain this,the presented ADPFD-CSOMN technique incorporates the design of the MobileNet model for the feature extraction process.Next,the CSO-based hyperparameter tuning process is executed for the MobileNet model,which shows the paper’s novelty.Finally,the Radial Basis Function(RBF)clas-sification model recognises and classifies the instances as either fall or non-fall.In order to validate the betterment of the proposed ADPFD-CSOMN model,a com-prehensive experimental analysis was conducted.The results confirmed the enhanced fall classification outcomes of the ADPFD-CSOMN model over other approaches with an accuracy of 99.17%.展开更多
文摘This paper proposes five indicators to evaluate the effectiveness and viability for adverse glycemic events detection based on predicted blood glucose(BG)values.False negative rate(FNR)and false positive rate(FPR)are defined to evaluate whether it can detect adverse glycemic events(AGEs)based on the predicted value.The temporal overlap(TO)and time difference(TD)are proposed to evaluate whether the predicted model can capture the accurate time duration of AGEs.The sum of squared percent(SSP)measures comprehensive similarity between prediction values and true values.We examined 328 patients with type 2 diabetes,containing real continuous glucose monitoring data with 5-minute time intervals.Autoregressive integrated moving average model has lower FNR and FPR.The gated recurrent unit has better temporal behavior where the mean TO with standard deviation is calculated as 0.84±0.18,and the mean TD with standard deviation is(4.39±4.01)min.Neural models have better effects on SSP(for hypoglycemia,long-short tern memory possesses 0.149 and 0.246).These five indicators are able to evaluate whether we can detect abnormal BG levels and reveal the temporal behavior of AGEs effectively.The proposed neural predictive models have more promising application in AGE detection.
基金supported in part by the National Natural Science Foundation of China under Grant 41904098Fundamental Research Funds for the Central Universities,under Grant 2462018YJRC020 and Grant 2462020YXZZ006。
文摘The occurrence of microseismic is not random but is related to the physical properties of the underground medium.Due to the low intensity and the influence of noise,microseismic eventually lead to poor signal-to-noise ratio.We proposed a method for automatic detection of microseismic events by adoption of multiscale top-hat transformation.The method is based on the difference between the signal and noise in the multiscale top-hat transform section and achieves the detection on a specific section.The microseismic data are decomposed into different scales by multiscale morphology top-hat transformation firstly.Then the potential microseismic events could be detected by picking up the peak value in the multiscale top-hat section,and the characteristic profile obtains the start point with a specific threshold value.Finally,the synthetic data experiences demonstrate the advantages of this method under strong and weak noisy conditions,and the filed data example also shows its reliability and adaptability.
基金supported by the National Key Research and Development Program of China(No.2024YFA1208103)the National Natural Science Foundation of China(Nos.22403079,22173075,22325303,21933012,and 22250003)+1 种基金the Fujian Provincial Department of Science and Technology(Nos.2022H6014 and 2023H6002)the Fundamental Research Funds for the Central Universities(Nos.20720220020 and 20720200068).
文摘Artificial intelligence for science(AI4S)has emerged as a new horizon in state-of-the-art scientific research,and single-molecule electronics could be considered an ideal prototype in AI4S due to the opportunities in correlating highthroughput and high-quality data with clear physical mechanisms.Towards using artificial intelligence for single-molecule electronics(AI4SME),the unsupervised extraction of lowprobability events from the massive experimental data becomes the key step,which has emerged for accurate detection of different configurations and even structural changes in singlemolecule junctions.However,the present algorithms suffer from the“uniform effect”,in which the majority events are erroneously allocated to minority ones,resulting in a relatively equal spread of cluster sizes and hindering the investigations for charge transport mechanisms with subtle and complex behaviors in single-molecule electronics.In this work,we propose a new multi-prototype clustering technique for precisely discriminating molecular events during the break junction process,especially those occurring with a probability below 10%,and further precisely extract the product species at the onset of the electric field-driven single-molecule keto-enol reaction with a probability as low as 1.5%.Our work tackles the long-term bottleneck of uniform effect for the precise detection of low-probability single-molecule events.
基金supported by the Zhejiang Provincial Key R&D Program(Nos.2024C01108,2023C01030,2023C01034)the Hangzhou Key R&D Program(Nos.2023SZD0046,2024SZD1A03)the Ningbo Key R&D Program(No.2024Z114).
文摘1 Introduction Sound event detection(SED)aims to identify and locate specific sound event categories and their corresponding timestamps within continuous audio streams.To overcome the limitations posed by the scarcity of strongly labeled training data,researchers have increasingly turned to semi-supervised learning(SSL)[1],which leverages unlabeled data to augment training and improve detection performance.Among many SSL methods[2-4].
基金supported by a National Natural Science Foundation of China(Grant number 41974150 and 42174158)Natural Science Basic Research Program of Shaanxi(2023-JC-YB-220).
文摘Microseismic monitoring is essential for understanding subsurface dynamics and optimizing oil and gas pro-duction.However,traditional methods for the automatic detection of microseismic events rely heavily on characteristic functions and human intervention,often resulting in suboptimal performance when dealing with complex and noisy data.In this study,we propose a novel approach that leverages deep learning frame to extract multiscale features from microseismic data using a TransUNet neural network.Our model integrates the ad-vantages of Transformer and UNet architectures to achieve high accuracy in multivariate image segmentation and precise picking of P-wave and S-wave first arrivals simultaneously.We validate our approach using both synthetic and field microseismic datasets recorded from gas storage monitoring and roof fracturing in a coal seam.The robustness of the proposed method has been verified in the testing of synthetic data with various levels of Gaussian and real background noises extracted from field data.The comparisons of the proposed method with UNet and SwinUNet in terms of the model architecture and classification performance demonstrate the Tran-sUNet achieves the optimal balance in its architecture and inference speed.With relatively low inference time and network complexity,it operates effectively in high-precision microseismic phase pickings.This advancement holds significant promise for enhancing microseismic monitoring technology in hydraulic fracturing and reser-voir monitoring applications.
基金supported by the National Natural Science Foundation of China(61877067)the Foundation of Science and Technology on Near-Surface Detection Laboratory(TCGZ2019A002,TCGZ2021C003,6142414200511)the Natural Science Basic Research Program of Shaanxi(2021JZ-19)。
文摘Acoustic source localization(ASL)and sound event detection(SED)are two widely pursued independent research fields.In recent years,in order to achieve a more complete spatial and temporal representation of sound field,sound event localization and detection(SELD)has become a very active research topic.This paper presents a deep learning-based multioverlapping sound event localization and detection algorithm in three-dimensional space.Log-Mel spectrum and generalized cross-correlation spectrum are joined together in channel dimension as input features.These features are classified and regressed in parallel after training by a neural network to obtain sound recognition and localization results respectively.The channel attention mechanism is also introduced in the network to selectively enhance the features containing essential information and suppress the useless features.Finally,a thourough comparison confirms the efficiency and effectiveness of the proposed SELD algorithm.Field experiments show that the proposed algorithm is robust to reverberation and environment and can achieve higher recognition and localization accuracy compared with the baseline method.
基金National Natural Science Foundation of China(61701029)。
文摘To improve the detection accuracy and robustness of crowd anomaly detection,especially crowd emergency evacuation detection,the abnormal crowd behavior detection method is proposed.This method is based on the improved statistical global optical flow entropy which can better describe the degree of chaos of crowd.First,the optical flow field is extracted from the video sequences and a 2D optical flow histogram is gained.Then,the improved optical flow entropy,combining information theory with statistical physics is calculated from 2D optical flow histograms.Finally,the anomaly can be detected according to the abnormality judgment formula.The experimental results show that the detection accuracy achieved over 95%in three public video datasets,which indicates that the proposed algorithm outperforms other state-of-the-art algorithms.
基金The National Natural Science Foundation of China under contract Nos 42376175,42090044 and U2006211。
文摘Marine heatwave(MHW)events refer to periods of significantly elevated sea surface temperatures(SST),persisting from days to months,with significant impacts on marine ecosystems,including increased mortality among marine life and coral bleaching.Forecasting MHW events are crucial to mitigate their harmful effects.This study presents a twostep forecasting process:short-term SST prediction followed by MHW event detection based on the forecasted SST.Firstly,we developed the“SST-MHW-DL”model using the ConvLSTM architecture,which incorporates an attention mechanism to enhance both SST forecasting and MHW event detection.The model utilizes SST data from the preceding 60 d to forecast SST and detect MHW events for the subsequent 15 d.Verification results for SST forecasting demonstrate a root mean square error(RMSE)of 0.64℃,a mean absolute percentage error(MAPE)of 2.05%,and a coefficient of determination(R^(2))of 0.85,indicating the model’s ability to accurately predict future temperatures by leveraging historical sea temperature information.For MHW event detection using forecasted SST,the evaluation metrics of“accuracy”,“precision”,and“recall”achieved values of 0.77,0.73,and 0.43,respectively,demonstrating the model’s capability to capture the occurrence of MHW events accurately.Furthermore,the attention-enhanced mechanism reveals that recent SST variations within the past 10 days have the most significant impact on forecasting accuracy,while variations in deep-sea regions and along the Taiwan Strait significantly contribute to the model’s efficacy in capturing spatial characteristics.Additionally,the proposed model and temporal mechanism were applied to detect MHWs in the Atlantic Ocean.By inputting 30 d of SST data,the model predicted SST with an RMSE of 1.02℃and an R^(2)of 0.94.The accuracy,precision,and recall for MHW detection were 0.79,0.78,and 0.62,respectively,further demonstrating the model’s robustness and usability.
基金973 Program,Grant/Award Number:2014CB340504The State Key Program of National Natural Science of China,Grant/Award Number:61533018+3 种基金National Natural Science Foundation of China,Grant/Award Number:61402220The Philosophy and Social Science Foundation of Hunan Province,Grant/Award Number:16YBA323Natural Science Foundation of Hunan Province,Grant/Award Number:2020JJ4525Scientific Research Fund of Hunan Provincial Education Department,Grant/Award Number:18B279,19A439。
文摘Current Chinese event detection methods commonly use word embedding to capture semantic representation,but these methods find it difficult to capture the dependence relationship between the trigger words and other words in the same sentence.Based on the simple evaluation,it is known that a dependency parser can effectively capture dependency relationships and improve the accuracy of event categorisation.This study proposes a novel architecture that models a hybrid representation to summarise semantic and structural information from both characters and words.This model can capture rich semantic features for the event detection task by incorporating the semantic representation generated from the dependency parser.The authors evaluate different models on kbp 2017 corpus.The experimental results show that the proposed method can significantly improve performance in Chinese event detection.
基金The work reported in this paper has been supported by UK-Jiangsu 20-20 World Class University Initiative programme.
文摘Online social media networks are gaining attention worldwide,with an increasing number of people relying on them to connect,communicate and share their daily pertinent event-related information.Event detection is now increasingly leveraging online social networks for highlighting events happening around the world via the Internet of People.In this paper,a novel Event Detection model based on Scoring and Word Embedding(ED-SWE)is proposed for discovering key events from a large volume of data streams of tweets and for generating an event summary using keywords and top-k tweets.The proposed ED-SWE model can distill high-quality tweets,reduce the negative impact of the advent of spam,and identify latent events in the data streams automatically.Moreover,a word embedding algorithm is used to learn a real-valued vector representation for a predefined fixed-sized vocabulary from a corpus of Twitter data.In order to further improve the performance of the Expectation-Maximization(EM)iteration algorithm,a novel initialization method based on the authority values of the tweets is also proposed in this paper to detect live events efficiently and precisely.Finally,a novel automatic identification method based on the cosine measure is used to automatically evaluate whether a given topic can form a live event.Experiments conducted on a real-world dataset demonstrate that the ED-SWE model exhibits better efficiency and accuracy than several state-of-art event detection models.
基金supported by the National Natural Science Foundation of China under Grants No.71271044,No.U1233118,and No.71572029
文摘Online social media exhibit massive organizational event relevant messages, and the well categorized event information can be useful in many real-world applications. In this paper, we propose a research framework to extract high quality event information from massive online media data. The main contributions lie in two aspects: First, we present an event-extraction and event-categorization system for online media data; second, we present a novel approach for both discovering important event categories and classifying extracted events based on word representation and clustering model. Experimental results with real dataset show that the proposed framework is effective to extract high quality event information.
基金supported by the Hunan Provincial Natural Science Foundation of China(Grant No.2020JJ4624)the National Social Science Fund of China(Grant No.20&ZD047)+1 种基金the Scientific Research Fund of Hunan Provincial Education Department(Grant No.19A020)the National University of Defense Technology Research Project ZK20-46 and the Young Elite Scientists Sponsorship Program 2021-JCJQ-QT-050.
文摘Event detection(ED)is aimed at detecting event occurrences and categorizing them.This task has been previously solved via recognition and classification of event triggers(ETs),which are defined as the phrase or word most clearly expressing event occurrence.Thus,current approaches require both annotated triggers as well as event types in training data.Nevertheless,triggers are non-essential in ED,and it is time-wasting for annotators to identify the“most clearly”word from a sentence,particularly in longer sentences.To decrease manual effort,we evaluate event detectionwithout triggers.We propose a novel framework that combines Type-aware Attention and Graph Convolutional Networks(TA-GCN)for event detection.Specifically,the task is identified as a multi-label classification problem.We first encode the input sentence using a novel type-aware neural network with attention mechanisms.Then,a Graph Convolutional Networks(GCN)-based multilabel classification model is exploited for event detection.Experimental results demonstrate the effectiveness.
基金supported by the National Natural Science Foundation of China(No.60821001)the National Basic Research Program of China(No.2007CB311203)
文摘Recently, the Internet of Things (loT) has attracted more and more attention. Multimedia sensor network plays an important role in the IoT, and audio event detection in the multimedia sensor net- works is one of the most important applications for the Internet of Things. In practice, it is hard to get enough real-world samples to generate the classifi- ers for some special audio events (e.g., car-crash- ing in the smart traffic system). In this paper, we introduce a TrAdaBoost-based method to solve the above problem. By using the proposed approach, we can train a strong classifier by using only a tiny amount of real-world data and a large number of more easily collected samples (e.g., collected from TV programs), even when the real-world data is not sufficient to train a model alone. We deploy this ap- proach in a smart traffic system to evaluate its per- formance, and the experiment evaluations demonstrate that our method can achieve satisfying results.
基金Supported in part by the National Natural Science Foundation of China (No. 60572045)the Ministry of Education of China Ph.D. Program Foundation (No.20050698033)Cooperation Project (2005.7-2007.6) with Microsoft Research Asia.
文摘Semantic video analysis plays an important role in the field of machine intelligence and pattern recognition. In this paper, based on the Hidden Markov Model (HMM), a semantic recognition framework on compressed videos is proposed to analyze the video events according to six low-level features. After the detailed analysis of video events, the pattern of global motion and five features in foreground—the principal parts of videos, are employed as the observations of the Hidden Markov Model to classify events in videos. The applications of the proposed framework in some video event detections demonstrate the promising success of the proposed framework on semantic video analysis.
基金Funded by the Planning Project of National Language Committee in the "12th 5-year Plan"(No.YB125-49)the Foundation for Key Program of Ministry of Education,China(No.212167)the Fundamental Research Funds for the Central Universities(No.SWJTU12CX096)
文摘How to quickly and accurately detect new topics from massive data online becomes a main problem of public opinion monitoring in cyberspace. This paperpresents a new event detection method for the current new event detection system, based on sorted subtopic matching algorithm and constructs the entire design framework. In this p^per, the subtopics contained in old topics (or news stories) are sorted in descending order according to their importance to the topic(or news stories), and form a sorted subtopic sequence. In the process of subtopic matching, subtopic scoring matrix is used to determine whether a new story is reporting a new event. Experimental results show that the sorted subtopic matching model improved the accuracy and effectiveness ofthenew event detection system in cyberspace.
基金the National Natural Science Foundation of China (No. 60805001)
文摘In this paper,we consider unusual event detection problem in a novel viewpoint and provide an algorithm to solve the problem.The actions or events in the scene is usual or not will eventually be reflected on the changes of some basic features.We summarize these basic event features and propose special representation for each of them.Thus we can model these features in a uniform mode using adaptive Gaussian mixture model.Supervised and unsupervised unusual event detection algorithm can be designed to fit various situations based on this model.The superiority of our model is that it can detect unusual event automatically without to know the determinate model of unusual events.In conclusion,we provide two applications to verify the effectiveness of our model.
文摘Crowd Anomaly Detection has become a challenge in intelligent video surveillance system and security.Intelligent video surveillance systems make extensive use of data mining,machine learning and deep learning methods.In this paper a novel approach is proposed to identify abnormal occurrences in crowded situations using deep learning.In this approach,Adaptive GoogleNet Neural Network Classifier with Multi-Objective Whale Optimization Algorithm are applied to predict the abnormal video frames in the crowded scenes.We use multiple instance learning(MIL)to dynamically develop a deep anomalous ranking framework.This technique predicts higher anomalous values for abnormal video frames by treating regular and irregular video bags and video sections.We use the multi-objective whale optimization algorithm to optimize the entire process and get the best results.The performance parameters such as accuracy,precision,recall,and F-score are considered to evaluate the proposed technique using the Python simulation tool.Our simulation results show that the proposed method performs better than the conventional methods on the public live video dataset.
基金Supported by the National High Technology Research and Development Programme of China(No.2015AA015405)
文摘Social media like Twitter who serves as a novel news medium and has become increasingly popular since its establishment. Large scale first-hand user-generated tweets motivate automatic event detection on Twitter. Previous unsupervised approaches detected events by clustering words. These methods detect events using burstiness,which measures surging frequencies of words at certain time windows. However,event clusters represented by a set of individual words are difficult to understand. This issue is addressed by building a document-level event detection model that directly calculates the burstiness of tweets,leveraging distributed word representations for modeling semantic information,thereby avoiding sparsity. Results show that the document-level model not only offers event summaries that are directly human-readable,but also gives significantly improved accuracies compared to previous methods on unsupervised tweet event detection,which are based on words/segments.
基金Supported by the National Natural Science Foundation of China (No. 61072110)the Industrial Tackling Project of Shaanxi Province (2010K06-20)the Natural Science Foundation of Shaanxi Province (SJ08F15)
文摘Focusing on the problem of goal event detection in soccer videos,a novel method based on Hidden Markov Model(HMM) and the semantic rule is proposed.Firstly,a HMM for a goal event is constructed.Then a Normalized Semantic Weighted Sum(NSWS) rule is established by defining a new feature of shots,semantic observation weight.The test video is detected based on the HMM and the NSWS rule,respectively.Finally,a fusion scheme based on logic distance is proposed and the detection results of the HMM and the NSWS rule are fused by optimal weights in the decision level,obtaining the final result.Experimental results indicate that the proposed method achieves 96.43% precision and 100% recall,which shows the effectiveness of this letter.
文摘Falls are the most common concern among older adults or disabled peo-ple who use scooters and wheelchairs.The early detection of disabled persons’falls is required to increase the living rate of an individual or provide support to them whenever required.In recent times,the arrival of the Internet of Things(IoT),smartphones,Artificial Intelligence(AI),wearables and so on make it easy to design fall detection mechanisms for smart homecare.The current study devel-ops an Automated Disabled People Fall Detection using Cuckoo Search Optimi-zation with Mobile Networks(ADPFD-CSOMN)model.The proposed model’s major aim is to detect and distinguish fall events from non-fall events automati-cally.To attain this,the presented ADPFD-CSOMN technique incorporates the design of the MobileNet model for the feature extraction process.Next,the CSO-based hyperparameter tuning process is executed for the MobileNet model,which shows the paper’s novelty.Finally,the Radial Basis Function(RBF)clas-sification model recognises and classifies the instances as either fall or non-fall.In order to validate the betterment of the proposed ADPFD-CSOMN model,a com-prehensive experimental analysis was conducted.The results confirmed the enhanced fall classification outcomes of the ADPFD-CSOMN model over other approaches with an accuracy of 99.17%.