Deception detection is regarded as a concern for everyone in their daily lives and affects social interactions.The human face is a rich source of data that offers trustworthy markers of deception.The deception or lie ...Deception detection is regarded as a concern for everyone in their daily lives and affects social interactions.The human face is a rich source of data that offers trustworthy markers of deception.The deception or lie detection systems are non-intrusive,cost-effective,and mobile by identifying facial expressions.Over the last decade,numerous studies have been conducted on deception detection using several advanced techniques.Researchers have focused their attention on inventing more effective and efficient solutions for the detection of deception.So,it could be challenging to spot trends,practical approaches,gaps,and chances for contribution.However,there are still a lot of opportunities for innovative deception detection methods.Therefore,we used a variety of machine learning(ML)and deep learning(DL)approaches to experiment with this work.This research aims to do the following:(i)review and analyze the current lie detection(LD)systems;(ii)create a dataset;(iii)use several ML and DL techniques to identify lying;and(iv)create a hybrid model known as LDNet.By combining layers from Vgg16 and DeneseNet121,LDNet was developed and offered the best accuracy(99.50%)of all the models.Our developed hybrid model is a great addition that significantly advances the study of LD.The findings from this research endeavor are expected to advance our understanding of the effectiveness of ML and DL techniques in LD.Furthermore,it has significant practical applications in diverse domains such as security,law enforcement,border control,organizations,and investigation cases where accurate lie detection is paramount.展开更多
Lie detection test is highly significant task due to its impact on criminology and society.Computerized lie detection test model using electroencephalogram(EEG)signals is studied in literature.In this paper we studied...Lie detection test is highly significant task due to its impact on criminology and society.Computerized lie detection test model using electroencephalogram(EEG)signals is studied in literature.In this paper we studied deep learning framework in lie detection test paradigm.First,we apply a preprocessing technique to utilize only a small fragment of the EEG image instead of the whole image.Our model describes a temporal feature map of the EEG signals measured during the lie detection test.A deep learning attention model(V-TAM)extracts the temporal map vector during the learning process.This technique reduces computational time and lessens the overfitting in Deep Learning architectures.We propose a Cascading attention model with a deep learning convolutional neural network(CNN).V-TAM model extracts local features and global features in separate paths spatial and temporal.Also,to enhance the EEG segmentation precision,a novel Visual-Temporal AttentionModel(V-TAM)is proposed.The accuracy was evaluated using data measured from a sensor from a public dataset of 9512 subjects during fifteen minutes lie detection task.We compared our model with three recent published models.Our proposed model attained the highest performance of(98.5%)with(p<0.01).The visual-temporal model of the proposed platform shows an optimized balance between prediction accuracy and time efficiency.Validation investigationwere performed to prove the correctness and reliability of the proposed method through sizing of the input data,proving its effectiveness in attaining satisfactory performance by using only a smaller size input data.展开更多
Traditional methods,such as polygraphs,suffer from limitations including single-modality vulnerability,cultural bias,and adversarial attacks.This paper presents a novel Multimodal Physiological-Behavioral Fusion Syste...Traditional methods,such as polygraphs,suffer from limitations including single-modality vulnerability,cultural bias,and adversarial attacks.This paper presents a novel Multimodal Physiological-Behavioral Fusion System(MPBFS)that integrates seven modalities:microexpressions,speech,text,eye movements,galvanic skin response(GSR),cultural features,and adversarial defense mechanisms.The system employs a Cultural Dimension-Physiological Signal Cross-Validation Module to dynamically weight modalities,reducing cultural bias.The Cascade Lightweight for Edge Computing achieves 84.6%accuracy(F1=0.87)on cross-cultural datasets with 23 FPS.A Two-Channel Adversarial Defense:Detects DeepFake audio via phase discontinuity analysis and validates microexpressions using Lagrangian biomechanical modeling confirming enhanced cross-cultural robustness.Experiments demonstrate a 31%improvement in Cultural Stability Index and a 42%reduction in adversarial attack success rates,validating the system’s robustness.Designed for forensic interrogation and security screen ing,MPBFS integrates dynamic anonymization and cross-modal validation to ensure ethical AI deployment,addressing key limitations of traditional deception detection methods.展开更多
基金funded by the Ministry of Higher Education(MOHE),Malaysia under the Fundamental Research Grant Project(FRGS/1/2021/SS0/TAYLOR/02/6)。
文摘Deception detection is regarded as a concern for everyone in their daily lives and affects social interactions.The human face is a rich source of data that offers trustworthy markers of deception.The deception or lie detection systems are non-intrusive,cost-effective,and mobile by identifying facial expressions.Over the last decade,numerous studies have been conducted on deception detection using several advanced techniques.Researchers have focused their attention on inventing more effective and efficient solutions for the detection of deception.So,it could be challenging to spot trends,practical approaches,gaps,and chances for contribution.However,there are still a lot of opportunities for innovative deception detection methods.Therefore,we used a variety of machine learning(ML)and deep learning(DL)approaches to experiment with this work.This research aims to do the following:(i)review and analyze the current lie detection(LD)systems;(ii)create a dataset;(iii)use several ML and DL techniques to identify lying;and(iv)create a hybrid model known as LDNet.By combining layers from Vgg16 and DeneseNet121,LDNet was developed and offered the best accuracy(99.50%)of all the models.Our developed hybrid model is a great addition that significantly advances the study of LD.The findings from this research endeavor are expected to advance our understanding of the effectiveness of ML and DL techniques in LD.Furthermore,it has significant practical applications in diverse domains such as security,law enforcement,border control,organizations,and investigation cases where accurate lie detection is paramount.
基金This research was funded by Princess Nourah bint Abdulrahman University Researchers Supporting Project Number(PNURSP2022R113)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.
文摘Lie detection test is highly significant task due to its impact on criminology and society.Computerized lie detection test model using electroencephalogram(EEG)signals is studied in literature.In this paper we studied deep learning framework in lie detection test paradigm.First,we apply a preprocessing technique to utilize only a small fragment of the EEG image instead of the whole image.Our model describes a temporal feature map of the EEG signals measured during the lie detection test.A deep learning attention model(V-TAM)extracts the temporal map vector during the learning process.This technique reduces computational time and lessens the overfitting in Deep Learning architectures.We propose a Cascading attention model with a deep learning convolutional neural network(CNN).V-TAM model extracts local features and global features in separate paths spatial and temporal.Also,to enhance the EEG segmentation precision,a novel Visual-Temporal AttentionModel(V-TAM)is proposed.The accuracy was evaluated using data measured from a sensor from a public dataset of 9512 subjects during fifteen minutes lie detection task.We compared our model with three recent published models.Our proposed model attained the highest performance of(98.5%)with(p<0.01).The visual-temporal model of the proposed platform shows an optimized balance between prediction accuracy and time efficiency.Validation investigationwere performed to prove the correctness and reliability of the proposed method through sizing of the input data,proving its effectiveness in attaining satisfactory performance by using only a smaller size input data.
文摘Traditional methods,such as polygraphs,suffer from limitations including single-modality vulnerability,cultural bias,and adversarial attacks.This paper presents a novel Multimodal Physiological-Behavioral Fusion System(MPBFS)that integrates seven modalities:microexpressions,speech,text,eye movements,galvanic skin response(GSR),cultural features,and adversarial defense mechanisms.The system employs a Cultural Dimension-Physiological Signal Cross-Validation Module to dynamically weight modalities,reducing cultural bias.The Cascade Lightweight for Edge Computing achieves 84.6%accuracy(F1=0.87)on cross-cultural datasets with 23 FPS.A Two-Channel Adversarial Defense:Detects DeepFake audio via phase discontinuity analysis and validates microexpressions using Lagrangian biomechanical modeling confirming enhanced cross-cultural robustness.Experiments demonstrate a 31%improvement in Cultural Stability Index and a 42%reduction in adversarial attack success rates,validating the system’s robustness.Designed for forensic interrogation and security screen ing,MPBFS integrates dynamic anonymization and cross-modal validation to ensure ethical AI deployment,addressing key limitations of traditional deception detection methods.
