Today,fatalities,physical injuries,and significant economic losses occur due to car accidents.Among the leading causes of car accidents is drowsiness behind the wheel,which can affect any driver.Drowsiness and sleepin...Today,fatalities,physical injuries,and significant economic losses occur due to car accidents.Among the leading causes of car accidents is drowsiness behind the wheel,which can affect any driver.Drowsiness and sleepiness often have associated indicators that researchers can use to identify and promptly warn drowsy drivers to avoid potential accidents.This paper proposes a spatiotemporal model for monitoring drowsiness visual indicators from videos.This model depends on integrating a 3D convolutional neural network(3D-CNN)and long short-term memory(LSTM).The 3DCNN-LSTM can analyze long sequences by applying the 3D-CNN to extract spatiotemporal features within adjacent frames.The learned features are then used as the input of the LSTM component for modeling high-level temporal features.In addition,we investigate how the training of the proposed model can be affected by changing the position of the batch normalization(BN)layers in the 3D-CNN units.The BN layer is examined in two different placement settings:before the non-linear activation function and after the non-linear activation function.The study was conducted on two publicly available drowsy drivers datasets named 3MDAD and YawDD.3MDAD is mainly composed of two synchronized datasets recorded from the frontal and side views of the drivers.We show that the position of the BN layers increases the convergence speed and reduces overfitting on one dataset but not the other.As a result,the model achieves a test detection accuracy of 96%,93%,and 90%on YawDD,Side-3MDAD,and Front-3MDAD,respectively.展开更多
One of the major causes of road accidents is sleepy drivers.Such accidents typically result in fatalities and financial losses and disadvantage other road users.Numerous studies have been conducted to identify the dri...One of the major causes of road accidents is sleepy drivers.Such accidents typically result in fatalities and financial losses and disadvantage other road users.Numerous studies have been conducted to identify the driver’s sleepiness and integrate it into a warning system.Most studies have examined how the mouth and eyelids move.However,this limits the system’s ability to identify drowsiness traits.Therefore,this study designed an Accident Detection Framework(RPK)that could be used to reduce road accidents due to sleepiness and detect the location of accidents.The drowsiness detectionmodel used three facial parameters:Yawning,closed eyes(blinking),and an upright head position.This model used a Convolutional Neural Network(CNN)consisting of two phases.The initial phase involves video processing and facial landmark coordinate detection.The second phase involves developing the extraction of frame-based features using normalization methods.All these phases used OpenCV and TensorFlow.The dataset contained 5017 images with 874 open eyes images,850 closed eyes images,723 open-mouth images,725 closed-mouth images,761 sleepy-head images,and 1084 non-sleepy head images.The dataset of 5017 images was divided into the training set with 4505 images and the testing set with 512 images,with a ratio of 90:10.The results showed that the RPK design could detect sleepiness by using deep learning techniques with high accuracy on all three parameters;namely 98%for eye blinking,96%for mouth yawning,and 97%for head movement.Overall,the test results have provided an overview of how the developed RPK prototype can accurately identify drowsy drivers.These findings will have a significant impact on the improvement of road users’safety and mobility.展开更多
Purpose-In order to prevent accidents during driving,driver drowsiness detection systems have become a hot topic for researchers.There are various types of features that can be used to detect drowsiness.Detection can ...Purpose-In order to prevent accidents during driving,driver drowsiness detection systems have become a hot topic for researchers.There are various types of features that can be used to detect drowsiness.Detection can be done by utilizing behavioral data,physiological measurements and vehicle-based data.The existing deep convolutional neural network(CNN)models-based ensemble approach analyzed the behavioral data comprises eye or face or head movement captured by using a camera images or videos.However,the developed model suffered from the limitation of high computational cost because of the application of approximately 140million parameters.Design/methodology/approach-The proposed model uses significant feature parameters from the feature extraction process such as ReliefF,Infinite,Correlation,Term Variance are used for feature selection.The features that are selected are undergone for classification using ensemble classifier.Findings-The output of these models is classified into non-drowsiness or drowsiness categories.Research limitations/implications-In this research work higher end camera are required to collect videos as it is cost-effective.Therefore,researches are encouraged to use the existing datasets.Practical implications-This paper overcomes the earlier approach.The developed model used complex deep learning models on small dataset which would also extract additional features,thereby provided a more satisfying result.Originality/value-Drowsiness can be detected at the earliest using ensemble model which restricts the number of accidents.展开更多
Driver distraction is a leading cause of traffic accidents,with fatigue being a significant contributor.This paper introduces a novel method for detecting driver distraction by analyzing facial features using machine ...Driver distraction is a leading cause of traffic accidents,with fatigue being a significant contributor.This paper introduces a novel method for detecting driver distraction by analyzing facial features using machine deep learning and 68 face model.The proposed system assesses driver tiredness by measuring the distance between key facial landmarks,such as the distance between the eyes and the angle of the mouth,to evaluate signs of drowsiness or disengagement.Real-time video feed analysis allows for continuous monitoring of the driver’s face,enabling the system to detect behavioral cues associated with distraction,such as eye closures or changes in facial expressions.The effectiveness of this method is demonstrated through a series of experiments on a dataset of driver videos,which proves that the approach can accurately assess tiredness and distraction levels under various driving conditions.By focusing on facial landmarks,the system is computationally efficient and capable of operating in real-time,making it a practical solution for in-vehicle safety systems.This paper discusses the system’s performance,limitations,and potential for future enhancements,including integration with other in-vehicle technologies to provide comprehensive driver monitoring.展开更多
文摘Today,fatalities,physical injuries,and significant economic losses occur due to car accidents.Among the leading causes of car accidents is drowsiness behind the wheel,which can affect any driver.Drowsiness and sleepiness often have associated indicators that researchers can use to identify and promptly warn drowsy drivers to avoid potential accidents.This paper proposes a spatiotemporal model for monitoring drowsiness visual indicators from videos.This model depends on integrating a 3D convolutional neural network(3D-CNN)and long short-term memory(LSTM).The 3DCNN-LSTM can analyze long sequences by applying the 3D-CNN to extract spatiotemporal features within adjacent frames.The learned features are then used as the input of the LSTM component for modeling high-level temporal features.In addition,we investigate how the training of the proposed model can be affected by changing the position of the batch normalization(BN)layers in the 3D-CNN units.The BN layer is examined in two different placement settings:before the non-linear activation function and after the non-linear activation function.The study was conducted on two publicly available drowsy drivers datasets named 3MDAD and YawDD.3MDAD is mainly composed of two synchronized datasets recorded from the frontal and side views of the drivers.We show that the position of the BN layers increases the convergence speed and reduces overfitting on one dataset but not the other.As a result,the model achieves a test detection accuracy of 96%,93%,and 90%on YawDD,Side-3MDAD,and Front-3MDAD,respectively.
基金The Faculty of Information Science and Technology,Universiti Kebangsaan Malaysia,provided funding for this research through the Research Grant“An Intelligent 4IR Mobile Technology for Express Bus Safety System Scheme DCP-2017-020/2”.
文摘One of the major causes of road accidents is sleepy drivers.Such accidents typically result in fatalities and financial losses and disadvantage other road users.Numerous studies have been conducted to identify the driver’s sleepiness and integrate it into a warning system.Most studies have examined how the mouth and eyelids move.However,this limits the system’s ability to identify drowsiness traits.Therefore,this study designed an Accident Detection Framework(RPK)that could be used to reduce road accidents due to sleepiness and detect the location of accidents.The drowsiness detectionmodel used three facial parameters:Yawning,closed eyes(blinking),and an upright head position.This model used a Convolutional Neural Network(CNN)consisting of two phases.The initial phase involves video processing and facial landmark coordinate detection.The second phase involves developing the extraction of frame-based features using normalization methods.All these phases used OpenCV and TensorFlow.The dataset contained 5017 images with 874 open eyes images,850 closed eyes images,723 open-mouth images,725 closed-mouth images,761 sleepy-head images,and 1084 non-sleepy head images.The dataset of 5017 images was divided into the training set with 4505 images and the testing set with 512 images,with a ratio of 90:10.The results showed that the RPK design could detect sleepiness by using deep learning techniques with high accuracy on all three parameters;namely 98%for eye blinking,96%for mouth yawning,and 97%for head movement.Overall,the test results have provided an overview of how the developed RPK prototype can accurately identify drowsy drivers.These findings will have a significant impact on the improvement of road users’safety and mobility.
文摘Purpose-In order to prevent accidents during driving,driver drowsiness detection systems have become a hot topic for researchers.There are various types of features that can be used to detect drowsiness.Detection can be done by utilizing behavioral data,physiological measurements and vehicle-based data.The existing deep convolutional neural network(CNN)models-based ensemble approach analyzed the behavioral data comprises eye or face or head movement captured by using a camera images or videos.However,the developed model suffered from the limitation of high computational cost because of the application of approximately 140million parameters.Design/methodology/approach-The proposed model uses significant feature parameters from the feature extraction process such as ReliefF,Infinite,Correlation,Term Variance are used for feature selection.The features that are selected are undergone for classification using ensemble classifier.Findings-The output of these models is classified into non-drowsiness or drowsiness categories.Research limitations/implications-In this research work higher end camera are required to collect videos as it is cost-effective.Therefore,researches are encouraged to use the existing datasets.Practical implications-This paper overcomes the earlier approach.The developed model used complex deep learning models on small dataset which would also extract additional features,thereby provided a more satisfying result.Originality/value-Drowsiness can be detected at the earliest using ensemble model which restricts the number of accidents.
文摘Driver distraction is a leading cause of traffic accidents,with fatigue being a significant contributor.This paper introduces a novel method for detecting driver distraction by analyzing facial features using machine deep learning and 68 face model.The proposed system assesses driver tiredness by measuring the distance between key facial landmarks,such as the distance between the eyes and the angle of the mouth,to evaluate signs of drowsiness or disengagement.Real-time video feed analysis allows for continuous monitoring of the driver’s face,enabling the system to detect behavioral cues associated with distraction,such as eye closures or changes in facial expressions.The effectiveness of this method is demonstrated through a series of experiments on a dataset of driver videos,which proves that the approach can accurately assess tiredness and distraction levels under various driving conditions.By focusing on facial landmarks,the system is computationally efficient and capable of operating in real-time,making it a practical solution for in-vehicle safety systems.This paper discusses the system’s performance,limitations,and potential for future enhancements,including integration with other in-vehicle technologies to provide comprehensive driver monitoring.
