Drogue detection is one of the challenging tasks in autonomous aerial refueling due to the requirement for accuracy and rapidity.Saliency detection based on image intrinsic cues can achieve fast detection,but with poo...Drogue detection is one of the challenging tasks in autonomous aerial refueling due to the requirement for accuracy and rapidity.Saliency detection based on image intrinsic cues can achieve fast detection,but with poor accuracy.Recent studies reveal that optimization-based methods provide accurate and quick solutions for saliency detection.This paper presents a hybrid pigeon-inspired optimization method,the optimized color opponent,that aims to adjust the weight of color opponent channels to detect the drogue region.It can optimize the weights in the selected aerial refueling scene offline,and the results are applied for drogue detection in the scene.A novel algorithm aggregated by the optimized color opponent and robust background detection is presented to provide better precision and robustness.Experimental results on benchmark datasets and aerial refueling images show that the proposed method successfully extracts the saliency region or drogue and exhibits superior performance against the other saliency detection methods with intrinsic cues.The algorithm designed in this paper is competent for the drogue detection task of autonomous aerial refueling.展开更多
Multimodal lung tumor medical images can provide anatomical and functional information for the same lesion.Such as Positron Emission Computed Tomography(PET),Computed Tomography(CT),and PET-CT.How to utilize the lesio...Multimodal lung tumor medical images can provide anatomical and functional information for the same lesion.Such as Positron Emission Computed Tomography(PET),Computed Tomography(CT),and PET-CT.How to utilize the lesion anatomical and functional information effectively and improve the network segmentation performance are key questions.To solve the problem,the Saliency Feature-Guided Interactive Feature Enhancement Lung Tumor Segmentation Network(Guide-YNet)is proposed in this paper.Firstly,a double-encoder single-decoder U-Net is used as the backbone in this model,a single-coder single-decoder U-Net is used to generate the saliency guided feature using PET image and transmit it into the skip connection of the backbone,and the high sensitivity of PET images to tumors is used to guide the network to accurately locate lesions.Secondly,a Cross Scale Feature Enhancement Module(CSFEM)is designed to extract multi-scale fusion features after downsampling.Thirdly,a Cross-Layer Interactive Feature Enhancement Module(CIFEM)is designed in the encoder to enhance the spatial position information and semantic information.Finally,a Cross-Dimension Cross-Layer Feature Enhancement Module(CCFEM)is proposed in the decoder,which effectively extractsmultimodal image features through global attention and multi-dimension local attention.The proposed method is verified on the lung multimodal medical image datasets,and the results showthat theMean Intersection overUnion(MIoU),Accuracy(Acc),Dice Similarity Coefficient(Dice),Volumetric overlap error(Voe),Relative volume difference(Rvd)of the proposed method on lung lesion segmentation are 87.27%,93.08%,97.77%,95.92%,89.28%,and 88.68%,respectively.It is of great significance for computer-aided diagnosis.展开更多
In this paper, the problem of moving object detection in aerial video is addressed. While motion cues have been extensively exploited in the literature, how to use spatial information is still an open problem. To deal...In this paper, the problem of moving object detection in aerial video is addressed. While motion cues have been extensively exploited in the literature, how to use spatial information is still an open problem. To deal with this issue, we propose a novel hierarchical moving target detection method based on spatiotemporal saliency. Temporal saliency is used to get a coarse segmentation, and spatial saliency is extracted to obtain the object＇s appearance details in candidate motion regions. Finally, by combining temporal and spatial saliency information, we can get refined detection results. Additionally, in order to give a full description of the object distribution, spatial saliency is detected in both pixel and region levels based on local contrast. Experiments conducted on the VIVID dataset show that the proposed method is efficient and accurate.展开更多
Visual attention is a mechanism that enables the visual system to detect potentially important objects in complex environment.Most computational visual attention models are designed with inspirations from mammalian vi...Visual attention is a mechanism that enables the visual system to detect potentially important objects in complex environment.Most computational visual attention models are designed with inspirations from mammalian visual systems.However,electrophysiological and behavioral evidences indicate that avian species are animals with high visual capability that can process complex information accurately in real time.Therefore,the visual system of the avian species,especially the nuclei related to the visual attention mechanism,are investigated in this paper.Afterwards,a hierarchical visual attention model is proposed for saliency detection.The optic tectum neuron responses are computed and the self-information is used to compute primary saliency maps in the first hierarchy.The"winner-takeall"network in the tecto-isthmal projection is simulated and final saliency maps are estimated with the regularized random walks ranking in the second hierarchy.Comparison results verify that the proposed model,which can define the focus of attention accurately,outperforms several state-of-the-art models.This study provides insights into the relationship between the visual attention mechanism and the avian visual pathways.The computational visual attention model may reveal the underlying neural mechanism of the nuclei for biological visual attention.展开更多
The detection range of underwater laser imaging technology achieves 4—6 times of detection range of conventional camera in intervening water medium, which makes it very promising in oceanic research, deep sea explora...The detection range of underwater laser imaging technology achieves 4—6 times of detection range of conventional camera in intervening water medium, which makes it very promising in oceanic research, deep sea exploration and robotic works. However, the special features in underwater laser images, such as speckle noise and non-uniform illumination, bring great difficulty for image segmentation. In this paper, a novel saliency motivated pulse coupled neural network(SM-PCNN) is proposed for underwater laser image segmentation. The pixel saliency is used as external stimulus of neurons. For improvement of convergence speed to optimal segmentation, a gradient descent method based on maximum two-dimensional Renyi entropy criterion is utilized to determine the dynamic threshold. On the basis of region contrast in each iteration step, the real object regions are effectively distinguished,and the robustness against speckle noise and non-uniform illumination is improved by region selection. The proposed method is compared with four other state-of-the-art methods which are watershed, fuzzy C-means, meanshift and normalized cut methods. Experimental results demonstrate the superiority of our proposed method to allow more accurate segmentation and higher robustness.展开更多
Most image saliency detection models are dependent on prior knowledge and demand high computational cost. However, spectral residual（SR） and phase spectrum of the Fourier transform（PFT） models are simple and fast ...Most image saliency detection models are dependent on prior knowledge and demand high computational cost. However, spectral residual（SR） and phase spectrum of the Fourier transform（PFT） models are simple and fast saliency detection approaches based on two-dimensional Fourier transform without the prior knowledge. For seismic data, the geological structure of the underground rock formation changes more obviously in the time direction. Therefore, one-dimensional Fourier transform is more suitable for seismic saliency detection. Fractional Fourier transform（FrFT） is an improved algorithm for Fourier transform, therefore we propose the seismic SR and PFT models in one-dimensional FrF T domain to obtain more detailed saliency maps. These two models use the amplitude and phase information in FrFT domain to construct the corresponding saliency maps in spatial domain. By means of these two models, several saliency maps at different fractional orders can be obtained for seismic attribute analysis. These saliency maps can characterize the detailed features and highlight the object areas, which is more conducive to determine the location of reservoirs. The performance of the proposed method is assessed on both simulated and real seismic data. The results indicate that our method is effective and convenient for seismic attribute extraction with good noise immunity.展开更多
Craters are salient terrain features on planetary surfaces, and provide useful information about the relative dating of geological unit of planets. In addition, they are ideal landmarks for spacecraft navigation. Due ...Craters are salient terrain features on planetary surfaces, and provide useful information about the relative dating of geological unit of planets. In addition, they are ideal landmarks for spacecraft navigation. Due to low contrast and uneven illumination, automatic extraction of craters remains a challenging task. This paper presents a saliency detection method for crater edges and a feature matching algorithm based on edges informa- tion. The craters are extracted through saliency edges detection, edge extraction and selection, feature matching of the same crater edges and robust ellipse fitting. In the edges matching algorithm, a crater feature model is proposed by analyzing the relationship between highlight region edges and shadow region ones. Then, crater edges are paired through the effective matching algorithm. Experiments of real planetary images show that the proposed approach is robust to different lights and topographies, and the detection rate is larger than 90%.展开更多
Reliable saliency detection can be used to quickly and effectively locate objects in images. In this paper, a novel algorithm for saliency detection based on superpixels clustering and stereo disparity （SDC） is prop...Reliable saliency detection can be used to quickly and effectively locate objects in images. In this paper, a novel algorithm for saliency detection based on superpixels clustering and stereo disparity （SDC） is proposed. Firstly, we use an improved superpixels clustering method to decompose the given image. Then, the disparity of each superpixel is computed by a modified stereo correspondence algorithm. Finally, a new measure which combines stereo disparity with color contrast and spatial coherence is defined to evaluate the saliency of each superpixel. From the experiments we can see that regions with high disparity can get higher saliency value, and the saliency maps have the same resolution with the source images, objects in the map have clear boundaries. Due to the use of superpixel and stereo disparity information, the proposed method is computationally efficient and outperforms some state-of-the-art color- based saliency detection methods.展开更多
In this paper, a fast and accurate work-piece detection and measurement algorithm is proposed based on top-down feature extraction and bottom-up saliency estimation. Firstly, a top-down feature extraction method based...In this paper, a fast and accurate work-piece detection and measurement algorithm is proposed based on top-down feature extraction and bottom-up saliency estimation. Firstly, a top-down feature extraction method based on the prior knowledge of work- pieces is presented, in which the contour of a work-piece is chosen as the major feature and the corresponding template of the edges is created. Secondly, a bottom-up salient region estimation algorithm is proposed, where the image boundaries are labelled as background queries, and the salient region can be detected by computing contrast against image boundary. Finally, the calibration method for vision system with telecentric lens is discussed, and the dimensions of the work-pieces are measured. In addition, strategies such as image pyramids and a stopping criterion are adopted to speed-up the algorithm. An automatic system embedded with the proposed detection and measurement algorithm combining top-down and bottom-up saliency （DM-TBS） is designed to pick out defective work-pieces without any manual auxiliary. Experiments and results demonstrate the effectiveness of the proposed method.展开更多
To evaluate the quality of blurred images effectively,this study proposes a no-reference blur assessment method based on gradient distortion measurement and salient region maps.First,a Gaussian low-pass filter is used...To evaluate the quality of blurred images effectively,this study proposes a no-reference blur assessment method based on gradient distortion measurement and salient region maps.First,a Gaussian low-pass filter is used to construct a reference image by blurring a given image.Gradient similarity is included to obtain the gradient distortion measurement map,which can finely reflect the smallest possible changes in textures and details.Second,a saliency model is utilized to calculate image saliency.Specifically,an adaptive method is used to calculate the specific salient threshold of the blurred image,and the blurred image is binarized to yield the salient region map.Block-wise visual saliency serves as the weight to obtain the final image quality.Experimental results based on the image and video engineering database,categorial image quality database,and camera image database demonstrate that the proposed method correlates well with human judgment.Its computational complexity is also relatively low.展开更多
Based on salient visual regions for mobile robot navigation in unknown environments, a new place recognition system was presented. The system uses monocular camera to acquire omni-directional images of the environment...Based on salient visual regions for mobile robot navigation in unknown environments, a new place recognition system was presented. The system uses monocular camera to acquire omni-directional images of the environment where the robot locates. Salient local regions are detected from these images using center-surround difference method, which computes opponencies of color and texture among multi-scale image spaces. And then they are organized using hidden Markov model (HMM) to form the vertex of topological map. So localization, that is place recognition in our system, can be converted to evaluation of HMM. Experimental results show that the saliency detection is immune to the changes of scale, 2D rotation and viewpoint etc. The created topological map has smaller size and a higher ratio of recognition is obtained.展开更多
Pests detecting is an important research subject in grain storage field.In the past decades,many edge detection methods have been applied to the edge detection of stored grain pests.Although some of them can realize t...Pests detecting is an important research subject in grain storage field.In the past decades,many edge detection methods have been applied to the edge detection of stored grain pests.Although some of them can realize the stored grain pests detecting,precision and robustness are not good enough.Spectral residual(SR)saliency edge detection defines the logarithmic spectrumof image as novelty part of the image information.The remaining spectrumis converted to the airspace to obtain edge detection results.SR algorithm is completely based on frequency domain processing.It not only can effectively simplify the target detection algorithm,but also can improve the effectiveness of target recognition.The experimental results show that the edge results of stored grain pests detected by SR method are effective and stable.展开更多
Traditional vehicle detection algorithms use traverse search based vehicle candidate generation and hand crafted based classifier training for vehicle candidate verification.These types of methods generally have high ...Traditional vehicle detection algorithms use traverse search based vehicle candidate generation and hand crafted based classifier training for vehicle candidate verification.These types of methods generally have high processing times and low vehicle detection performance.To address this issue,a visual saliency and deep sparse convolution hierarchical model based vehicle detection algorithm is proposed.A visual saliency calculation is firstly used to generate a small vehicle candidate area.The vehicle candidate sub images are then loaded into a sparse deep convolution hierarchical model with an SVM-based classifier to perform the final detection.The experimental results demonstrate that the proposed method is with 94.81% correct rate and 0.78% false detection rate on the existing datasets and the real road pictures captured by our group,which outperforms the existing state-of-the-art algorithms.More importantly,high discriminative multi-scale features are generated by deep sparse convolution network which has broad application prospects in target recognition in the field of intelligent vehicle.展开更多
A new method for automatic salient object segmentation is presented.Salient object segmentation is an important research area in the field of object recognition,image retrieval,image editing,scene reconstruction,and 2...A new method for automatic salient object segmentation is presented.Salient object segmentation is an important research area in the field of object recognition,image retrieval,image editing,scene reconstruction,and 2D/3D conversion.In this work,salient object segmentation is performed using saliency map and color segmentation.Edge,color and intensity feature are extracted from mean shift segmentation(MSS)image,and saliency map is created using these features.First average saliency per segment image is calculated using the color information from MSS image and generated saliency map.Then,second average saliency per segment image is calculated by applying same procedure for the first image to the thresholding,labeling,and hole-filling applied image.Thresholding,labeling and hole-filling are applied to the mean image of the generated two images to get the final salient object segmentation.The effectiveness of proposed method is proved by showing 80%,89%and 80%of precision,recall and F-measure values from the generated salient object segmentation image and ground truth image.展开更多
The graph-based manifold ranking saliency detection only relies on the boundary background to extract foreground seeds,resulting in a poor saliency detection result,so a method that obtains robust foreground for manif...The graph-based manifold ranking saliency detection only relies on the boundary background to extract foreground seeds,resulting in a poor saliency detection result,so a method that obtains robust foreground for manifold ranking is proposed in this paper.First,boundary connectivity is used to select the boundary background for manifold ranking to get a preliminary saliency map,and a foreground region is acquired by a binary segmentation of the map.Second,the feature points of the original image and the filtered image are obtained by using color boosting Harris corners to generate two different convex hulls.Calculating the intersection of these two convex hulls,a final convex hull is found.Finally,the foreground region and the final convex hull are combined to extract robust foreground seeds for manifold ranking and getting final saliency map.Experimental results on two public image datasets show that the proposed method gains improved performance compared with some other classic methods in three evaluation indicators:precision-recall curve,F-measure and mean absolute error.展开更多
This paper concerns the problem of object segmentation in real-time for picking system. A region proposal method inspired by human glance based on the convolutional neural network is proposed to select promising regio...This paper concerns the problem of object segmentation in real-time for picking system. A region proposal method inspired by human glance based on the convolutional neural network is proposed to select promising regions, allowing more processing is reserved only for these regions. The speed of object segmentation is significantly improved by the region proposal method.By the combination of the region proposal method based on the convolutional neural network and superpixel method, the category and location information can be used to segment objects and image redundancy is significantly reduced. The processing time is reduced considerably by this to achieve the real time. Experiments show that the proposed method can segment the interested target object in real time on an ordinary laptop.展开更多
In order to further improve the efficiency of video compression, we introduce a perceptual characteristics of Human Visual System (HVS) to video coding, and propose a novel video coding rate control algorithm based on...In order to further improve the efficiency of video compression, we introduce a perceptual characteristics of Human Visual System (HVS) to video coding, and propose a novel video coding rate control algorithm based on human visual saliency model in H.264/AVC. Firstly, we modifie Itti's saliency model. Secondly, target bits of each frame are allocated through the correlation of saliency region between the current and previous frame, and the complexity of each MB is modified through the saliency value and its Mean Absolute Difference (MAD) value. Lastly, the algorithm was implemented in JVT JM12.2. Simulation results show that, comparing with traditional rate control algorithm, the proposed one can reduce the coding bit rate and improve the reconstructed video subjective quality, especially for visual saliency region. It is very suitable for wireless video transmission.展开更多
In order to better represent infrared target features under different environments, a saliency detection method based on region covariance and global feature is proposed. Firstly, the region covariance features on dif...In order to better represent infrared target features under different environments, a saliency detection method based on region covariance and global feature is proposed. Firstly, the region covariance features on different scale spaces and different image regions are extracted and transformed into sigma features,then combined with central position feature, the local salient map is generated. Next, a global salient map is generated by gray contrast and density estimation. Finally, the saliency detection result of infrared images is obtained by fusing the local and global salient maps. The experimental results show that the salient map of the proposed method has complete target features and obvious edges,and the proposed method is better than the state of art method both qualitatively and quantitatively.展开更多
Melanoma,due to its higher mortality rate,is considered as one of the most pernicious types of skin cancers,mostly affecting the white populations.It has been reported a number of times and is now widely accepted,that...Melanoma,due to its higher mortality rate,is considered as one of the most pernicious types of skin cancers,mostly affecting the white populations.It has been reported a number of times and is now widely accepted,that early detection of melanoma increases the chances of the subject’s survival.Computer-aided diagnostic systems help the experts in diagnosing the skin lesion at earlier stages using machine learning techniques.In thiswork,we propose a framework that accurately segments,and later classifies,the lesion using improved image segmentation and fusion methods.The proposed technique takes an image and passes it through two methods simultaneously;one is the weighted visual saliency-based method,and the second is improved HDCT based saliency estimation.The resultant image maps are later fused using the proposed image fusion technique to generate a localized lesion region.The resultant binary image is later mapped back to the RGB image and fed into the Inception-ResNet-V2 pre-trained model-trained by applying transfer learning.The simulation results show improved performance compared to several existing methods.展开更多
Visual saliency is an important cue in human visual system to identify salient region in the image;it can be useful in many applications including image retrieval,object recognition,image segmentation,etc.Image contra...Visual saliency is an important cue in human visual system to identify salient region in the image;it can be useful in many applications including image retrieval,object recognition,image segmentation,etc.Image contrast has been used as an effective feature to detect visual salient region.However,the conventional contrast measures either in spectral domain or in spatial domain fail to give sufficient consideration towards the local and global characteristics of the image.This paper presents a visual saliency detection algorithm based on a novel contrast measurement.This measurement extracts the spectral information of image block using the 2D discrete Fourier transform(DFT),and combines with the total variation(TV)of image block in spatial domain.The proposed algorithm is used to perform salient region detection in the image,and compared with state-of-the-art algorithms.The experimental results from the MSRA dataset validate the effectiveness of the proposed algorithm.展开更多
基金This work was partially supported by Science and Technology Innovation 2030-Key Project of“New Generation Artificial Intelligence”,China(No.2018AAA0102403)the National Natural Science Foundation of China(Nos.U1913602,T2121003,91948204,62103040,and U20B2071)the Open Fund/Postdoctoral Fund of the Laboratory of Cognition and Decision Intelligence for Complex Systems,Institute of Automation,Chinese Academy of Sciences(No.CASIA-KFKT-08).
文摘Drogue detection is one of the challenging tasks in autonomous aerial refueling due to the requirement for accuracy and rapidity.Saliency detection based on image intrinsic cues can achieve fast detection,but with poor accuracy.Recent studies reveal that optimization-based methods provide accurate and quick solutions for saliency detection.This paper presents a hybrid pigeon-inspired optimization method,the optimized color opponent,that aims to adjust the weight of color opponent channels to detect the drogue region.It can optimize the weights in the selected aerial refueling scene offline,and the results are applied for drogue detection in the scene.A novel algorithm aggregated by the optimized color opponent and robust background detection is presented to provide better precision and robustness.Experimental results on benchmark datasets and aerial refueling images show that the proposed method successfully extracts the saliency region or drogue and exhibits superior performance against the other saliency detection methods with intrinsic cues.The algorithm designed in this paper is competent for the drogue detection task of autonomous aerial refueling.
基金supported in part by the National Natural Science Foundation of China(Grant No.62062003)Natural Science Foundation of Ningxia(Grant No.2023AAC03293).
文摘Multimodal lung tumor medical images can provide anatomical and functional information for the same lesion.Such as Positron Emission Computed Tomography(PET),Computed Tomography(CT),and PET-CT.How to utilize the lesion anatomical and functional information effectively and improve the network segmentation performance are key questions.To solve the problem,the Saliency Feature-Guided Interactive Feature Enhancement Lung Tumor Segmentation Network(Guide-YNet)is proposed in this paper.Firstly,a double-encoder single-decoder U-Net is used as the backbone in this model,a single-coder single-decoder U-Net is used to generate the saliency guided feature using PET image and transmit it into the skip connection of the backbone,and the high sensitivity of PET images to tumors is used to guide the network to accurately locate lesions.Secondly,a Cross Scale Feature Enhancement Module(CSFEM)is designed to extract multi-scale fusion features after downsampling.Thirdly,a Cross-Layer Interactive Feature Enhancement Module(CIFEM)is designed in the encoder to enhance the spatial position information and semantic information.Finally,a Cross-Dimension Cross-Layer Feature Enhancement Module(CCFEM)is proposed in the decoder,which effectively extractsmultimodal image features through global attention and multi-dimension local attention.The proposed method is verified on the lung multimodal medical image datasets,and the results showthat theMean Intersection overUnion(MIoU),Accuracy(Acc),Dice Similarity Coefficient(Dice),Volumetric overlap error(Voe),Relative volume difference(Rvd)of the proposed method on lung lesion segmentation are 87.27%,93.08%,97.77%,95.92%,89.28%,and 88.68%,respectively.It is of great significance for computer-aided diagnosis.
基金co-supported by the National Natural Science Foundation of China (Nos.61005028,61175032,and 61101222)
文摘In this paper, the problem of moving object detection in aerial video is addressed. While motion cues have been extensively exploited in the literature, how to use spatial information is still an open problem. To deal with this issue, we propose a novel hierarchical moving target detection method based on spatiotemporal saliency. Temporal saliency is used to get a coarse segmentation, and spatial saliency is extracted to obtain the object＇s appearance details in candidate motion regions. Finally, by combining temporal and spatial saliency information, we can get refined detection results. Additionally, in order to give a full description of the object distribution, spatial saliency is detected in both pixel and region levels based on local contrast. Experiments conducted on the VIVID dataset show that the proposed method is efficient and accurate.
基金supported by Natural Science Foundation of China(61425008,61333004,61273054)
文摘Visual attention is a mechanism that enables the visual system to detect potentially important objects in complex environment.Most computational visual attention models are designed with inspirations from mammalian visual systems.However,electrophysiological and behavioral evidences indicate that avian species are animals with high visual capability that can process complex information accurately in real time.Therefore,the visual system of the avian species,especially the nuclei related to the visual attention mechanism,are investigated in this paper.Afterwards,a hierarchical visual attention model is proposed for saliency detection.The optic tectum neuron responses are computed and the self-information is used to compute primary saliency maps in the first hierarchy.The"winner-takeall"network in the tecto-isthmal projection is simulated and final saliency maps are estimated with the regularized random walks ranking in the second hierarchy.Comparison results verify that the proposed model,which can define the focus of attention accurately,outperforms several state-of-the-art models.This study provides insights into the relationship between the visual attention mechanism and the avian visual pathways.The computational visual attention model may reveal the underlying neural mechanism of the nuclei for biological visual attention.
基金the National High Technology Research and Development Program(863)of China(No.2011AA09A106)the National Natural Science Foundation of China(No.51009040)and the Fundamental Research Funds for Central Universities of China(No.HEUCF140113)
文摘The detection range of underwater laser imaging technology achieves 4—6 times of detection range of conventional camera in intervening water medium, which makes it very promising in oceanic research, deep sea exploration and robotic works. However, the special features in underwater laser images, such as speckle noise and non-uniform illumination, bring great difficulty for image segmentation. In this paper, a novel saliency motivated pulse coupled neural network(SM-PCNN) is proposed for underwater laser image segmentation. The pixel saliency is used as external stimulus of neurons. For improvement of convergence speed to optimal segmentation, a gradient descent method based on maximum two-dimensional Renyi entropy criterion is utilized to determine the dynamic threshold. On the basis of region contrast in each iteration step, the real object regions are effectively distinguished,and the robustness against speckle noise and non-uniform illumination is improved by region selection. The proposed method is compared with four other state-of-the-art methods which are watershed, fuzzy C-means, meanshift and normalized cut methods. Experimental results demonstrate the superiority of our proposed method to allow more accurate segmentation and higher robustness.
基金supported by the National Natural Science Foundation of China (Nos.61571096,61775030,41274127,41301460,and 40874066)
文摘Most image saliency detection models are dependent on prior knowledge and demand high computational cost. However, spectral residual（SR） and phase spectrum of the Fourier transform（PFT） models are simple and fast saliency detection approaches based on two-dimensional Fourier transform without the prior knowledge. For seismic data, the geological structure of the underground rock formation changes more obviously in the time direction. Therefore, one-dimensional Fourier transform is more suitable for seismic saliency detection. Fractional Fourier transform（FrFT） is an improved algorithm for Fourier transform, therefore we propose the seismic SR and PFT models in one-dimensional FrF T domain to obtain more detailed saliency maps. These two models use the amplitude and phase information in FrFT domain to construct the corresponding saliency maps in spatial domain. By means of these two models, several saliency maps at different fractional orders can be obtained for seismic attribute analysis. These saliency maps can characterize the detailed features and highlight the object areas, which is more conducive to determine the location of reservoirs. The performance of the proposed method is assessed on both simulated and real seismic data. The results indicate that our method is effective and convenient for seismic attribute extraction with good noise immunity.
基金supported by the National Natural Science Foundation of China(61210012)
文摘Craters are salient terrain features on planetary surfaces, and provide useful information about the relative dating of geological unit of planets. In addition, they are ideal landmarks for spacecraft navigation. Due to low contrast and uneven illumination, automatic extraction of craters remains a challenging task. This paper presents a saliency detection method for crater edges and a feature matching algorithm based on edges informa- tion. The craters are extracted through saliency edges detection, edge extraction and selection, feature matching of the same crater edges and robust ellipse fitting. In the edges matching algorithm, a crater feature model is proposed by analyzing the relationship between highlight region edges and shadow region ones. Then, crater edges are paired through the effective matching algorithm. Experiments of real planetary images show that the proposed approach is robust to different lights and topographies, and the detection rate is larger than 90%.
基金supported by NSFC Joint Fund with Guangdong under Key Project(U1201258)National Natural Science foundation of China(61402261+3 种基金6130308861572286)the scientific research foundation of Shandong Province of Outstanding Young Scientist Award(BS2013DX048)Shandong Ji’nan Science and Technology Development Project(201202015)
文摘Reliable saliency detection can be used to quickly and effectively locate objects in images. In this paper, a novel algorithm for saliency detection based on superpixels clustering and stereo disparity （SDC） is proposed. Firstly, we use an improved superpixels clustering method to decompose the given image. Then, the disparity of each superpixel is computed by a modified stereo correspondence algorithm. Finally, a new measure which combines stereo disparity with color contrast and spatial coherence is defined to evaluate the saliency of each superpixel. From the experiments we can see that regions with high disparity can get higher saliency value, and the saliency maps have the same resolution with the source images, objects in the map have clear boundaries. Due to the use of superpixel and stereo disparity information, the proposed method is computationally efficient and outperforms some state-of-the-art color- based saliency detection methods.
基金supported by National Natural Science Foundation of China(Nos.61379097,91748131,61771471,U1613213 and 61627808)National Key Research and Development Plan of China(No.2017YFB1300202)Youth Innovation Promotion Association Chinese Academy of Sciences(CAS)(No.2015112)
文摘In this paper, a fast and accurate work-piece detection and measurement algorithm is proposed based on top-down feature extraction and bottom-up saliency estimation. Firstly, a top-down feature extraction method based on the prior knowledge of work- pieces is presented, in which the contour of a work-piece is chosen as the major feature and the corresponding template of the edges is created. Secondly, a bottom-up salient region estimation algorithm is proposed, where the image boundaries are labelled as background queries, and the salient region can be detected by computing contrast against image boundary. Finally, the calibration method for vision system with telecentric lens is discussed, and the dimensions of the work-pieces are measured. In addition, strategies such as image pyramids and a stopping criterion are adopted to speed-up the algorithm. An automatic system embedded with the proposed detection and measurement algorithm combining top-down and bottom-up saliency （DM-TBS） is designed to pick out defective work-pieces without any manual auxiliary. Experiments and results demonstrate the effectiveness of the proposed method.
基金The National Natural Science Foundation of China(No.61762004,61762005)the National Key Research and Development Program(No.2018YFB1702700)+1 种基金the Science and Technology Project Founded by the Education Department of Jiangxi Province,China(No.GJJ200702,GJJ200746)the Open Fund Project of Jiangxi Engineering Laboratory on Radioactive Geoscience and Big Data Technology(No.JETRCNGDSS201901,JELRGBDT202001,JELRGBDT202003).
文摘To evaluate the quality of blurred images effectively,this study proposes a no-reference blur assessment method based on gradient distortion measurement and salient region maps.First,a Gaussian low-pass filter is used to construct a reference image by blurring a given image.Gradient similarity is included to obtain the gradient distortion measurement map,which can finely reflect the smallest possible changes in textures and details.Second,a saliency model is utilized to calculate image saliency.Specifically,an adaptive method is used to calculate the specific salient threshold of the blurred image,and the blurred image is binarized to yield the salient region map.Block-wise visual saliency serves as the weight to obtain the final image quality.Experimental results based on the image and video engineering database,categorial image quality database,and camera image database demonstrate that the proposed method correlates well with human judgment.Its computational complexity is also relatively low.
基金Projects(60234030 ,60404021) supported by the National Natural Science Foundation of China
文摘Based on salient visual regions for mobile robot navigation in unknown environments, a new place recognition system was presented. The system uses monocular camera to acquire omni-directional images of the environment where the robot locates. Salient local regions are detected from these images using center-surround difference method, which computes opponencies of color and texture among multi-scale image spaces. And then they are organized using hidden Markov model (HMM) to form the vertex of topological map. So localization, that is place recognition in our system, can be converted to evaluation of HMM. Experimental results show that the saliency detection is immune to the changes of scale, 2D rotation and viewpoint etc. The created topological map has smaller size and a higher ratio of recognition is obtained.
基金financially supported by National Natural Science Foundation of China(No.61871176)Key Scientific and Technological Project of Science and Technology Department of Henan Province(No.172102210030,182102110099)+2 种基金Key Scientific Research Project Program of Universities of Henan Province(No.18B520025)Open Fund of Key Laboratory of Grain Information Processing and Control(No.KFJJ-2018-102)supported by Collaborative Innovation Center of Grain Storage and Security of Henan Province
文摘Pests detecting is an important research subject in grain storage field.In the past decades,many edge detection methods have been applied to the edge detection of stored grain pests.Although some of them can realize the stored grain pests detecting,precision and robustness are not good enough.Spectral residual(SR)saliency edge detection defines the logarithmic spectrumof image as novelty part of the image information.The remaining spectrumis converted to the airspace to obtain edge detection results.SR algorithm is completely based on frequency domain processing.It not only can effectively simplify the target detection algorithm,but also can improve the effectiveness of target recognition.The experimental results show that the edge results of stored grain pests detected by SR method are effective and stable.
基金Supported by National Natural Science Foundation of China(Grant Nos.U1564201,61573171,61403172,51305167)China Postdoctoral Science Foundation(Grant Nos.2015T80511,2014M561592)+3 种基金Jiangsu Provincial Natural Science Foundation of China(Grant No.BK20140555)Six Talent Peaks Project of Jiangsu Province,China(Grant Nos.2015-JXQC-012,2014-DZXX-040)Jiangsu Postdoctoral Science Foundation,China(Grant No.1402097C)Jiangsu University Scientific Research Foundation for Senior Professionals,China(Grant No.14JDG028)
文摘Traditional vehicle detection algorithms use traverse search based vehicle candidate generation and hand crafted based classifier training for vehicle candidate verification.These types of methods generally have high processing times and low vehicle detection performance.To address this issue,a visual saliency and deep sparse convolution hierarchical model based vehicle detection algorithm is proposed.A visual saliency calculation is firstly used to generate a small vehicle candidate area.The vehicle candidate sub images are then loaded into a sparse deep convolution hierarchical model with an SVM-based classifier to perform the final detection.The experimental results demonstrate that the proposed method is with 94.81% correct rate and 0.78% false detection rate on the existing datasets and the real road pictures captured by our group,which outperforms the existing state-of-the-art algorithms.More importantly,high discriminative multi-scale features are generated by deep sparse convolution network which has broad application prospects in target recognition in the field of intelligent vehicle.
文摘A new method for automatic salient object segmentation is presented.Salient object segmentation is an important research area in the field of object recognition,image retrieval,image editing,scene reconstruction,and 2D/3D conversion.In this work,salient object segmentation is performed using saliency map and color segmentation.Edge,color and intensity feature are extracted from mean shift segmentation(MSS)image,and saliency map is created using these features.First average saliency per segment image is calculated using the color information from MSS image and generated saliency map.Then,second average saliency per segment image is calculated by applying same procedure for the first image to the thresholding,labeling,and hole-filling applied image.Thresholding,labeling and hole-filling are applied to the mean image of the generated two images to get the final salient object segmentation.The effectiveness of proposed method is proved by showing 80%,89%and 80%of precision,recall and F-measure values from the generated salient object segmentation image and ground truth image.
文摘The graph-based manifold ranking saliency detection only relies on the boundary background to extract foreground seeds,resulting in a poor saliency detection result,so a method that obtains robust foreground for manifold ranking is proposed in this paper.First,boundary connectivity is used to select the boundary background for manifold ranking to get a preliminary saliency map,and a foreground region is acquired by a binary segmentation of the map.Second,the feature points of the original image and the filtered image are obtained by using color boosting Harris corners to generate two different convex hulls.Calculating the intersection of these two convex hulls,a final convex hull is found.Finally,the foreground region and the final convex hull are combined to extract robust foreground seeds for manifold ranking and getting final saliency map.Experimental results on two public image datasets show that the proposed method gains improved performance compared with some other classic methods in three evaluation indicators:precision-recall curve,F-measure and mean absolute error.
基金supported by the National Natural Science Foundation of China(61233010 61305106)+2 种基金the Shanghai Natural Science Foundation(17ZR1409700 18ZR1415300)the basic research project of Shanghai Municipal Science and Technology Commission(16JC1400900)
文摘This paper concerns the problem of object segmentation in real-time for picking system. A region proposal method inspired by human glance based on the convolutional neural network is proposed to select promising regions, allowing more processing is reserved only for these regions. The speed of object segmentation is significantly improved by the region proposal method.By the combination of the region proposal method based on the convolutional neural network and superpixel method, the category and location information can be used to segment objects and image redundancy is significantly reduced. The processing time is reduced considerably by this to achieve the real time. Experiments show that the proposed method can segment the interested target object in real time on an ordinary laptop.
基金supported by National Natural Science Foundation of China under Grant No.610700800973 Sub-Program Projects under Grant No.2009CB320906+3 种基金National Science and Technology of Major Special Projects under Grant No.2010ZX03004-003S&T Planning Project of Hubei Provincial Department of Education under Grant No. Q20112805H&SPlanning Project of Hubei Provincial Department of Education under Grant No.2011jyte142Science Foundation of HubeiProvincial under Grant No.2010CDB05103
文摘In order to further improve the efficiency of video compression, we introduce a perceptual characteristics of Human Visual System (HVS) to video coding, and propose a novel video coding rate control algorithm based on human visual saliency model in H.264/AVC. Firstly, we modifie Itti's saliency model. Secondly, target bits of each frame are allocated through the correlation of saliency region between the current and previous frame, and the complexity of each MB is modified through the saliency value and its Mean Absolute Difference (MAD) value. Lastly, the algorithm was implemented in JVT JM12.2. Simulation results show that, comparing with traditional rate control algorithm, the proposed one can reduce the coding bit rate and improve the reconstructed video subjective quality, especially for visual saliency region. It is very suitable for wireless video transmission.
基金supported by the National Natural Science Foundation of China(61303192)the China Postdoctoral Science Foundation(2015M5726942016T90979)
文摘In order to better represent infrared target features under different environments, a saliency detection method based on region covariance and global feature is proposed. Firstly, the region covariance features on different scale spaces and different image regions are extracted and transformed into sigma features,then combined with central position feature, the local salient map is generated. Next, a global salient map is generated by gray contrast and density estimation. Finally, the saliency detection result of infrared images is obtained by fusing the local and global salient maps. The experimental results show that the salient map of the proposed method has complete target features and obvious edges,and the proposed method is better than the state of art method both qualitatively and quantitatively.
基金The authors extend their appreciation to the Deanship of Scientific Research at King Saud University for funding this work through research Group No.(RG-1438-034)and co-authors K.A.and M.A.
文摘Melanoma,due to its higher mortality rate,is considered as one of the most pernicious types of skin cancers,mostly affecting the white populations.It has been reported a number of times and is now widely accepted,that early detection of melanoma increases the chances of the subject’s survival.Computer-aided diagnostic systems help the experts in diagnosing the skin lesion at earlier stages using machine learning techniques.In thiswork,we propose a framework that accurately segments,and later classifies,the lesion using improved image segmentation and fusion methods.The proposed technique takes an image and passes it through two methods simultaneously;one is the weighted visual saliency-based method,and the second is improved HDCT based saliency estimation.The resultant image maps are later fused using the proposed image fusion technique to generate a localized lesion region.The resultant binary image is later mapped back to the RGB image and fed into the Inception-ResNet-V2 pre-trained model-trained by applying transfer learning.The simulation results show improved performance compared to several existing methods.
基金the Natural Science Foundation of Hubei Province(No.2014CFB247)the National Natural Science Foundation of China(Nos.61440016,61273225,61273303 and 31201121)the Project of the Key Laboratory for Metallurgical Equipment and Control of Ministry of Education(No.2013B08)
文摘Visual saliency is an important cue in human visual system to identify salient region in the image;it can be useful in many applications including image retrieval,object recognition,image segmentation,etc.Image contrast has been used as an effective feature to detect visual salient region.However,the conventional contrast measures either in spectral domain or in spatial domain fail to give sufficient consideration towards the local and global characteristics of the image.This paper presents a visual saliency detection algorithm based on a novel contrast measurement.This measurement extracts the spectral information of image block using the 2D discrete Fourier transform(DFT),and combines with the total variation(TV)of image block in spatial domain.The proposed algorithm is used to perform salient region detection in the image,and compared with state-of-the-art algorithms.The experimental results from the MSRA dataset validate the effectiveness of the proposed algorithm.
