An effective nonrigid image registrationmethod is developed based on the optical flow field(OFF)framework for the complex registration of structure images.In our method,a new force is modeled and integrated into the o...An effective nonrigid image registrationmethod is developed based on the optical flow field(OFF)framework for the complex registration of structure images.In our method,a new force is modeled and integrated into the original optical flow equation to jointly drive the motion direction of pixels.At any point in the offset field,in addition to the force generated by the OFF model derived from local gradient information to drive the pixels in the floating image to infiltrate into the reference pixel set,a new“guiding force”derived from the global grayscale overall trend in a given neighborhood system helps the pixels to more properly spread into the corresponding reference pixel set,particularly when the gradient field of the reference image is unstable.In the experiment,a data set containing several images with complex structures was employed to validate the performance of our registration model.The test results show that our method can quickly and efficiently register complex images and is robust to noise in images.展开更多
Objective: Most of the western music consists of a melody and an accompaniment. The melody is referred to as the foreground, with the accompaniment the background. In visual processing, the lateral occipital complex (...Objective: Most of the western music consists of a melody and an accompaniment. The melody is referred to as the foreground, with the accompaniment the background. In visual processing, the lateral occipital complex (LOC) is known to participate in foreground and background segregation. We investigated the role of LOC in music processing with use of positron emission tomography (PET). Method: Musically na?ve subjects listened to unfamiliar novel melodies with (accompaniment condition) and without the accompaniment (melodic condition). Using a PET subtraction technique, we studied changes in regional cerebral blood flow (rCBF) during the accompaniment condition compared to the melodic condition. Results: The accompanyment condition was associated with bilateral increase of rCBF at the lateral and medial surfaces of both occipital lobes, medial parts of fusiform gyri, cingulate gyri, precentral gyri, insular cortices, and cerebellum. During the melodic condition, the activation at the anterior and posterior portions of the temporal lobes, medial surface of the frontal lobes, inferior frontal gyri, orbitofrontal cortices, inferior parietal lobules, and cerebellum was observed. Conclusions: The LOC participates in recognition of melody with accompaniment, a phenomenon that can be regarded as foreground and background segregation in auditory processing. The fusiform cortex which was known to participate in the color recognition might be activated by the recognition of flourish sounds by the accompaniment, compared to melodic condition. It is supposed that the LOC and fusiform cortex play similar functions beyond the difference of sensory modalities.展开更多
Accurately identifying building distribution from remote sensing images with complex background information is challenging.The emergence of diffusion models has prompted the innovative idea of employing the reverse de...Accurately identifying building distribution from remote sensing images with complex background information is challenging.The emergence of diffusion models has prompted the innovative idea of employing the reverse denoising process to distill building distribution from these complex backgrounds.Building on this concept,we propose a novel framework,building extraction diffusion model(BEDiff),which meticulously refines the extraction of building footprints from remote sensing images in a stepwise fashion.Our approach begins with the design of booster guidance,a mechanism that extracts structural and semantic features from remote sensing images to serve as priors,thereby providing targeted guidance for the diffusion process.Additionally,we introduce a cross-feature fusion module(CFM)that bridges the semantic gap between different types of features,facilitating the integration of the attributes extracted by booster guidance into the diffusion process more effectively.Our proposed BEDiff marks the first application of diffusion models to the task of building extraction.Empirical evidence from extensive experiments on the Beijing building dataset demonstrates the superior performance of BEDiff,affirming its effectiveness and potential for enhancing the accuracy of building extraction in complex urban landscapes.展开更多
在电力巡检过程中,无人机等边端智能检测设备往往面临输电线路绝缘子缺陷目标小、背景因素复杂等难点,且边端设备的硬件条件限制了模型的规模,导致设备算力有限,模型准确率偏低。针对上述问题,该文提出了一种基于YOLOv8-RFL(You only lo...在电力巡检过程中,无人机等边端智能检测设备往往面临输电线路绝缘子缺陷目标小、背景因素复杂等难点,且边端设备的硬件条件限制了模型的规模,导致设备算力有限,模型准确率偏低。针对上述问题,该文提出了一种基于YOLOv8-RFL(You only look once version 8-RFL)模型的输电线路绝缘子缺陷检测方法。首先,通过对原有主干网络C2f(CSPDarknet53 to 2-Stage FPN)模块进行改进,增强模型对于绝缘子缺陷的特征提取能力;其次,构建基于特征聚焦的泛化特征金字塔网络(focusing generalized feature pyramid networks,FGFPN),采用“特征聚焦-扩散”的思想,精细化小缺陷目标的特征表达;然后,设计基于交叉注意机制的特征语义融合模块(feature semantic fusion module,FSFM),优化了对关键特征信息的捕获和利用;最后,提出轻量化权重共享检测头(Lightweight weight sharing detection head,LWSD),在保证检测精度的同时提高模型的计算效率和实时性。实验表明,改进后的YOLOv8-RFL模型均值平均精度(mean average precision,mAP)达到了93.2%,相较于基准模型提升了5.9%,在降低模型参数量和所需计算量的同时,实现了更好的绝缘子小目标缺陷检测效果,对于复杂背景下的输电线路绝缘子缺陷检测具有一定的现实意义。展开更多
基金supported in part by the National Key Research and Development Program of China under Grant no.2020YFB1806403.
文摘An effective nonrigid image registrationmethod is developed based on the optical flow field(OFF)framework for the complex registration of structure images.In our method,a new force is modeled and integrated into the original optical flow equation to jointly drive the motion direction of pixels.At any point in the offset field,in addition to the force generated by the OFF model derived from local gradient information to drive the pixels in the floating image to infiltrate into the reference pixel set,a new“guiding force”derived from the global grayscale overall trend in a given neighborhood system helps the pixels to more properly spread into the corresponding reference pixel set,particularly when the gradient field of the reference image is unstable.In the experiment,a data set containing several images with complex structures was employed to validate the performance of our registration model.The test results show that our method can quickly and efficiently register complex images and is robust to noise in images.
文摘Objective: Most of the western music consists of a melody and an accompaniment. The melody is referred to as the foreground, with the accompaniment the background. In visual processing, the lateral occipital complex (LOC) is known to participate in foreground and background segregation. We investigated the role of LOC in music processing with use of positron emission tomography (PET). Method: Musically na?ve subjects listened to unfamiliar novel melodies with (accompaniment condition) and without the accompaniment (melodic condition). Using a PET subtraction technique, we studied changes in regional cerebral blood flow (rCBF) during the accompaniment condition compared to the melodic condition. Results: The accompanyment condition was associated with bilateral increase of rCBF at the lateral and medial surfaces of both occipital lobes, medial parts of fusiform gyri, cingulate gyri, precentral gyri, insular cortices, and cerebellum. During the melodic condition, the activation at the anterior and posterior portions of the temporal lobes, medial surface of the frontal lobes, inferior frontal gyri, orbitofrontal cortices, inferior parietal lobules, and cerebellum was observed. Conclusions: The LOC participates in recognition of melody with accompaniment, a phenomenon that can be regarded as foreground and background segregation in auditory processing. The fusiform cortex which was known to participate in the color recognition might be activated by the recognition of flourish sounds by the accompaniment, compared to melodic condition. It is supposed that the LOC and fusiform cortex play similar functions beyond the difference of sensory modalities.
基金supported by the National Natural Science Foundation of China(Nos.61906168,62202429 and 62272267)the Zhejiang Provincial Natural Science Foundation of China(No.LY23F020023)the Construction of Hubei Provincial Key Laboratory for Intelligent Visual Monitoring of Hydropower Projects(No.2022SDSJ01)。
文摘Accurately identifying building distribution from remote sensing images with complex background information is challenging.The emergence of diffusion models has prompted the innovative idea of employing the reverse denoising process to distill building distribution from these complex backgrounds.Building on this concept,we propose a novel framework,building extraction diffusion model(BEDiff),which meticulously refines the extraction of building footprints from remote sensing images in a stepwise fashion.Our approach begins with the design of booster guidance,a mechanism that extracts structural and semantic features from remote sensing images to serve as priors,thereby providing targeted guidance for the diffusion process.Additionally,we introduce a cross-feature fusion module(CFM)that bridges the semantic gap between different types of features,facilitating the integration of the attributes extracted by booster guidance into the diffusion process more effectively.Our proposed BEDiff marks the first application of diffusion models to the task of building extraction.Empirical evidence from extensive experiments on the Beijing building dataset demonstrates the superior performance of BEDiff,affirming its effectiveness and potential for enhancing the accuracy of building extraction in complex urban landscapes.
文摘在电力巡检过程中,无人机等边端智能检测设备往往面临输电线路绝缘子缺陷目标小、背景因素复杂等难点,且边端设备的硬件条件限制了模型的规模,导致设备算力有限,模型准确率偏低。针对上述问题,该文提出了一种基于YOLOv8-RFL(You only look once version 8-RFL)模型的输电线路绝缘子缺陷检测方法。首先,通过对原有主干网络C2f(CSPDarknet53 to 2-Stage FPN)模块进行改进,增强模型对于绝缘子缺陷的特征提取能力;其次,构建基于特征聚焦的泛化特征金字塔网络(focusing generalized feature pyramid networks,FGFPN),采用“特征聚焦-扩散”的思想,精细化小缺陷目标的特征表达;然后,设计基于交叉注意机制的特征语义融合模块(feature semantic fusion module,FSFM),优化了对关键特征信息的捕获和利用;最后,提出轻量化权重共享检测头(Lightweight weight sharing detection head,LWSD),在保证检测精度的同时提高模型的计算效率和实时性。实验表明,改进后的YOLOv8-RFL模型均值平均精度(mean average precision,mAP)达到了93.2%,相较于基准模型提升了5.9%,在降低模型参数量和所需计算量的同时,实现了更好的绝缘子小目标缺陷检测效果,对于复杂背景下的输电线路绝缘子缺陷检测具有一定的现实意义。
