The improved scene-based adaptive nonuniformity correction (NUC) algorithms using a neural network (NNT) approach for infrared image sequences are presented and analyzed. The retina-like neural networks using steepest...The improved scene-based adaptive nonuniformity correction (NUC) algorithms using a neural network (NNT) approach for infrared image sequences are presented and analyzed. The retina-like neural networks using steepest descent model was the first proposed infrared focal plane arrays (IRFPA) nonuniformity compensation method,which can perform parameter estimation of the sensors over time on a frame by frame basis. To increase the strength and the robustness of the NNT algorithm and to avoid the presence of ghosting artifacts,some optimization techniques,including momentum term,regularization factor and adaptive learning rate,were executed in the parameter learning process. In this paper,the local median filtering result of AX^U_ ij (n) is proposed as an alternative value of desired network output of neuron X_ ij (n),denoted as T_ ij (n),which is the local spatial average of AX^U_ ij (n) in traditional NNT methods. Noticeably,the NUC algorithm is inter-frame adaptive in nature and does not rely on any statistical assumptions on the scene data in the image sequence. Applications of this algorithm to the simulated video sequences and real infrared data taken with PV320 show that the correction results of image sequence are better than that of using original NNT approach,especially for the short-time image sequences (several hundred frames) subjected to the dense impulse noises with a number of dead or saturated pixels.展开更多
To solve the heterogeneous image scene matching problem, a non-linear pre-processing method for the original images before intensity-based correlation is proposed. The result shows that the proper matching probability...To solve the heterogeneous image scene matching problem, a non-linear pre-processing method for the original images before intensity-based correlation is proposed. The result shows that the proper matching probability is raised greatly. Especially for the low S/N image pairs, the effect is more remarkable.展开更多
Object-based audio coding is the main technique of audio scene coding. It can effectively reconstruct each object trajectory, besides provide sufficient flexibility for personalized audio scene reconstruction. So more...Object-based audio coding is the main technique of audio scene coding. It can effectively reconstruct each object trajectory, besides provide sufficient flexibility for personalized audio scene reconstruction. So more and more attentions have been paid to the object-based audio coding. However, existing object-based techniques have poor sound quality because of low parameter frequency domain resolution. In order to achieve high quality audio object coding, we propose a new coding framework with introducing the non-negative matrix factorization(NMF) method. We extract object parameters with high resolution to improve sound quality, and apply NMF method to parameter coding to reduce the high bitrate caused by high resolution. And the experimental results have shown that the proposed framework can improve the coding quality by 25%, so it can provide a better solution to encode audio scene in a more flexible and higher quality way.展开更多
<div style="text-align:justify;"> In the era of information and communication technology (ICT) and big data, the map gradually shows a new qualitative feature of “spatiotemporal ubiquitous” due to th...<div style="text-align:justify;"> In the era of information and communication technology (ICT) and big data, the map gradually shows a new qualitative feature of “spatiotemporal ubiquitous” due to the extension of its object space and the geographic information it contains, which brings new challenges to map information organization. This paper analyzes the concept and information characteristics of the ubiquitous map. Based on that, it proposes a ubiquitous map information organization model oriented to location-based aggregation. This new model includes three parts as “ubiquitous map instance”, “location-based aggregation mode” and “map scene”. This paper focuses on the “map scene” part which is the core of the model and contains two mutually mapped aspects as “content scene” and “representation scene”. And both aspects are divided into three levels as “features” ←→ “elements” ←→ “scenes” according to ubiquitous map information characteristics and location-based aggregation mode. With cases of map decomposition, the application of the model is explained to illustrate its effectiveness. The model is expected to provide powerful data organization and management capabilities for ubiquitous map production and use. </div>展开更多
针对煤矿井下人机协同作业中的安全防护需求,设计了一种基于超宽带(UWB)技术的电子围栏系统,构建了一个包含定位、通信、控制“三位一体”的主动防护体系。系统通过UWB技术实现了厘米级的高精度定位,并结合多基站同步定位的飞行时间差(T...针对煤矿井下人机协同作业中的安全防护需求,设计了一种基于超宽带(UWB)技术的电子围栏系统,构建了一个包含定位、通信、控制“三位一体”的主动防护体系。系统通过UWB技术实现了厘米级的高精度定位,并结合多基站同步定位的飞行时间差(Time of Flight,TOF)测距优化算法,突破了传统定位技术中单基站的局限,成功实现了标签在复杂井下环境中通过多个定位设备之间的无缝协同定位。系统构建了一种RS485/UWB异构数据传输架构,通过RS485总线实现远距离稳定通信,结合UWB无线技术形成冗余传输通道,确保危险区域预警/停机数据能够在井下复杂、恶劣环境下可靠传输。硬件方面,设计了一种具备多模态数据融合能力的智能读卡器装置,能够集成UWB测距数据、AI视频识别装置数据、近场感应终端数据,通过场景状态评估算法实现对人员定位卡、声光报警器、断电保护装置的分级联动控制。试验验证表明,系统响应时间低于2 s,能够在人员接近危险区域时迅速发出报警信号并实现设备的断电保护;双向报警机制的成功率达到了99.3%,有效保证了当人员接近危险区域时,同时向作业人员和设备操作端发出警报;系统的误报率被控制在0.2%以内,避免了因错误检测导致的设备误断电,确保了安全性和稳定性。此外,系统数据的无线上传成功率高达99.1%,为井下复杂环境中的预警/停机数据提供了稳定的冗余传输通道。展开更多
文摘The improved scene-based adaptive nonuniformity correction (NUC) algorithms using a neural network (NNT) approach for infrared image sequences are presented and analyzed. The retina-like neural networks using steepest descent model was the first proposed infrared focal plane arrays (IRFPA) nonuniformity compensation method,which can perform parameter estimation of the sensors over time on a frame by frame basis. To increase the strength and the robustness of the NNT algorithm and to avoid the presence of ghosting artifacts,some optimization techniques,including momentum term,regularization factor and adaptive learning rate,were executed in the parameter learning process. In this paper,the local median filtering result of AX^U_ ij (n) is proposed as an alternative value of desired network output of neuron X_ ij (n),denoted as T_ ij (n),which is the local spatial average of AX^U_ ij (n) in traditional NNT methods. Noticeably,the NUC algorithm is inter-frame adaptive in nature and does not rely on any statistical assumptions on the scene data in the image sequence. Applications of this algorithm to the simulated video sequences and real infrared data taken with PV320 show that the correction results of image sequence are better than that of using original NNT approach,especially for the short-time image sequences (several hundred frames) subjected to the dense impulse noises with a number of dead or saturated pixels.
文摘To solve the heterogeneous image scene matching problem, a non-linear pre-processing method for the original images before intensity-based correlation is proposed. The result shows that the proper matching probability is raised greatly. Especially for the low S/N image pairs, the effect is more remarkable.
基金supported by National High Technology Research and Development Program of China (863 Program) (No.2015AA016306)National Nature Science Foundation of China (No.61231015)National Nature Science Foundation of China (No.61671335)
文摘Object-based audio coding is the main technique of audio scene coding. It can effectively reconstruct each object trajectory, besides provide sufficient flexibility for personalized audio scene reconstruction. So more and more attentions have been paid to the object-based audio coding. However, existing object-based techniques have poor sound quality because of low parameter frequency domain resolution. In order to achieve high quality audio object coding, we propose a new coding framework with introducing the non-negative matrix factorization(NMF) method. We extract object parameters with high resolution to improve sound quality, and apply NMF method to parameter coding to reduce the high bitrate caused by high resolution. And the experimental results have shown that the proposed framework can improve the coding quality by 25%, so it can provide a better solution to encode audio scene in a more flexible and higher quality way.
文摘<div style="text-align:justify;"> In the era of information and communication technology (ICT) and big data, the map gradually shows a new qualitative feature of “spatiotemporal ubiquitous” due to the extension of its object space and the geographic information it contains, which brings new challenges to map information organization. This paper analyzes the concept and information characteristics of the ubiquitous map. Based on that, it proposes a ubiquitous map information organization model oriented to location-based aggregation. This new model includes three parts as “ubiquitous map instance”, “location-based aggregation mode” and “map scene”. This paper focuses on the “map scene” part which is the core of the model and contains two mutually mapped aspects as “content scene” and “representation scene”. And both aspects are divided into three levels as “features” ←→ “elements” ←→ “scenes” according to ubiquitous map information characteristics and location-based aggregation mode. With cases of map decomposition, the application of the model is explained to illustrate its effectiveness. The model is expected to provide powerful data organization and management capabilities for ubiquitous map production and use. </div>
文摘针对煤矿井下人机协同作业中的安全防护需求,设计了一种基于超宽带(UWB)技术的电子围栏系统,构建了一个包含定位、通信、控制“三位一体”的主动防护体系。系统通过UWB技术实现了厘米级的高精度定位,并结合多基站同步定位的飞行时间差(Time of Flight,TOF)测距优化算法,突破了传统定位技术中单基站的局限,成功实现了标签在复杂井下环境中通过多个定位设备之间的无缝协同定位。系统构建了一种RS485/UWB异构数据传输架构,通过RS485总线实现远距离稳定通信,结合UWB无线技术形成冗余传输通道,确保危险区域预警/停机数据能够在井下复杂、恶劣环境下可靠传输。硬件方面,设计了一种具备多模态数据融合能力的智能读卡器装置,能够集成UWB测距数据、AI视频识别装置数据、近场感应终端数据,通过场景状态评估算法实现对人员定位卡、声光报警器、断电保护装置的分级联动控制。试验验证表明,系统响应时间低于2 s,能够在人员接近危险区域时迅速发出报警信号并实现设备的断电保护;双向报警机制的成功率达到了99.3%,有效保证了当人员接近危险区域时,同时向作业人员和设备操作端发出警报;系统的误报率被控制在0.2%以内,避免了因错误检测导致的设备误断电,确保了安全性和稳定性。此外,系统数据的无线上传成功率高达99.1%,为井下复杂环境中的预警/停机数据提供了稳定的冗余传输通道。
