The concept and advantage of reconfigurable technology is introduced. A kind of processor architecture of re configurable macro processor (RMP) model based on FPGA array and DSP is put forward and has been implemented...The concept and advantage of reconfigurable technology is introduced. A kind of processor architecture of re configurable macro processor (RMP) model based on FPGA array and DSP is put forward and has been implemented. Two image algorithms are developed: template-based automatic target recognition and zone labeling. One is estimating for motion direction in the infrared image background, another is line picking-up algorithm based on image zone labeling and phase grouping technique. It is a kind of 'hardware' function that can be called by the DSP in high-level algorithm. It is also a kind of hardware algorithm of the DSP. The results of experiments show the reconfigurable computing technology based on RMP is an ideal accelerating means to deal with the high-speed image processing tasks. High real time performance is obtained in our two applications on RMP.展开更多
An airborne SAR real-time digital imaging processor is presented, and its realtime digital imaging principle and main technical parameters are analyzed briefly. The system configuration and logical structure are descr...An airborne SAR real-time digital imaging processor is presented, and its realtime digital imaging principle and main technical parameters are analyzed briefly. The system configuration and logical structure are described in detail. Finally the main features of this system and examples of imagery obtained with the system are also presented.展开更多
A novel reconfigurable hardware system which uses both muhi-DSP and FPGA to attain high performance and real-time image processing are presented. The system structure and working principle of mainly processing multi-B...A novel reconfigurable hardware system which uses both muhi-DSP and FPGA to attain high performance and real-time image processing are presented. The system structure and working principle of mainly processing multi-BSP board, extended multi-DSP board are analysed. The outstanding advantage is that the communication among different board components of this system is supported by high speed link ports ＆ serial ports for increasing the system performance and computational power. Then the implementation of embedded real-time operating systems （RTOS） by us is discussed in detail. In this system, we adopt two kinds of parallel structures controlled by RTOS for parallel processing of algorithms. The experimental results show that exploitive period of the system is short, and maintenance convenient. Thus it is suitable for real-time image processing and can get satisfactory effect of image recognition.展开更多
This paper analyzes the current difficulties encountered in on-line inspection systems of strip surface quality, specifically relating to problems with real-time processing of huge amounts of data. To address this nee...This paper analyzes the current difficulties encountered in on-line inspection systems of strip surface quality, specifically relating to problems with real-time processing of huge amounts of data. To address this need, this paper describes an FPGA-based high-speed image processing module with both hardware and software aspects. Improving these two aspects together will help the system achieve real-time processing of massive image data, and simplifies the architecture of the strip surface quality on-line inspection system.展开更多
This paper proposed a general purpose real-time image processing system based on a flexible DSP-based Network, which is implemented by a high bandwidth communication channel, links. The links is realized using FPGA an...This paper proposed a general purpose real-time image processing system based on a flexible DSP-based Network, which is implemented by a high bandwidth communication channel, links. The links is realized using FPGA and provides a bandwidth of 12. 8 Gbit/s. Using the links, The topologic of multi-DSP system can be changed online to meet the variabilities of the parallel algorithm of image processing. The system can be assembled with utmost tens of boards and maintain the high communication speed. Analysis of the system adaptivity to image processing is testified followed by actual results. Key words real-time image processing - multi-DSP - flexible - scalable - FPGA - links CLC number TP 303 Foundation item: Supported by the National Natural Science Foundation of China (60135020)Biography: MAO Hai-cen(1973-), male, Ph.D. candidate, research direction: artificial intelligence, expert system, pattern recognition and image processing展开更多
The flexibility of traditional image processing system is limited because those system are designed for specific applications. In this paper, a new TMS320C64x-based multi-DSP parallel computing architecture is present...The flexibility of traditional image processing system is limited because those system are designed for specific applications. In this paper, a new TMS320C64x-based multi-DSP parallel computing architecture is presented. It has many promising characteristics such as powerful computing capability, broad I/O bandwidth, topology flexibility, and expansibility. The parallel system performance is evaluated by practical experiment.展开更多
Although the image dehazing problem has received considerable attention over recent years,the existing models often prioritise performance at the expense of complexity,making them unsuitable for real-world application...Although the image dehazing problem has received considerable attention over recent years,the existing models often prioritise performance at the expense of complexity,making them unsuitable for real-world applications,which require algorithms to be deployed on resource constrained-devices.To address this challenge,we propose WaveLiteDehaze-Network(WLD-Net),an end-to-end dehazing model that delivers performance comparable to complex models while operating in real time and using significantly fewer parameters.This approach capitalises on the insight that haze predominantly affects low-frequency infor-mation.By exclusively processing the image in the frequency domain using discrete wavelet transform(DWT),we segregate the image into high and low frequencies and process them separately.This allows us to preserve high-frequency details and recover low-frequency components affected by haze,distinguishing our method from existing approaches that use spatial domain processing as the backbone,with DWT serving as an auxiliary component.DWT is applied at multiple levels for better in-formation retention while also accelerating computation by downsampling feature maps.Subsequently,a learning-based fusion mechanism reintegrates the processed frequencies to reconstruct the dehazed image.Experiments show that WLD-Net out-performs other low-parameter models on real-world hazy images and rivals much larger models,achieving the highest PSNR and SSIM scores on the O-Haze dataset.Qualitatively,the proposed method demonstrates its effectiveness in handling a diverse range of haze types,delivering visually pleasing results and robust performance,while also generalising well across different scenarios.With only 0.385 million parameters(more than 100 times smaller than comparable dehazing methods),WLD-Net processes 1024×1024 images in just 0.045 s,highlighting its applicability across various real-world scenarios.The code is available at https://github.com/AliMurtaza29/WLD-Net.展开更多
Microsoft Kinect sensor has shown the research community that it's more than just an interactive gaming device, due to its multi-functional abilities and high reliability. In this work, online HIL (Hardware-in-the...Microsoft Kinect sensor has shown the research community that it's more than just an interactive gaming device, due to its multi-functional abilities and high reliability. In this work, online HIL (Hardware-in-the-Loop) experimental data are used to apply human motion imitation to a 2-degree of freedom Lego Mind storm NXT robotic arm. A model simulation of the dc motor used in this experiment is also present in this paper. The acquired input data from the Kinect sensor are processed in a closed loop PID controller with feedback from motors encoders. The applied algorithms solve the overlapping input problem, conducting a simultaneous control of both shoulder and elbow joints, and solving the overlapping input problem as well. The work in this paper is presented as a prototype to assure the applicability of the algorithms, for further development.展开更多
Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to ...Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to realize the automation of computer-aided seam tracking. A PAW (plasma arc welding) seam tracking system was developed, which senses the molten pool and the seam in one frame by a vision sensor, and then detects the seam deviation to adjust the work piece motion adaptively to the seam position sensed by vision sensor. A novel molten pool area image-processing algorithm based on machine vision was proposed. The algorithm processes each image at the speed of 20 frames/second in real-time to extract three feature variables to get the seam deviation. It is proved experimentally that the algorithm is very fast and effective. Issues related to the algorithm are also discussed.展开更多
In our previous work, a novel algorithm to perform robust pose estimation was presented. The pose was estimated using points on the object to regions on image correspondence. The laboratory experiments conducted in th...In our previous work, a novel algorithm to perform robust pose estimation was presented. The pose was estimated using points on the object to regions on image correspondence. The laboratory experiments conducted in the previous work showed that the accuracy of the estimated pose was over 99% for position and 84% for orientation estimations respectively. However, for larger objects, the algorithm requires a high number of points to achieve the same accuracy. The requirement of higher number of points makes the algorithm, computationally intensive resulting in the algorithm infeasible for real-time computer vision applications. In this paper, the algorithm is parallelized to run on NVIDIA GPUs. The results indicate that even for objects having more than 2000 points, the algorithm can estimate the pose in real time for each frame of high-resolution videos.展开更多
The design of a pixel processor of a real-time CIG (Computer Image Generation) system is summarized. The system has been brought into use. In order to adopt ASIC (Application-Specific integrated Circuit) technology in...The design of a pixel processor of a real-time CIG (Computer Image Generation) system is summarized. The system has been brought into use. In order to adopt ASIC (Application-Specific integrated Circuit) technology in the design of the new system, the VHDL (Very high speed integrated circuit Hardware Description Language) is used and a re-design and simulation strategy is planed.展开更多
The digital contour enhancement techniques of infrared image are discussed. Emphasis is laid the thermal spread compensation method. On the basis of describing the theory of the method, a model is suggested. The concr...The digital contour enhancement techniques of infrared image are discussed. Emphasis is laid the thermal spread compensation method. On the basis of describing the theory of the method, a model is suggested. The concrete project based on the model for realizing digital contour enhancement of the infrared thermal image is put forward, and some test results are shown.展开更多
This paper expounds the necessity of applying real-time control in vision sensing and tracking system of welding robot and analyses the difficulty of welding image processing. Through experiments, a practical robot C...This paper expounds the necessity of applying real-time control in vision sensing and tracking system of welding robot and analyses the difficulty of welding image processing. Through experiments, a practical robot CO2 arc adaptive feedback tracking system is established. According to the analysing of current and voltage signals between welding torch and base metal, the image freezing time for TMS-32020 processor is determined, and the defect of dark image and serious splashes in CO, welding image are avoided. Thus welding image becomes clear, and digitalization of video signal is stability. Then, with adaptive threshold control the welding image binaryzation, 3×3 mean level filtration and 3×3 weighting mean level filtration in welding seam are processed.Furthermore, the deviation between the centre of welding torch and the seam welded is found out, even though there are much spatter in the welding image.At last, the end effector of the robot is controlled and a welding torch is carried to track the seam welded during arc welding.展开更多
文摘The concept and advantage of reconfigurable technology is introduced. A kind of processor architecture of re configurable macro processor (RMP) model based on FPGA array and DSP is put forward and has been implemented. Two image algorithms are developed: template-based automatic target recognition and zone labeling. One is estimating for motion direction in the infrared image background, another is line picking-up algorithm based on image zone labeling and phase grouping technique. It is a kind of 'hardware' function that can be called by the DSP in high-level algorithm. It is also a kind of hardware algorithm of the DSP. The results of experiments show the reconfigurable computing technology based on RMP is an ideal accelerating means to deal with the high-speed image processing tasks. High real time performance is obtained in our two applications on RMP.
文摘An airborne SAR real-time digital imaging processor is presented, and its realtime digital imaging principle and main technical parameters are analyzed briefly. The system configuration and logical structure are described in detail. Finally the main features of this system and examples of imagery obtained with the system are also presented.
基金This project was supported by the National Natural Science Foundation of China(60135020) National Key Pre-researchProject of China(413010701 -3) .
文摘A novel reconfigurable hardware system which uses both muhi-DSP and FPGA to attain high performance and real-time image processing are presented. The system structure and working principle of mainly processing multi-BSP board, extended multi-DSP board are analysed. The outstanding advantage is that the communication among different board components of this system is supported by high speed link ports ＆ serial ports for increasing the system performance and computational power. Then the implementation of embedded real-time operating systems （RTOS） by us is discussed in detail. In this system, we adopt two kinds of parallel structures controlled by RTOS for parallel processing of algorithms. The experimental results show that exploitive period of the system is short, and maintenance convenient. Thus it is suitable for real-time image processing and can get satisfactory effect of image recognition.
文摘This paper analyzes the current difficulties encountered in on-line inspection systems of strip surface quality, specifically relating to problems with real-time processing of huge amounts of data. To address this need, this paper describes an FPGA-based high-speed image processing module with both hardware and software aspects. Improving these two aspects together will help the system achieve real-time processing of massive image data, and simplifies the architecture of the strip surface quality on-line inspection system.
文摘This paper proposed a general purpose real-time image processing system based on a flexible DSP-based Network, which is implemented by a high bandwidth communication channel, links. The links is realized using FPGA and provides a bandwidth of 12. 8 Gbit/s. Using the links, The topologic of multi-DSP system can be changed online to meet the variabilities of the parallel algorithm of image processing. The system can be assembled with utmost tens of boards and maintain the high communication speed. Analysis of the system adaptivity to image processing is testified followed by actual results. Key words real-time image processing - multi-DSP - flexible - scalable - FPGA - links CLC number TP 303 Foundation item: Supported by the National Natural Science Foundation of China (60135020)Biography: MAO Hai-cen(1973-), male, Ph.D. candidate, research direction: artificial intelligence, expert system, pattern recognition and image processing
基金This project was supported by the National Natural Science Foundation of China (60135020).
文摘The flexibility of traditional image processing system is limited because those system are designed for specific applications. In this paper, a new TMS320C64x-based multi-DSP parallel computing architecture is presented. It has many promising characteristics such as powerful computing capability, broad I/O bandwidth, topology flexibility, and expansibility. The parallel system performance is evaluated by practical experiment.
基金Japan International Cooperation Agency(JICA)via Malaysia-Japan Linkage Research Grant 2024.
文摘Although the image dehazing problem has received considerable attention over recent years,the existing models often prioritise performance at the expense of complexity,making them unsuitable for real-world applications,which require algorithms to be deployed on resource constrained-devices.To address this challenge,we propose WaveLiteDehaze-Network(WLD-Net),an end-to-end dehazing model that delivers performance comparable to complex models while operating in real time and using significantly fewer parameters.This approach capitalises on the insight that haze predominantly affects low-frequency infor-mation.By exclusively processing the image in the frequency domain using discrete wavelet transform(DWT),we segregate the image into high and low frequencies and process them separately.This allows us to preserve high-frequency details and recover low-frequency components affected by haze,distinguishing our method from existing approaches that use spatial domain processing as the backbone,with DWT serving as an auxiliary component.DWT is applied at multiple levels for better in-formation retention while also accelerating computation by downsampling feature maps.Subsequently,a learning-based fusion mechanism reintegrates the processed frequencies to reconstruct the dehazed image.Experiments show that WLD-Net out-performs other low-parameter models on real-world hazy images and rivals much larger models,achieving the highest PSNR and SSIM scores on the O-Haze dataset.Qualitatively,the proposed method demonstrates its effectiveness in handling a diverse range of haze types,delivering visually pleasing results and robust performance,while also generalising well across different scenarios.With only 0.385 million parameters(more than 100 times smaller than comparable dehazing methods),WLD-Net processes 1024×1024 images in just 0.045 s,highlighting its applicability across various real-world scenarios.The code is available at https://github.com/AliMurtaza29/WLD-Net.
文摘Microsoft Kinect sensor has shown the research community that it's more than just an interactive gaming device, due to its multi-functional abilities and high reliability. In this work, online HIL (Hardware-in-the-Loop) experimental data are used to apply human motion imitation to a 2-degree of freedom Lego Mind storm NXT robotic arm. A model simulation of the dc motor used in this experiment is also present in this paper. The acquired input data from the Kinect sensor are processed in a closed loop PID controller with feedback from motors encoders. The applied algorithms solve the overlapping input problem, conducting a simultaneous control of both shoulder and elbow joints, and solving the overlapping input problem as well. The work in this paper is presented as a prototype to assure the applicability of the algorithms, for further development.
文摘Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to realize the automation of computer-aided seam tracking. A PAW (plasma arc welding) seam tracking system was developed, which senses the molten pool and the seam in one frame by a vision sensor, and then detects the seam deviation to adjust the work piece motion adaptively to the seam position sensed by vision sensor. A novel molten pool area image-processing algorithm based on machine vision was proposed. The algorithm processes each image at the speed of 20 frames/second in real-time to extract three feature variables to get the seam deviation. It is proved experimentally that the algorithm is very fast and effective. Issues related to the algorithm are also discussed.
文摘In our previous work, a novel algorithm to perform robust pose estimation was presented. The pose was estimated using points on the object to regions on image correspondence. The laboratory experiments conducted in the previous work showed that the accuracy of the estimated pose was over 99% for position and 84% for orientation estimations respectively. However, for larger objects, the algorithm requires a high number of points to achieve the same accuracy. The requirement of higher number of points makes the algorithm, computationally intensive resulting in the algorithm infeasible for real-time computer vision applications. In this paper, the algorithm is parallelized to run on NVIDIA GPUs. The results indicate that even for objects having more than 2000 points, the algorithm can estimate the pose in real time for each frame of high-resolution videos.
文摘The design of a pixel processor of a real-time CIG (Computer Image Generation) system is summarized. The system has been brought into use. In order to adopt ASIC (Application-Specific integrated Circuit) technology in the design of the new system, the VHDL (Very high speed integrated circuit Hardware Description Language) is used and a re-design and simulation strategy is planed.
文摘The digital contour enhancement techniques of infrared image are discussed. Emphasis is laid the thermal spread compensation method. On the basis of describing the theory of the method, a model is suggested. The concrete project based on the model for realizing digital contour enhancement of the infrared thermal image is put forward, and some test results are shown.
文摘This paper expounds the necessity of applying real-time control in vision sensing and tracking system of welding robot and analyses the difficulty of welding image processing. Through experiments, a practical robot CO2 arc adaptive feedback tracking system is established. According to the analysing of current and voltage signals between welding torch and base metal, the image freezing time for TMS-32020 processor is determined, and the defect of dark image and serious splashes in CO, welding image are avoided. Thus welding image becomes clear, and digitalization of video signal is stability. Then, with adaptive threshold control the welding image binaryzation, 3×3 mean level filtration and 3×3 weighting mean level filtration in welding seam are processed.Furthermore, the deviation between the centre of welding torch and the seam welded is found out, even though there are much spatter in the welding image.At last, the end effector of the robot is controlled and a welding torch is carried to track the seam welded during arc welding.
