Fluorescent probes have revolutionized optical imaging and biosensing by enabling real-time visualization, quantification, and tracking of biological processes at molecular and cellular levels. These probes, ranging f...Fluorescent probes have revolutionized optical imaging and biosensing by enabling real-time visualization, quantification, and tracking of biological processes at molecular and cellular levels. These probes, ranging from organic dyes to genetically encoded proteins and nanomaterials, provide unparalleled specificity, sensitivity, and multiplexing capabilities. However, challenges such as brightness, photobleaching, biocompatibility, and emission range continue to drive innovation in probe design and application. This special issue, comprising four review papers and seven original research studies, highlights cutting-edge advancements in fluorescent probe technologies and their transformative roles in super-resolution imaging, in vivo diagnostics, and cancer therapeutics.展开更多
New initiatives put forward by clinical diagnosis require the development of technologies for high throughput screening(HTS) of multiple analytes. Suspension arrays have great advantages over the planar arraybased mul...New initiatives put forward by clinical diagnosis require the development of technologies for high throughput screening(HTS) of multiple analytes. Suspension arrays have great advantages over the planar arraybased multiplexing assays, and the encoded bead is the key for providing multiplexing capability. Among various encoding strategies, optically encoded microspheres have been widely used while the number of codes is still limited. This review discusses the progress of optical encoding strategy from mainly three aspects, namely organic dyes, quantum dots(QDs) and surface-enhanced Raman scattering(SERS) active substrates. Emphases are put up on describing how these optical encoded microbeads are manufactured and the merits and demerits of different encoding materials are compared.展开更多
Various designed circuits for multiple-valued all-optical arithmetic are demonstrated. The terahertz-optical-asymmetric-demultiplexer (TOAD) switch is used as the basic structure unit in the proposed circuits due to i...Various designed circuits for multiple-valued all-optical arithmetic are demonstrated. The terahertz-optical-asymmetric-demultiplexer (TOAD) switch is used as the basic structure unit in the proposed circuits due to its compact size, thermal stability, and low power operation. The designs of trinary and quaternary signed-digit numbers based adders are presented using different polarized states of light. These proposed polarization-encoded based adders use much less switches and their speeds are higher than the intensity-encoded counterparts. Further, it will be shown that one of the proposed trinary signed-digit adders is twice as fast as a recently reported modified signed-digit adder.展开更多
Considerable studies have been carried out on fault diagnosis of gears, with most of them concentrated on conventional vibration analysis. However, besides the complexity of gear dynamics, the diagnosis results in ter...Considerable studies have been carried out on fault diagnosis of gears, with most of them concentrated on conventional vibration analysis. However, besides the complexity of gear dynamics, the diagnosis results in terms of vibration signal are easily misjudged owing to the interference of sensor position or other components. In this paper, an alternative gearbox fault detection method based on the instantaneous rotational speed is proposed because of its advantages over vibration analysis. Depending on the timer/counter-based method for the pulse signal of the optical encoder, the varying rotational speed can be obtained e ectively. Owing to the coupling and meshing of gears in transmission, the excitations are the same for the instantaneous rotational speed of the input and output shafts. Thus, the di erential signal of instantaneous rotational speeds can be adopted to eliminate the e ect of the interference excitations and extract the associated feature of the localized fault e ectively. With the experiments on multistage gearbox test system, the di erential signal of instantaneous speeds is compared with other signals. It is proved that localized faults in the gearbox generate small angular speed fluctuations, which are measurable with an optical encoder. Using the di erential signal of instantaneous speeds, the fault characteristics are extracted in the spectrum where the deterministic frequency component and its harmonics corresponding to crack fault characteristics are displayed clearly.展开更多
Optical cryptanalysis is essential to the further investigation of more secure optical cryptosystems.Learning-based at-tack of optical encryption eliminates the need for the retrieval of random phase keys of optical e...Optical cryptanalysis is essential to the further investigation of more secure optical cryptosystems.Learning-based at-tack of optical encryption eliminates the need for the retrieval of random phase keys of optical encryption systems but it is limited for practical applications since it requires a large set of plaintext-ciphertext pairs for the cryptosystem to be at-tacked.Here,we propose a two-step deep learning strategy for ciphertext-only attack(COA)on the classical double ran-dom phase encryption(DRPE).Specifically,we construct a virtual DRPE system to gather the training data.Besides,we divide the inverse problem in COA into two more specific inverse problems and employ two deep neural networks(DNNs)to respectively learn the removal of speckle noise in the autocorrelation domain and the de-correlation operation to retrieve the plaintext image.With these two trained DNNs at hand,we show that the plaintext can be predicted in real-time from an unknown ciphertext alone.The proposed learning-based COA method dispenses with not only the retrieval of random phase keys but also the invasive data acquisition of plaintext-ciphertext pairs in the DPRE system.Numerical simulations and optical experiments demonstrate the feasibility and effectiveness of the proposed learning-based COA method.展开更多
The encoding/decoding scheme based on Fiber Bragg Grating (FBG) for Optical Code Division Multiple Access (OCDMA) system is analyzed and the whole process from transmitting end to receiving end is researched in detail...The encoding/decoding scheme based on Fiber Bragg Grating (FBG) for Optical Code Division Multiple Access (OCDMA) system is analyzed and the whole process from transmitting end to receiving end is researched in detail. The mathematical mode including signal transmission, summing, receiving and recovering are established respectively. One of the main sources of Bit Error Rate (BER) of OCDMA system based on FBGs is the unevenness of signal power spectrum, which leads to the chip powers unequal with each other. The Signal to Interfere Ratio (SIR) and BER performance of the system are studied and simulated at the case with uneven distribution of chips' powers.展开更多
In this paper, we discuss and analyze an optical code division multiple access for multiple user system. Media access control implementation has been considered. For fulfilling the huge need of bandwidth services, tec...In this paper, we discuss and analyze an optical code division multiple access for multiple user system. Media access control implementation has been considered. For fulfilling the huge need of bandwidth services, technology tends to move to optical networks and three major optical systems come into existence. Code division of the optical network is most used and real concept interacted with users up to this time. Optical code division multiple access provides complete spectrum to each and every user for the time of accessing the channel. In the paper, we have proposed network architecture with optical encoder and decoder along with optical code translator which is supporting multiple user systems. We integrate the code translator with encoding and decoding of optical code to use the optical network at full extent and present the simulation validation results of 6 Gb/s 3-hop transmission by use of proposed architecture. Further, we have implemented experimentation with 6 users 3 Gb/s optical code division multiple access network. Through simulation structure, it is shown that the combination of encoding with EDFA in multiple user environment system provides improvement in bit error rate and also improves the multiple access interference. With increase of users in the network, MAI value increases and our proposed scheme controls interference in the network.展开更多
In this paper, the operation principle of laser rotary encoders is expounded and the optical quadruple frequency technology used in laser rotary encoders is explained, and the design idea of optical system in φ66 mm ...In this paper, the operation principle of laser rotary encoders is expounded and the optical quadruple frequency technology used in laser rotary encoders is explained, and the design idea of optical system in φ66 mm laser rotary encoder is mainly introduced, as well as the choice of principal devices.展开更多
In this paper a simple scheme for optical implementation of human-face recognition with only an incoherent optical correlator is presented. The system uses complementary-encoding hit-or-miss transform method to improv...In this paper a simple scheme for optical implementation of human-face recognition with only an incoherent optical correlator is presented. The system uses complementary-encoding hit-or-miss transform method to improve the performance of the standard correlator. According to this method, a compact optical system for human-face optical recognition is bult up. In the face library 200 photographs are stored and the recognition speed of the system is 10 frames per second. The accuracy of recognition is more than 90 percent. The system has good fault-tolerance ability for the pictures with rotation distortion, Gauss noise disturbance or information losing.展开更多
Metal-semiconductor plasmonic metasurfaces enable precise optical field manipulation at the subwavelength scale;however,most existing designs rely on external fields and exhibit only binary responses,thereby restricti...Metal-semiconductor plasmonic metasurfaces enable precise optical field manipulation at the subwavelength scale;however,most existing designs rely on external fields and exhibit only binary responses,thereby restricting the realization of multistate logic operations.Here,we present an in-situ polarization-controlled approach based on an Au-indium tin oxide(ITO)bilayer nanocrescent with a Schottky heterojunction for achieving polarization-dependent tristate optical modulation.Polarization-selective excitation of distinct localized plasmon modes facilitates directional hot-electron injection across the Au-ITO interface,thereby producing three distinct programmable states—positive,zero,and negative—at a single detection wavelength.This symmetric bilayer design is applicable to other metal-semiconductor composites and offers generalizable design principles for ternary logic,multistate optical encoding,and ultrafast photonic information processing.The proposed concept is validated through both experimental measurements and numerical simulations.展开更多
A hybrid wavelength division multiple access (WDMA)/optical code division multiplexing (OCDM) system is proposed, where the optical code is not the same as the address of every optical network unit (ONU); rather...A hybrid wavelength division multiple access (WDMA)/optical code division multiplexing (OCDM) system is proposed, where the optical code is not the same as the address of every optical network unit (ONU); rather, the code is a virtual fiber of hybrid passive optical network (PON). To our knowledge, this is the first report analyzing a single encoder/decoder with a single corresponding optical code being exploited to encode/decode multiple wavelength signals simultaneously. This system enables OCDM to become transparent to ONU so that the existing wavelength division multiplexing (WDM) PON can be upgraded. Thus, redesigning the optical line terminal and ONU can be easily accomplished, and greatly decreasing the number of encoder/decoder becomes possible. In experiment, we only employ two encoder/decoder pairs to combine two WDM-PONs in one fiber. Simulation results confirm the feasibility of the proposed system.展开更多
Multiple access interference (MAI) is the most serious interference in spectral phase encoding optical code division multiple access (SPE OCDMA) systems. This paper focuses on the behavior of MAI in SPE OCDMA systems ...Multiple access interference (MAI) is the most serious interference in spectral phase encoding optical code division multiple access (SPE OCDMA) systems. This paper focuses on the behavior of MAI in SPE OCDMA systems with pseudorandom coding. The statistical expectation of multi access interference (MAI) is derived and plotted. The results confirm that MAI can be suppressed effectively by pseudorandom coding with m sequences.展开更多
Optical reservoir computing(ORC)offers advantages,such as high computational speed,low power consumption,and high training speed,so it has become a competitive candidate for time series analysis in recent years.The cu...Optical reservoir computing(ORC)offers advantages,such as high computational speed,low power consumption,and high training speed,so it has become a competitive candidate for time series analysis in recent years.The current ORC employs single-dimensional encoding for computation,which limits input resolution and introduces extraneous information due to interactions between optical dimensions during propagation,thus constraining performance.Here,we propose complex-value encoding-based optoelectronic reservoir computing(CE-ORC),in which the amplitude and phase of the input optical field are both modulated to improve the input resolution and prevent the influence of extraneous information on computation.In addition,scale factors in the amplitude encoding can fine-tune the optical reservoir dynamics for better performance.We built a CE-ORC processing unit with an iteration rate of up to∼1.2 kHz using high-speed communication interfaces and field programmable gate arrays(FPGAs)and demonstrated the excellent performance of CE-ORC in two time series prediction tasks.In comparison with the conventional ORC for the Mackey–Glass task,CE-ORC showed a decrease in normalized mean square error by∼75%.Furthermore,we applied this method in a weather time series analysis and effectively predicted the temperature and humidity within a range of 24 h.展开更多
Computational optics introduces computation into optics and consequently helps overcome traditional optical limitations such as low sensing dimension,low light throughput,low resolution,and so on.The combination of op...Computational optics introduces computation into optics and consequently helps overcome traditional optical limitations such as low sensing dimension,low light throughput,low resolution,and so on.The combination of optical encoding and computational decoding offers enhanced imaging and sensing capabilities with diverse applications in biomedicine,astronomy,agriculture,etc.With the great advance of artificial intelligence in the last decade,deep learning has further boosted computational optics with higher precision and efficiency.Recently,there developed an end-to-end joint optimization technique that digitally twins optical encoding to neural network layers,and then facilitates simultaneous optimization with the decoding process.This framework offers effective performance enhancement over conventional techniques.However,the reverse physical twinning from optimized encoding parameters to practical modulation elements faces a serious challenge,due to the discrepant gap in such as bit depth,numerical range,and stability.In this regard,this review explores various optical modulation elements across spatial,phase,and spectral dimensions in the digital twin model for joint encoding-decoding optimization.Our analysis offers constructive guidance for finding the most appropriate modulation element in diverse imaging and sensing tasks concerning various requirements of precision,speed,and robustness.The review may help tackle the above twinning challenge and pave the way for next-generation computational optics.展开更多
文摘Fluorescent probes have revolutionized optical imaging and biosensing by enabling real-time visualization, quantification, and tracking of biological processes at molecular and cellular levels. These probes, ranging from organic dyes to genetically encoded proteins and nanomaterials, provide unparalleled specificity, sensitivity, and multiplexing capabilities. However, challenges such as brightness, photobleaching, biocompatibility, and emission range continue to drive innovation in probe design and application. This special issue, comprising four review papers and seven original research studies, highlights cutting-edge advancements in fluorescent probe technologies and their transformative roles in super-resolution imaging, in vivo diagnostics, and cancer therapeutics.
基金the 2012 Shanghai Jiao Tong University and University of Michigan Collaborative Research Projects(No.12X120010007)the National High Technology Research and Development Program(863) of China(No.2012AA020103)+1 种基金the Shanghai Nano Program(No.11nm0505600)the Shanghai Jiao Tong University Funding(No.YG2012ZD03)
文摘New initiatives put forward by clinical diagnosis require the development of technologies for high throughput screening(HTS) of multiple analytes. Suspension arrays have great advantages over the planar arraybased multiplexing assays, and the encoded bead is the key for providing multiplexing capability. Among various encoding strategies, optically encoded microspheres have been widely used while the number of codes is still limited. This review discusses the progress of optical encoding strategy from mainly three aspects, namely organic dyes, quantum dots(QDs) and surface-enhanced Raman scattering(SERS) active substrates. Emphases are put up on describing how these optical encoded microbeads are manufactured and the merits and demerits of different encoding materials are compared.
文摘Various designed circuits for multiple-valued all-optical arithmetic are demonstrated. The terahertz-optical-asymmetric-demultiplexer (TOAD) switch is used as the basic structure unit in the proposed circuits due to its compact size, thermal stability, and low power operation. The designs of trinary and quaternary signed-digit numbers based adders are presented using different polarized states of light. These proposed polarization-encoded based adders use much less switches and their speeds are higher than the intensity-encoded counterparts. Further, it will be shown that one of the proposed trinary signed-digit adders is twice as fast as a recently reported modified signed-digit adder.
基金Supported by National Natural Science Foundation of China(Grant No.51575438)China Postdoctoral Science Foundation(Grant Nos.2017M623159,2018T111046)Shaanxi Provincial Postdoctoral Science Foundation of China(Grant No.2017BSHEDZZ68)
文摘Considerable studies have been carried out on fault diagnosis of gears, with most of them concentrated on conventional vibration analysis. However, besides the complexity of gear dynamics, the diagnosis results in terms of vibration signal are easily misjudged owing to the interference of sensor position or other components. In this paper, an alternative gearbox fault detection method based on the instantaneous rotational speed is proposed because of its advantages over vibration analysis. Depending on the timer/counter-based method for the pulse signal of the optical encoder, the varying rotational speed can be obtained e ectively. Owing to the coupling and meshing of gears in transmission, the excitations are the same for the instantaneous rotational speed of the input and output shafts. Thus, the di erential signal of instantaneous rotational speeds can be adopted to eliminate the e ect of the interference excitations and extract the associated feature of the localized fault e ectively. With the experiments on multistage gearbox test system, the di erential signal of instantaneous speeds is compared with other signals. It is proved that localized faults in the gearbox generate small angular speed fluctuations, which are measurable with an optical encoder. Using the di erential signal of instantaneous speeds, the fault characteristics are extracted in the spectrum where the deterministic frequency component and its harmonics corresponding to crack fault characteristics are displayed clearly.
基金financial supports from the National Natural Science Foundation of China(NSFC)(62061136005,61705141,61805152,61875129,61701321)Sino-German Research Collaboration Group(GZ 1391)+2 种基金the Mobility program(M-0044)sponsored by the Sino-German CenterChinese Academy of Sciences(QYZDB-SSW-JSC002)Science and Technology Innovation Commission of Shenzhen(JCYJ20170817095047279)。
文摘Optical cryptanalysis is essential to the further investigation of more secure optical cryptosystems.Learning-based at-tack of optical encryption eliminates the need for the retrieval of random phase keys of optical encryption systems but it is limited for practical applications since it requires a large set of plaintext-ciphertext pairs for the cryptosystem to be at-tacked.Here,we propose a two-step deep learning strategy for ciphertext-only attack(COA)on the classical double ran-dom phase encryption(DRPE).Specifically,we construct a virtual DRPE system to gather the training data.Besides,we divide the inverse problem in COA into two more specific inverse problems and employ two deep neural networks(DNNs)to respectively learn the removal of speckle noise in the autocorrelation domain and the de-correlation operation to retrieve the plaintext image.With these two trained DNNs at hand,we show that the plaintext can be predicted in real-time from an unknown ciphertext alone.The proposed learning-based COA method dispenses with not only the retrieval of random phase keys but also the invasive data acquisition of plaintext-ciphertext pairs in the DPRE system.Numerical simulations and optical experiments demonstrate the feasibility and effectiveness of the proposed learning-based COA method.
基金Supported by the Natural Science Research Foundation of Jiangsu Higher-Learning Insti-tution (No.04jkb510057).
文摘The encoding/decoding scheme based on Fiber Bragg Grating (FBG) for Optical Code Division Multiple Access (OCDMA) system is analyzed and the whole process from transmitting end to receiving end is researched in detail. The mathematical mode including signal transmission, summing, receiving and recovering are established respectively. One of the main sources of Bit Error Rate (BER) of OCDMA system based on FBGs is the unevenness of signal power spectrum, which leads to the chip powers unequal with each other. The Signal to Interfere Ratio (SIR) and BER performance of the system are studied and simulated at the case with uneven distribution of chips' powers.
文摘In this paper, we discuss and analyze an optical code division multiple access for multiple user system. Media access control implementation has been considered. For fulfilling the huge need of bandwidth services, technology tends to move to optical networks and three major optical systems come into existence. Code division of the optical network is most used and real concept interacted with users up to this time. Optical code division multiple access provides complete spectrum to each and every user for the time of accessing the channel. In the paper, we have proposed network architecture with optical encoder and decoder along with optical code translator which is supporting multiple user systems. We integrate the code translator with encoding and decoding of optical code to use the optical network at full extent and present the simulation validation results of 6 Gb/s 3-hop transmission by use of proposed architecture. Further, we have implemented experimentation with 6 users 3 Gb/s optical code division multiple access network. Through simulation structure, it is shown that the combination of encoding with EDFA in multiple user environment system provides improvement in bit error rate and also improves the multiple access interference. With increase of users in the network, MAI value increases and our proposed scheme controls interference in the network.
文摘In this paper, the operation principle of laser rotary encoders is expounded and the optical quadruple frequency technology used in laser rotary encoders is explained, and the design idea of optical system in φ66 mm laser rotary encoder is mainly introduced, as well as the choice of principal devices.
基金Supported by the High Technology Research and Development Programme of ChinaCao Guangbiao High Technology Foundation
文摘In this paper a simple scheme for optical implementation of human-face recognition with only an incoherent optical correlator is presented. The system uses complementary-encoding hit-or-miss transform method to improve the performance of the standard correlator. According to this method, a compact optical system for human-face optical recognition is bult up. In the face library 200 photographs are stored and the recognition speed of the system is 10 frames per second. The accuracy of recognition is more than 90 percent. The system has good fault-tolerance ability for the pictures with rotation distortion, Gauss noise disturbance or information losing.
基金supported by the National Natural Science Foundation of China(Nos.12374345,U24A20103,12404358,and 12304309)the Natural Science Foundation of Zhejiang Province(Nos.LZ26E010002 and LQN25A040010)+2 种基金the Key R&D Project of Zhejiang Province(No.2024C03258)the Fundamental Research Funds for the Provincial Universities of Zhejiang(No.GK259909299001-310)the Hong Kong Joint Laboratory for Preparation and Application of Ordered Structural Materials of Guangdong Province(No.2023B1212120011).
文摘Metal-semiconductor plasmonic metasurfaces enable precise optical field manipulation at the subwavelength scale;however,most existing designs rely on external fields and exhibit only binary responses,thereby restricting the realization of multistate logic operations.Here,we present an in-situ polarization-controlled approach based on an Au-indium tin oxide(ITO)bilayer nanocrescent with a Schottky heterojunction for achieving polarization-dependent tristate optical modulation.Polarization-selective excitation of distinct localized plasmon modes facilitates directional hot-electron injection across the Au-ITO interface,thereby producing three distinct programmable states—positive,zero,and negative—at a single detection wavelength.This symmetric bilayer design is applicable to other metal-semiconductor composites and offers generalizable design principles for ternary logic,multistate optical encoding,and ultrafast photonic information processing.The proposed concept is validated through both experimental measurements and numerical simulations.
基金supported by the National Natural Science Fundation of China(Nos.60972032 and 60632010)the National"863"Project of China(Nos. 2006AA01Z251 and 2007AA01Z271)
文摘A hybrid wavelength division multiple access (WDMA)/optical code division multiplexing (OCDM) system is proposed, where the optical code is not the same as the address of every optical network unit (ONU); rather, the code is a virtual fiber of hybrid passive optical network (PON). To our knowledge, this is the first report analyzing a single encoder/decoder with a single corresponding optical code being exploited to encode/decode multiple wavelength signals simultaneously. This system enables OCDM to become transparent to ONU so that the existing wavelength division multiplexing (WDM) PON can be upgraded. Thus, redesigning the optical line terminal and ONU can be easily accomplished, and greatly decreasing the number of encoder/decoder becomes possible. In experiment, we only employ two encoder/decoder pairs to combine two WDM-PONs in one fiber. Simulation results confirm the feasibility of the proposed system.
基金Fund of Science and Technology Develop-ment of Shanghai(No.0 0 JC14 0 5 4
文摘Multiple access interference (MAI) is the most serious interference in spectral phase encoding optical code division multiple access (SPE OCDMA) systems. This paper focuses on the behavior of MAI in SPE OCDMA systems with pseudorandom coding. The statistical expectation of multi access interference (MAI) is derived and plotted. The results confirm that MAI can be suppressed effectively by pseudorandom coding with m sequences.
基金the National Natural Science Foundation of China(Grant Nos.62375171,62305208,62205189,62105203,and 62405182)the Shanghai Pujiang Program(Grant No.22PJ1407500)+4 种基金the Oceanic Interdisciplinary Program of Shanghai Jiao Tong University(SJTU)(Grant No.SL2022ZD205)the National Key Research and Development Program of China(Grant No.2022YFC2806600)the Science Foundation of Donghai Laboratory(Grant Nos.DH-2022KF01001 and DH-2022KF01005)the Startup Fund for Young Faculty at SJTU(Grant No.24X010500120)the Science and Technology Commission of Shanghai Municipality(Grant No.20DZ2220400).
文摘Optical reservoir computing(ORC)offers advantages,such as high computational speed,low power consumption,and high training speed,so it has become a competitive candidate for time series analysis in recent years.The current ORC employs single-dimensional encoding for computation,which limits input resolution and introduces extraneous information due to interactions between optical dimensions during propagation,thus constraining performance.Here,we propose complex-value encoding-based optoelectronic reservoir computing(CE-ORC),in which the amplitude and phase of the input optical field are both modulated to improve the input resolution and prevent the influence of extraneous information on computation.In addition,scale factors in the amplitude encoding can fine-tune the optical reservoir dynamics for better performance.We built a CE-ORC processing unit with an iteration rate of up to∼1.2 kHz using high-speed communication interfaces and field programmable gate arrays(FPGAs)and demonstrated the excellent performance of CE-ORC in two time series prediction tasks.In comparison with the conventional ORC for the Mackey–Glass task,CE-ORC showed a decrease in normalized mean square error by∼75%.Furthermore,we applied this method in a weather time series analysis and effectively predicted the temperature and humidity within a range of 24 h.
基金supported by the National Natural Science Foundation of China(Nos.62131003,62322502,62088101)the Guangdong Province Key Laboratory of Intelligent Detection in Complex Environment of Aerospace,Land and Sea(No.2022KSYS016).
文摘Computational optics introduces computation into optics and consequently helps overcome traditional optical limitations such as low sensing dimension,low light throughput,low resolution,and so on.The combination of optical encoding and computational decoding offers enhanced imaging and sensing capabilities with diverse applications in biomedicine,astronomy,agriculture,etc.With the great advance of artificial intelligence in the last decade,deep learning has further boosted computational optics with higher precision and efficiency.Recently,there developed an end-to-end joint optimization technique that digitally twins optical encoding to neural network layers,and then facilitates simultaneous optimization with the decoding process.This framework offers effective performance enhancement over conventional techniques.However,the reverse physical twinning from optimized encoding parameters to practical modulation elements faces a serious challenge,due to the discrepant gap in such as bit depth,numerical range,and stability.In this regard,this review explores various optical modulation elements across spatial,phase,and spectral dimensions in the digital twin model for joint encoding-decoding optimization.Our analysis offers constructive guidance for finding the most appropriate modulation element in diverse imaging and sensing tasks concerning various requirements of precision,speed,and robustness.The review may help tackle the above twinning challenge and pave the way for next-generation computational optics.