Mason Reset(MR),a groundbreaking invention by Clesson E.Mason in 1930 that later became a part of“the universal approach to process control instrumentation”,is revisited in this paper and is shown to consists of thr...Mason Reset(MR),a groundbreaking invention by Clesson E.Mason in 1930 that later became a part of“the universal approach to process control instrumentation”,is revisited in this paper and is shown to consists of three actions:fast(errorcorrection),medium(negative feedback for expanded proportional band)and slow(reset for zero steady-state error).The focus of the paper is on the reset action,generated from a positive feedback loop,and its underlying principles with profound implications to our understanding and practice of automatic control,both basic and advanced.For example,we note that reset control and integral control,contrary to common belief,differ fundamentally in design principle and in practicality.Such difference comes to a head in the event of integrator windup:while reset windup is a problem of actuator saturation,the integrator windup is a runaway situation due to controller instability.In fact,there is no advantage gained in replacing MR with an integrator.In other words,one should not integrate the error directly as in standard PID,since doing so makes the closed-loop system internally unstable.With MR-based control formulated in this paper,there is no such threat of instability and,therefore,no need for any anti-windup mechanisms.Furthermore,the integral control is made scalable in this framework as a tradeoff between the steady-state accuracy and the controller stability.This leads to a novel MR-based control design,scalable in gain and in time to accommodate various process characteristics and design specifications.Simple in construction and transparent in principle,this MR-based control,as a basic framework of design,is readily deployable in scale.展开更多
Domain randomization is a widely adopted technique in deep reinforcement learning(DRL)to improve agent generalization by exposing policies to diverse environmental conditions.This paper investigates the impact of diff...Domain randomization is a widely adopted technique in deep reinforcement learning(DRL)to improve agent generalization by exposing policies to diverse environmental conditions.This paper investigates the impact of different reset strategies,normal,non-randomized,and randomized,on agent performance using the Deep Deterministic Policy Gradient(DDPG)and Twin Delayed DDPG(TD3)algorithms within the CarRacing-v2 environment.Two experimental setups were conducted:an extended training regime with DDPG for 1000 steps per episode across 1000 episodes,and a fast execution setup comparing DDPG and TD3 for 30 episodes with 50 steps per episode under constrained computational resources.A step-based reward scaling mechanism was applied under the randomized reset condition to promote broader state exploration.Experimental results showthat randomized resets significantly enhance learning efficiency and generalization,with DDPG demonstrating superior performance across all reset strategies.In particular,DDPG combined with randomized resets achieves the highest smoothed rewards(reaching approximately 15),best stability,and fastest convergence.These differences are statistically significant,as confirmed by t-tests:DDPG outperforms TD3 under randomized(t=−101.91,p<0.0001),normal(t=−21.59,p<0.0001),and non-randomized(t=−62.46,p<0.0001)reset conditions.The findings underscore the critical role of reset strategy and reward shaping in enhancing the robustness and adaptability of DRL agents in continuous control tasks,particularly in environments where computational efficiency and training stability are crucial.展开更多
Understanding the mechanisms of parent-daughter isotopic mobility at the nanoscale is key to rigorous interpretation of Ue The Pb data and associated dating. Until now, all nanoscale geochronological studies on geolog...Understanding the mechanisms of parent-daughter isotopic mobility at the nanoscale is key to rigorous interpretation of Ue The Pb data and associated dating. Until now, all nanoscale geochronological studies on geological samples have relied on either Transmission Electron Microscope(TEM) or Atom Probe Microscopy(APM) characterizations alone, thus suffering from the respective weaknesses of each technique. Here we focus on monazite crystals from a ~1 Ga, ultrahigh temperature granulite from Rogaland(Norway). This sample has recorded concordant UeP b dates(measured by LA-ICP-MS) that range over 100 My, with the three domains yielding distinct isotopic Ue Pb ages of 1034 ± 6 Ma(D1; Srich core), 1005 ± 7 Ma(D2), and 935 ± 7 Ma(D3), respectively. Combined APM and TEM characterization of these monazite crystals reveal phase separation that led to the isolation of two different radiogenic Pb(Pb*) reservoirs at the nanoscale. The S-rich core of these monazite crystals contains Cae Srich clusters, 5 -10 nm in size, homogenously distributed within the monazite matrix with a mean interparticle distance of 40 -60 nm. The clusters acted as a sink for radiogenic Pb(Pb*) produced in the monazite matrix, which was reset at the nanoscale via Pb diffusion while the grain remained closed at the micro-scale. Compared to the concordant ages given by conventional micro-scale dating of the grain,the apparent nano-scale age of the monazite matrix in between clusters is about 100 Myr younger, which compares remarkably well to the duration of the metamorphic event. This study highlights the capabilities of combined APM-TEM nano-structural and nano-isotopic characterizations in dating and timing of geological events, allowing the detection of processes untraceable with conventional dating methods.展开更多
In radiation measurement and digital nuclear spectrum systems,traditional nuclear signal processing circuits in nuclear electronics have been gradually replaced by digital algorithm modules with the application of hig...In radiation measurement and digital nuclear spectrum systems,traditional nuclear signal processing circuits in nuclear electronics have been gradually replaced by digital algorithm modules with the application of highperformance programmable hardware logic devices(such as FPGA or DSP).Referring to the digital realization method of inverse RC integral circuit systems,the function of the pole-zero cancellation(PZC)circuit was analyzed,a new modified cascade equivalent model of PZC was established,and the time-domain digital PZC(DPZC)recursive algorithm was derived in detail in this study.Two parameters kIand k_(D)are included in the new algorithm,where kIshould match the exponential decay time constant of the input signal to realize the pole-zero compensation,while the decay time constant of the output signal can be changed with the adjustable parameter k_(D)(which is larger than the decay time constant of the input signal).Based on the new DPZC algorithm module,two trapezoidal(triangular)shaping filters were designed and implemented.The amplitude–frequency characteristics of the output signal of the proposed trapezoidal shaping algorithm and the convolution trapezoidal shaping algorithm were compared,with fixed peaking time.The results show that the trapezoidal shaping algorithm based on DPZC can better suppress high-frequency noise.Finally,based on the Na I(Tl)scintillator(u75 mm×75 mm)detector and^(137)Cs source,the effect of the k_(D)value on the energy resolution of the DPZC trapezoidal(triangular)shaping algorithm was studied.The experimental results show that,with an increase in k_(D),the energy resolution of the system improved and reached the maximum when k_(D)was greater than 10,and the optimal energy resolution of the system was 7.72%.展开更多
InGaAs/InP avalanche photodiodes （APD） are rarely used in a free-running regime for near-infrared single photon detection. In order to overcome the detrimental afterpulsing, we demonstrate a passive quenching active...InGaAs/InP avalanche photodiodes （APD） are rarely used in a free-running regime for near-infrared single photon detection. In order to overcome the detrimental afterpulsing, we demonstrate a passive quenching active reset integrated circuit. Taking advantage of the inherent fast passive quenching process and active reset to reduce reset time, the integrated circuit is useful for reducing afterpulses and is also area-efficient. We investigate the free-running single photon detector＇s afterpulsing effect, de-trapping time, dark count rate, and photon detection efficiency, and also compare with gated regime operation. After correction for deadtime and afterpulse, we find that the passive quenching active reset free-running single photon detector＇s performance is consistent with gated operation.展开更多
A strike reset option is an option that allows its holder to reset the strike price to the prevailing underlying asset price at a moment chosen by the holder. The pricing model of the option can be formulated as a par...A strike reset option is an option that allows its holder to reset the strike price to the prevailing underlying asset price at a moment chosen by the holder. The pricing model of the option can be formulated as a parabolic variational inequality and the optimal reset strategy is the free boundary. The smoothness of the free boundary in some cases was showed in our article published in JDE. We would prove its smoothness in the other case in this paper by a generalized comparison principle for the variational inequality.展开更多
An optimized device structure for reducing the RESET current of phase-change random access memory （PCRAM） with blade-type like （BTL） phase change layer is proposed. The electrical thermal analysis of the BTL cell ...An optimized device structure for reducing the RESET current of phase-change random access memory （PCRAM） with blade-type like （BTL） phase change layer is proposed. The electrical thermal analysis of the BTL cell and the blade heater contactor structure by three-dimensional finite element modeling are compared with each other during RESET operation. The simulation results show that the programming region of the phase change layer in the BTL cell is much smaller, and thermal electrical distributions of the BTL cell are more concentrated on the TiN/GST interface. The results indicate that the BTL cell has the superiorities of increasing the heating efficiency, decreasing the power consumption and reducing the RESET current from 0.67mA to 0.32mA. Therefore, the BTL cell will be appropriate for high performance PCRAM device with lower power consumption and lower RESET current.展开更多
Presently,we develop a simplified corticothalamic(SCT)model and propose a single-pulse alternately resetting stimulation(SARS)with sequentially applying anodic(A,“+”)or cathodic(C,“−”)phase pulses to the thalamic ...Presently,we develop a simplified corticothalamic(SCT)model and propose a single-pulse alternately resetting stimulation(SARS)with sequentially applying anodic(A,“+”)or cathodic(C,“−”)phase pulses to the thalamic reticular(RE)nuclei,thalamus-cortex(TC)relay nuclei,and cortical excitatory(EX)neurons,respectively.Abatement effects of ACC-SARS of RE,TC,and EX for the 2 Hz-4 Hz spike and wave discharges(SWD)of absence seizures are then concerned.The m∶n on-off ACC-SARS protocol is shown to effectively reduce the SWD with the least current consumption.In particular,when its frequency is out of the 2 Hz-4 Hz SWD dominant rhythm,the desired seizure abatements can be obtained,which can be further improved by our proposed directional steering(DS)stimulation.The dynamical explanations for the SARS induced seizure abatements are lastly given by calculating the averaged mean firing rate(AMFR)of neurons and triggering averaged mean firing rates(TAMFRs)of 2 Hz-4 Hz SWD.展开更多
An on-chip power-on reset circuit with a brown-out detection capability is implemented in a 0. 18 μm CMOS. A pF-order capacitor is charged with a proportional-to-absolute-temperature （PTAT） current from a bandgap r...An on-chip power-on reset circuit with a brown-out detection capability is implemented in a 0. 18 μm CMOS. A pF-order capacitor is charged with a proportional-to-absolute-temperature （PTAT） current from a bandgap reference with limited loop bandwidth and slow start-up feature, to generate a reset signal with high robustness and wide-range supply rise time. An embedded brown- out detector based on complementary voltage-to-current （V-to-I） conversion and current comparison can accurately respond to the brown-out event with high robustness over process and temperature when the supply is lower than 1.5 V and the brown-out duration is longer than 0. 1 ms. The presented design with embedded offset voltage cancellation consumes a quiescent current of 8. 5 μA from a 1. 8 V supply and works over ambient temperature of -40° to 120°.展开更多
文摘Mason Reset(MR),a groundbreaking invention by Clesson E.Mason in 1930 that later became a part of“the universal approach to process control instrumentation”,is revisited in this paper and is shown to consists of three actions:fast(errorcorrection),medium(negative feedback for expanded proportional band)and slow(reset for zero steady-state error).The focus of the paper is on the reset action,generated from a positive feedback loop,and its underlying principles with profound implications to our understanding and practice of automatic control,both basic and advanced.For example,we note that reset control and integral control,contrary to common belief,differ fundamentally in design principle and in practicality.Such difference comes to a head in the event of integrator windup:while reset windup is a problem of actuator saturation,the integrator windup is a runaway situation due to controller instability.In fact,there is no advantage gained in replacing MR with an integrator.In other words,one should not integrate the error directly as in standard PID,since doing so makes the closed-loop system internally unstable.With MR-based control formulated in this paper,there is no such threat of instability and,therefore,no need for any anti-windup mechanisms.Furthermore,the integral control is made scalable in this framework as a tradeoff between the steady-state accuracy and the controller stability.This leads to a novel MR-based control design,scalable in gain and in time to accommodate various process characteristics and design specifications.Simple in construction and transparent in principle,this MR-based control,as a basic framework of design,is readily deployable in scale.
基金supported by the Deputyship for Research&Innovation,Ministry of Education in Saudi Arabia(Project No.MoE-IF-UJ-R2-22-04220773-1).
文摘Domain randomization is a widely adopted technique in deep reinforcement learning(DRL)to improve agent generalization by exposing policies to diverse environmental conditions.This paper investigates the impact of different reset strategies,normal,non-randomized,and randomized,on agent performance using the Deep Deterministic Policy Gradient(DDPG)and Twin Delayed DDPG(TD3)algorithms within the CarRacing-v2 environment.Two experimental setups were conducted:an extended training regime with DDPG for 1000 steps per episode across 1000 episodes,and a fast execution setup comparing DDPG and TD3 for 30 episodes with 50 steps per episode under constrained computational resources.A step-based reward scaling mechanism was applied under the randomized reset condition to promote broader state exploration.Experimental results showthat randomized resets significantly enhance learning efficiency and generalization,with DDPG demonstrating superior performance across all reset strategies.In particular,DDPG combined with randomized resets achieves the highest smoothed rewards(reaching approximately 15),best stability,and fastest convergence.These differences are statistically significant,as confirmed by t-tests:DDPG outperforms TD3 under randomized(t=−101.91,p<0.0001),normal(t=−21.59,p<0.0001),and non-randomized(t=−62.46,p<0.0001)reset conditions.The findings underscore the critical role of reset strategy and reward shaping in enhancing the robustness and adaptability of DRL agents in continuous control tasks,particularly in environments where computational efficiency and training stability are crucial.
基金Both UJM and CNRS (INSU TelluS-SYSTER) are thanked for financial support for AMSG and ATL. The Australian Resource Characterisation Facility (ARCF), under the auspices of the National Resource Sciences Precinct (NRSP) - a collaboration between CSIRO, Curtin University and The University of Western Australia e is supported by the Science and Industry Endowment Fund (SIEF RI13-01)
文摘Understanding the mechanisms of parent-daughter isotopic mobility at the nanoscale is key to rigorous interpretation of Ue The Pb data and associated dating. Until now, all nanoscale geochronological studies on geological samples have relied on either Transmission Electron Microscope(TEM) or Atom Probe Microscopy(APM) characterizations alone, thus suffering from the respective weaknesses of each technique. Here we focus on monazite crystals from a ~1 Ga, ultrahigh temperature granulite from Rogaland(Norway). This sample has recorded concordant UeP b dates(measured by LA-ICP-MS) that range over 100 My, with the three domains yielding distinct isotopic Ue Pb ages of 1034 ± 6 Ma(D1; Srich core), 1005 ± 7 Ma(D2), and 935 ± 7 Ma(D3), respectively. Combined APM and TEM characterization of these monazite crystals reveal phase separation that led to the isolation of two different radiogenic Pb(Pb*) reservoirs at the nanoscale. The S-rich core of these monazite crystals contains Cae Srich clusters, 5 -10 nm in size, homogenously distributed within the monazite matrix with a mean interparticle distance of 40 -60 nm. The clusters acted as a sink for radiogenic Pb(Pb*) produced in the monazite matrix, which was reset at the nanoscale via Pb diffusion while the grain remained closed at the micro-scale. Compared to the concordant ages given by conventional micro-scale dating of the grain,the apparent nano-scale age of the monazite matrix in between clusters is about 100 Myr younger, which compares remarkably well to the duration of the metamorphic event. This study highlights the capabilities of combined APM-TEM nano-structural and nano-isotopic characterizations in dating and timing of geological events, allowing the detection of processes untraceable with conventional dating methods.
基金supported by the National Natural Science Foundation of China(Nos.11975060,12005026,and 12075038)the Fund of Robot Technology Used for Special Environment Key Laboratory of Sichuan Province(No.19kftk02)。
文摘In radiation measurement and digital nuclear spectrum systems,traditional nuclear signal processing circuits in nuclear electronics have been gradually replaced by digital algorithm modules with the application of highperformance programmable hardware logic devices(such as FPGA or DSP).Referring to the digital realization method of inverse RC integral circuit systems,the function of the pole-zero cancellation(PZC)circuit was analyzed,a new modified cascade equivalent model of PZC was established,and the time-domain digital PZC(DPZC)recursive algorithm was derived in detail in this study.Two parameters kIand k_(D)are included in the new algorithm,where kIshould match the exponential decay time constant of the input signal to realize the pole-zero compensation,while the decay time constant of the output signal can be changed with the adjustable parameter k_(D)(which is larger than the decay time constant of the input signal).Based on the new DPZC algorithm module,two trapezoidal(triangular)shaping filters were designed and implemented.The amplitude–frequency characteristics of the output signal of the proposed trapezoidal shaping algorithm and the convolution trapezoidal shaping algorithm were compared,with fixed peaking time.The results show that the trapezoidal shaping algorithm based on DPZC can better suppress high-frequency noise.Finally,based on the Na I(Tl)scintillator(u75 mm×75 mm)detector and^(137)Cs source,the effect of the k_(D)value on the energy resolution of the DPZC trapezoidal(triangular)shaping algorithm was studied.The experimental results show that,with an increase in k_(D),the energy resolution of the system improved and reached the maximum when k_(D)was greater than 10,and the optimal energy resolution of the system was 7.72%.
基金supported by the National High Technology Research and Development Program of China(Grant No.2013AA122902)the National Key Scientific Instrument and Equipment Development Project of China(Grant No.2013YQ030595)the National Natural Science Foundation of China(Grant Nos.61274024 and 61474123)
文摘InGaAs/InP avalanche photodiodes （APD） are rarely used in a free-running regime for near-infrared single photon detection. In order to overcome the detrimental afterpulsing, we demonstrate a passive quenching active reset integrated circuit. Taking advantage of the inherent fast passive quenching process and active reset to reduce reset time, the integrated circuit is useful for reducing afterpulses and is also area-efficient. We investigate the free-running single photon detector＇s afterpulsing effect, de-trapping time, dark count rate, and photon detection efficiency, and also compare with gated regime operation. After correction for deadtime and afterpulse, we find that the passive quenching active reset free-running single photon detector＇s performance is consistent with gated operation.
基金supported by National Natural Science Foundation of China(10901060,10971073,1081056)Natural Science Foundation of Guangdong Province (9451063101002091)
文摘A strike reset option is an option that allows its holder to reset the strike price to the prevailing underlying asset price at a moment chosen by the holder. The pricing model of the option can be formulated as a parabolic variational inequality and the optimal reset strategy is the free boundary. The smoothness of the free boundary in some cases was showed in our article published in JDE. We would prove its smoothness in the other case in this paper by a generalized comparison principle for the variational inequality.
基金Supported by the Strategic Priority Research Program of the Chinese Academy of Sciences under Grant No XDA09020402the National Integrate Circuit Research Program of China under Grant No 2009ZX02023-003+1 种基金the National Natural Science Foundation of China under Grant Nos 61261160500,61376006,61401444 and 61504157the Science and Technology Council of Shanghai under Grant Nos 14DZ2294900,15DZ2270900 and 14ZR1447500
文摘An optimized device structure for reducing the RESET current of phase-change random access memory （PCRAM） with blade-type like （BTL） phase change layer is proposed. The electrical thermal analysis of the BTL cell and the blade heater contactor structure by three-dimensional finite element modeling are compared with each other during RESET operation. The simulation results show that the programming region of the phase change layer in the BTL cell is much smaller, and thermal electrical distributions of the BTL cell are more concentrated on the TiN/GST interface. The results indicate that the BTL cell has the superiorities of increasing the heating efficiency, decreasing the power consumption and reducing the RESET current from 0.67mA to 0.32mA. Therefore, the BTL cell will be appropriate for high performance PCRAM device with lower power consumption and lower RESET current.
基金Project supported by the National Natural Science Foundation of China(Nos.11702018,11932003,and 11672074)。
文摘Presently,we develop a simplified corticothalamic(SCT)model and propose a single-pulse alternately resetting stimulation(SARS)with sequentially applying anodic(A,“+”)or cathodic(C,“−”)phase pulses to the thalamic reticular(RE)nuclei,thalamus-cortex(TC)relay nuclei,and cortical excitatory(EX)neurons,respectively.Abatement effects of ACC-SARS of RE,TC,and EX for the 2 Hz-4 Hz spike and wave discharges(SWD)of absence seizures are then concerned.The m∶n on-off ACC-SARS protocol is shown to effectively reduce the SWD with the least current consumption.In particular,when its frequency is out of the 2 Hz-4 Hz SWD dominant rhythm,the desired seizure abatements can be obtained,which can be further improved by our proposed directional steering(DS)stimulation.The dynamical explanations for the SARS induced seizure abatements are lastly given by calculating the averaged mean firing rate(AMFR)of neurons and triggering averaged mean firing rates(TAMFRs)of 2 Hz-4 Hz SWD.
基金Supported by the National Natural Science Foundation of China(6130603761201182)
文摘An on-chip power-on reset circuit with a brown-out detection capability is implemented in a 0. 18 μm CMOS. A pF-order capacitor is charged with a proportional-to-absolute-temperature （PTAT） current from a bandgap reference with limited loop bandwidth and slow start-up feature, to generate a reset signal with high robustness and wide-range supply rise time. An embedded brown- out detector based on complementary voltage-to-current （V-to-I） conversion and current comparison can accurately respond to the brown-out event with high robustness over process and temperature when the supply is lower than 1.5 V and the brown-out duration is longer than 0. 1 ms. The presented design with embedded offset voltage cancellation consumes a quiescent current of 8. 5 μA from a 1. 8 V supply and works over ambient temperature of -40° to 120°.
