Domain randomization is a widely adopted technique in deep reinforcement learning(DRL)to improve agent generalization by exposing policies to diverse environmental conditions.This paper investigates the impact of diff...Domain randomization is a widely adopted technique in deep reinforcement learning(DRL)to improve agent generalization by exposing policies to diverse environmental conditions.This paper investigates the impact of different reset strategies,normal,non-randomized,and randomized,on agent performance using the Deep Deterministic Policy Gradient(DDPG)and Twin Delayed DDPG(TD3)algorithms within the CarRacing-v2 environment.Two experimental setups were conducted:an extended training regime with DDPG for 1000 steps per episode across 1000 episodes,and a fast execution setup comparing DDPG and TD3 for 30 episodes with 50 steps per episode under constrained computational resources.A step-based reward scaling mechanism was applied under the randomized reset condition to promote broader state exploration.Experimental results showthat randomized resets significantly enhance learning efficiency and generalization,with DDPG demonstrating superior performance across all reset strategies.In particular,DDPG combined with randomized resets achieves the highest smoothed rewards(reaching approximately 15),best stability,and fastest convergence.These differences are statistically significant,as confirmed by t-tests:DDPG outperforms TD3 under randomized(t=−101.91,p<0.0001),normal(t=−21.59,p<0.0001),and non-randomized(t=−62.46,p<0.0001)reset conditions.The findings underscore the critical role of reset strategy and reward shaping in enhancing the robustness and adaptability of DRL agents in continuous control tasks,particularly in environments where computational efficiency and training stability are crucial.展开更多
Human orofacial clefts (OFCs) are congenital anomalies that result from the breakdown of normal mechanisms that regulate the formation of the human face. They could be syndromic or non-syndromic, with a global inciden...Human orofacial clefts (OFCs) are congenital anomalies that result from the breakdown of normal mechanisms that regulate the formation of the human face. They could be syndromic or non-syndromic, with a global incidence of 1:700 per live births. Environmental and genetic factors are thought to play various roles in the aetiology of OFCs. This study seeks to establish the diversity, distribution and pattern of inheritance of OFCs as well as environmental and other risk factors associated with OFCs in a Ghanaian population. A family-based, descriptive cross-sectional study that employed an interview-based survey questionnaire was used to obtain information from 467 families with history of OFCs. We employed chi-square statistics to analyse the data and used graphs to interpret the data. All previously reported subphenotypes of OFCs were observed by the present study. Clinically, about 12% of clefts in the study population were syndromic. The most common syndromic forms observed were Pierre Robin Sequence, cleft-with-club foot abnormalities and Van der Woude Syndrome. Only about 5% of clefts in the study cohort were familial. The study also established that lower level of education of parents, poverty, late antenatal care and dietary folate deficiency are major environmental factors associated with clefts in the Ghanaian population. In conclusion, OFCs are non-randomly distributed in Ghana and folate deficiency could likely be a source of genetic mutations and “epimutations” that cause OFCs, since folate is essential for DNA methylation, replication and repair as well as histone modification.展开更多
Objective:Acute ischemic stroke(AIS)is characterized by high morbidity and high mortality.In recent years,complementary and alternative medicine has gradually been widely accepted and applied.At present,traditional Ch...Objective:Acute ischemic stroke(AIS)is characterized by high morbidity and high mortality.In recent years,complementary and alternative medicine has gradually been widely accepted and applied.At present,traditional Chinese medicine therapy and standard treatments are used for the treatment of AIS.Xingnao-Jianshen prescriptions(XNJS)is an effective prescription for the clinical treatment of AIS,but there is a lack of large-scale clinical evidence to confirm its clinical efficacy.Therefore,our team designed this protocol to evaluate the initial therapeutic effect of XNJS.Methods:The protocol for a non-randomized controlled trial is designed in which 72 eligible patients will be allocated to one of two groups.The control group(n=36)will receive standard treatment for AIS,the test group(n=36)will receive XNJS and standard treatment.Patients will be recruited after stroke onset and will receive the intervention continuously over 10±1 days,with a follow-up period of 90 days.The primary outcome will be the change in the NIHSS,BI,mRS scores.All outcome measures will be assessed at inception,after the intervention(10±1 days),and at the follow-up(90 days).The results will be disseminated to the public through peerreviewed journals and academic conferences.Discussion:The study will provide evidence of the preliminary effects.展开更多
在实际工作过程中,电动挖掘机所承受的载荷往往表现出显著的非平稳随机特性,导致电动挖掘机电池包振动现象十分复杂,从而直接影响电池包的安全、可靠运行。针对这一问题,探究了复杂工况下电动挖掘机所承受的路面激励、柱塞泵压力脉动激...在实际工作过程中,电动挖掘机所承受的载荷往往表现出显著的非平稳随机特性,导致电动挖掘机电池包振动现象十分复杂,从而直接影响电池包的安全、可靠运行。针对这一问题,探究了复杂工况下电动挖掘机所承受的路面激励、柱塞泵压力脉动激励和冲击激励特性,分析了各种激励下的振动传递路径,建立了电动挖掘机电池包的动力学模型,揭示了非平稳随机激励下电池包的振动特性,并通过实例进行了分析和验证。研究表明,基于小波变换及灰狼优化-变分模态分解(Grey Wolf Optimization-Variational Mode Decomposition,GWO-VMD)信号分析算法对路面激励信号进行重构,能够较好地反映路面激励特性;行驶工况下电动挖掘机所承受的路面激励具有显著的非平稳特性;在路面激励等非平稳随机激励作用下,电动挖掘机电池包产生复杂多变的振动,其动态响应的功率谱密度随时间变化显著,具有明显的非平稳随机特性。研究工作为电动挖掘机电池包的安全、可靠运行提供了一定的参考。展开更多
Objective: The purpose of this study was to evaluate health education using videos and leaflets for preconception care (PCC) awareness among adolescent females up to six months after the health education. Methods: The...Objective: The purpose of this study was to evaluate health education using videos and leaflets for preconception care (PCC) awareness among adolescent females up to six months after the health education. Methods: The subjects were female university students living in the Kinki area. A longitudinal survey was conducted on 67 members in the intervention group, who received the health education, and 52 members in the control group, who did not receive the health education. The primary outcome measures were knowledge of PCC and the subscales of the Health Promotion Lifestyle Profile. Surveys were conducted before, after, and six months after the intervention in the intervention group, and an initial survey and survey six months later were conducted in the control group. Cochran’s Q test, Bonferroni’s multiple comparison test, and McNemar’s test were used to analyze the knowledge of PCC data. The Health Awareness, Nutrition, and Stress Management subscales of the Health Promotion Lifestyle Profile were analyzed by paired t-test, and comparisons between the intervention and control groups were performed using the two-way repeated measures analysis of variance. Results: In the intervention group of 67 people, the number of subjects who answered “correct” for five of the nine items concerning knowledge of PCC increased immediately after the health education (P = 0.006) but decreased for five items from immediately after the health education to six months later (P = 0.043). In addition, the number of respondents who answered “correct” for “low birth weight infants and future lifestyle-related diseases” (P = 0.016) increased after six months compared with before the health education. For the 52 subjects in the control group, there was no change in the number of subjects who answered “correct” for eight out of the nine items after six months. There was also no increase in scores for the Health Promotion Lifestyle Profile after six months for either the intervention or control group. Conclusion: Providing health education about PCC using videos and leaflets to adolescent females was shown to enhance the knowledge of PCC immediately after the education.展开更多
The security of information transmission and processing due to unknown vulnerabilities and backdoors in cyberspace is becoming increasingly problematic.However,there is a lack of effective theory to mathematically dem...The security of information transmission and processing due to unknown vulnerabilities and backdoors in cyberspace is becoming increasingly problematic.However,there is a lack of effective theory to mathematically demonstrate the security of information transmission and processing under nonrandom noise(or vulnerability backdoor attack)conditions in cyberspace.This paper first proposes a security model for cyberspace information transmission and processing channels based on error correction coding theory.First,we analyze the fault tolerance and non-randomness problem of Dynamic Heterogeneous Redundancy(DHR)structured information transmission and processing channel under the condition of non-random noise or attacks.Secondly,we use a mathematical statistical method to demonstrate that for non-random noise(or attacks)on discrete memory channels,there exists a DHR-structured channel and coding scheme that enables the average system error probability to be arbitrarily small.Finally,to construct suitable coding and heterogeneous channels,we take Turbo code as an example and simulate the effects of different heterogeneity,redundancy,output vector length,verdict algorithm and dynamism on the system,which is an important guidance for theory and engineering practice.展开更多
Objective: To evaluate the effect and safety of acupuncture therapy on patients with moderate to severe allergic rhinitis. Methods: A non-randomized controlled design was used to compare between the acupuncture grou...Objective: To evaluate the effect and safety of acupuncture therapy on patients with moderate to severe allergic rhinitis. Methods: A non-randomized controlled design was used to compare between the acupuncture group and the medication group. The acupuncture group received 8-week acupuncture therapy, and the medication group received budesonide nasal spray with cetirizine tablets for 8 weeks. The clinical symptoms and signs were analyzed before treatment, at 4 and 8 weeks after the start of treatment, and at 12 weeks after the end of treatment. Furthermore, the clinical efficacy and safety indicators were compared between the two groups. Results: A total of 76 participants consisting of 38 in each of the two groups were enrolled. The scores of each clinical symptom and sign, including sneezing, runny nose, stuffy nose, nasal itching, and turbinate edema, and the total scores decreased over time in both groups (all P〈0.05); and no difference was found in the scores between the two groups (P〉0.05). There was no statistically significant difference in the effective rates of the acupuncture group at 4 and 8 weeks after the start of treatment as well as at 12-week follow-up compared with those of the medication group (83.3% vs. 91.2%, and 94.4 % vs. 85.3%; and 80.6 % vs. 82.4%, all P〉0.05). Experimental items including blood routine, urine routine, aspartate transaminase, alanine aminotransferase, urea nitrogen and creatinine were all in the normal reference ranges during the treatment in the acupuncture group. Conclusions: Acupuncture therapy has a comparable effect to the medication treatment on patients with moderate to severe allergic rhinitis, and it is safe with no severe adverse effects.展开更多
基金supported by the Deputyship for Research&Innovation,Ministry of Education in Saudi Arabia(Project No.MoE-IF-UJ-R2-22-04220773-1).
文摘Domain randomization is a widely adopted technique in deep reinforcement learning(DRL)to improve agent generalization by exposing policies to diverse environmental conditions.This paper investigates the impact of different reset strategies,normal,non-randomized,and randomized,on agent performance using the Deep Deterministic Policy Gradient(DDPG)and Twin Delayed DDPG(TD3)algorithms within the CarRacing-v2 environment.Two experimental setups were conducted:an extended training regime with DDPG for 1000 steps per episode across 1000 episodes,and a fast execution setup comparing DDPG and TD3 for 30 episodes with 50 steps per episode under constrained computational resources.A step-based reward scaling mechanism was applied under the randomized reset condition to promote broader state exploration.Experimental results showthat randomized resets significantly enhance learning efficiency and generalization,with DDPG demonstrating superior performance across all reset strategies.In particular,DDPG combined with randomized resets achieves the highest smoothed rewards(reaching approximately 15),best stability,and fastest convergence.These differences are statistically significant,as confirmed by t-tests:DDPG outperforms TD3 under randomized(t=−101.91,p<0.0001),normal(t=−21.59,p<0.0001),and non-randomized(t=−62.46,p<0.0001)reset conditions.The findings underscore the critical role of reset strategy and reward shaping in enhancing the robustness and adaptability of DRL agents in continuous control tasks,particularly in environments where computational efficiency and training stability are crucial.
文摘Human orofacial clefts (OFCs) are congenital anomalies that result from the breakdown of normal mechanisms that regulate the formation of the human face. They could be syndromic or non-syndromic, with a global incidence of 1:700 per live births. Environmental and genetic factors are thought to play various roles in the aetiology of OFCs. This study seeks to establish the diversity, distribution and pattern of inheritance of OFCs as well as environmental and other risk factors associated with OFCs in a Ghanaian population. A family-based, descriptive cross-sectional study that employed an interview-based survey questionnaire was used to obtain information from 467 families with history of OFCs. We employed chi-square statistics to analyse the data and used graphs to interpret the data. All previously reported subphenotypes of OFCs were observed by the present study. Clinically, about 12% of clefts in the study population were syndromic. The most common syndromic forms observed were Pierre Robin Sequence, cleft-with-club foot abnormalities and Van der Woude Syndrome. Only about 5% of clefts in the study cohort were familial. The study also established that lower level of education of parents, poverty, late antenatal care and dietary folate deficiency are major environmental factors associated with clefts in the Ghanaian population. In conclusion, OFCs are non-randomly distributed in Ghana and folate deficiency could likely be a source of genetic mutations and “epimutations” that cause OFCs, since folate is essential for DNA methylation, replication and repair as well as histone modification.
基金Changchun Science and Technology Development Project(No.21ZGM32)Natural Science Foundation of Jilin Province(No.20200201412JC).All funds conflict-free.
文摘Objective:Acute ischemic stroke(AIS)is characterized by high morbidity and high mortality.In recent years,complementary and alternative medicine has gradually been widely accepted and applied.At present,traditional Chinese medicine therapy and standard treatments are used for the treatment of AIS.Xingnao-Jianshen prescriptions(XNJS)is an effective prescription for the clinical treatment of AIS,but there is a lack of large-scale clinical evidence to confirm its clinical efficacy.Therefore,our team designed this protocol to evaluate the initial therapeutic effect of XNJS.Methods:The protocol for a non-randomized controlled trial is designed in which 72 eligible patients will be allocated to one of two groups.The control group(n=36)will receive standard treatment for AIS,the test group(n=36)will receive XNJS and standard treatment.Patients will be recruited after stroke onset and will receive the intervention continuously over 10±1 days,with a follow-up period of 90 days.The primary outcome will be the change in the NIHSS,BI,mRS scores.All outcome measures will be assessed at inception,after the intervention(10±1 days),and at the follow-up(90 days).The results will be disseminated to the public through peerreviewed journals and academic conferences.Discussion:The study will provide evidence of the preliminary effects.
文摘在实际工作过程中,电动挖掘机所承受的载荷往往表现出显著的非平稳随机特性,导致电动挖掘机电池包振动现象十分复杂,从而直接影响电池包的安全、可靠运行。针对这一问题,探究了复杂工况下电动挖掘机所承受的路面激励、柱塞泵压力脉动激励和冲击激励特性,分析了各种激励下的振动传递路径,建立了电动挖掘机电池包的动力学模型,揭示了非平稳随机激励下电池包的振动特性,并通过实例进行了分析和验证。研究表明,基于小波变换及灰狼优化-变分模态分解(Grey Wolf Optimization-Variational Mode Decomposition,GWO-VMD)信号分析算法对路面激励信号进行重构,能够较好地反映路面激励特性;行驶工况下电动挖掘机所承受的路面激励具有显著的非平稳特性;在路面激励等非平稳随机激励作用下,电动挖掘机电池包产生复杂多变的振动,其动态响应的功率谱密度随时间变化显著,具有明显的非平稳随机特性。研究工作为电动挖掘机电池包的安全、可靠运行提供了一定的参考。
文摘Objective: The purpose of this study was to evaluate health education using videos and leaflets for preconception care (PCC) awareness among adolescent females up to six months after the health education. Methods: The subjects were female university students living in the Kinki area. A longitudinal survey was conducted on 67 members in the intervention group, who received the health education, and 52 members in the control group, who did not receive the health education. The primary outcome measures were knowledge of PCC and the subscales of the Health Promotion Lifestyle Profile. Surveys were conducted before, after, and six months after the intervention in the intervention group, and an initial survey and survey six months later were conducted in the control group. Cochran’s Q test, Bonferroni’s multiple comparison test, and McNemar’s test were used to analyze the knowledge of PCC data. The Health Awareness, Nutrition, and Stress Management subscales of the Health Promotion Lifestyle Profile were analyzed by paired t-test, and comparisons between the intervention and control groups were performed using the two-way repeated measures analysis of variance. Results: In the intervention group of 67 people, the number of subjects who answered “correct” for five of the nine items concerning knowledge of PCC increased immediately after the health education (P = 0.006) but decreased for five items from immediately after the health education to six months later (P = 0.043). In addition, the number of respondents who answered “correct” for “low birth weight infants and future lifestyle-related diseases” (P = 0.016) increased after six months compared with before the health education. For the 52 subjects in the control group, there was no change in the number of subjects who answered “correct” for eight out of the nine items after six months. There was also no increase in scores for the Health Promotion Lifestyle Profile after six months for either the intervention or control group. Conclusion: Providing health education about PCC using videos and leaflets to adolescent females was shown to enhance the knowledge of PCC immediately after the education.
基金supported by National Key R&D Program of China for Young Scientists:Cyberspace Endogenous Security Mechanisms and Evaluation Methods(No.2022YFB3102800).
文摘The security of information transmission and processing due to unknown vulnerabilities and backdoors in cyberspace is becoming increasingly problematic.However,there is a lack of effective theory to mathematically demonstrate the security of information transmission and processing under nonrandom noise(or vulnerability backdoor attack)conditions in cyberspace.This paper first proposes a security model for cyberspace information transmission and processing channels based on error correction coding theory.First,we analyze the fault tolerance and non-randomness problem of Dynamic Heterogeneous Redundancy(DHR)structured information transmission and processing channel under the condition of non-random noise or attacks.Secondly,we use a mathematical statistical method to demonstrate that for non-random noise(or attacks)on discrete memory channels,there exists a DHR-structured channel and coding scheme that enables the average system error probability to be arbitrarily small.Finally,to construct suitable coding and heterogeneous channels,we take Turbo code as an example and simulate the effects of different heterogeneity,redundancy,output vector length,verdict algorithm and dynamism on the system,which is an important guidance for theory and engineering practice.
基金Supported by the Key Project of Zhejiang Province Pharmaceutical Administration,China(No.2010ZZ001)Key Disciplines in Integrative Medicine of Zhejiang Province,China(No.2012-XK-A04)
文摘Objective: To evaluate the effect and safety of acupuncture therapy on patients with moderate to severe allergic rhinitis. Methods: A non-randomized controlled design was used to compare between the acupuncture group and the medication group. The acupuncture group received 8-week acupuncture therapy, and the medication group received budesonide nasal spray with cetirizine tablets for 8 weeks. The clinical symptoms and signs were analyzed before treatment, at 4 and 8 weeks after the start of treatment, and at 12 weeks after the end of treatment. Furthermore, the clinical efficacy and safety indicators were compared between the two groups. Results: A total of 76 participants consisting of 38 in each of the two groups were enrolled. The scores of each clinical symptom and sign, including sneezing, runny nose, stuffy nose, nasal itching, and turbinate edema, and the total scores decreased over time in both groups (all P〈0.05); and no difference was found in the scores between the two groups (P〉0.05). There was no statistically significant difference in the effective rates of the acupuncture group at 4 and 8 weeks after the start of treatment as well as at 12-week follow-up compared with those of the medication group (83.3% vs. 91.2%, and 94.4 % vs. 85.3%; and 80.6 % vs. 82.4%, all P〉0.05). Experimental items including blood routine, urine routine, aspartate transaminase, alanine aminotransferase, urea nitrogen and creatinine were all in the normal reference ranges during the treatment in the acupuncture group. Conclusions: Acupuncture therapy has a comparable effect to the medication treatment on patients with moderate to severe allergic rhinitis, and it is safe with no severe adverse effects.