We employed random distributions and gradient descent methods for the Generator Coordinate Method(GCM)to identify effective basis wave functions,taking halo nuclei ^(6)He and ^(6)Li as examples.By comparing the ground...We employed random distributions and gradient descent methods for the Generator Coordinate Method(GCM)to identify effective basis wave functions,taking halo nuclei ^(6)He and ^(6)Li as examples.By comparing the ground state(0^(+))energy of ^(6)He and the excited state(0^(+))energy of 6 Li calculated with various random distributions and manually selected generation coordinates,we found that the heavy tail characteristic of the logistic distribution better describes the features of the halo nuclei.Subsequently,the Adam algorithm from machine learning was applied to optimize the basis wave functions,indicating that a limited number of basis wave functions can approximate the converged values.These results offer some empirical insights for selecting basis wave functions and contribute to the broader application of machine learning methods in predicting effective basis wave functions.展开更多
This paper proposes a multi-objective index-based approach to optimally determine the size and location of multi-distributed generators (DG) units in distribution system with different load models. It is shown that lo...This paper proposes a multi-objective index-based approach to optimally determine the size and location of multi-distributed generators (DG) units in distribution system with different load models. It is shown that load models can significantly affect the optimal location and sizing of DG resources in distribution systems. The proposed multi-objective function to be optimized includes a short circuit level parameter to represent the protective device requirements. The proposed function also considers a wide range of technical issues such as active and reactive power losses of the system, the voltage profile, the line loading and the MVA intake by the grid. The optimization technique based on particle swarm optimization (PSO) is introduced. The analysis of continuation power flow to determine the effect of DG units on the most sensitive buses to voltage collapse is carried out. The proposed algorithm is tested using the 38-bus radial system and the IEEE 30-bus meshed system. The results show the effectiveness of the proposed algorithm.展开更多
Large language models(LLMs)have undergone significant expansion and have been increasingly integrated across various domains.Notably,in the realm of robot task planning,LLMs harness their advanced reasoning and langua...Large language models(LLMs)have undergone significant expansion and have been increasingly integrated across various domains.Notably,in the realm of robot task planning,LLMs harness their advanced reasoning and language comprehension capabilities to formulate precise and efficient action plans based on natural language instructions.However,for embodied tasks,where robots interact with complex environments,textonly LLMs often face challenges due to a lack of compatibility with robotic visual perception.This study provides a comprehensive overview of the emerging integration of LLMs and multimodal LLMs into various robotic tasks.Additionally,we propose a framework that utilizes multimodal GPT-4V to enhance embodied task planning through the combination of natural language instructions and robot visual perceptions.Our results,based on diverse datasets,indicate that GPT-4V effectively enhances robot performance in embodied tasks.This extensive survey and evaluation of LLMs and multimodal LLMs across a variety of robotic tasks enriches the understanding of LLM-centric embodied intelligence and provides forward-looking insights towards bridging the gap in Human-Robot-Environment interaction.展开更多
With the miniaturization of devices and the development of modern heating technologies,the generalization of heat conduction and thermoelastic coupling has become crucial,effectively emulating the thermodynamic behavi...With the miniaturization of devices and the development of modern heating technologies,the generalization of heat conduction and thermoelastic coupling has become crucial,effectively emulating the thermodynamic behavior of materials in ultrashort time scales.Theoretically,generalized heat conductive models are considered in this work.By analogy with mechanical viscoelastic models,this paper further enriches the heat conduction models and gives their one-dimensional physical expression.Numerically,the transient thermoelastic response of the slim strip material under thermal shock is investigated by applying the proposed models.First,the analytical solution in the Laplace domain is obtained by the Laplace transform.Then,the numerical results of the transient responses are obtained by the numerical inverse Laplace transform.Finally,the transient responses of different models are analyzed and compared,and the effects of material parameters are discussed.This work not only opens up new research perspectives on generalized heat conductive and thermoelastic coupling theories,but also is expected to be beneficial for the deeper understanding of the heat wave theory.展开更多
With the rapid development of generative artificial intelligence technology,the traditional cloud-based centralized model training and inference face significant limitations due to high transmission latency and costs,...With the rapid development of generative artificial intelligence technology,the traditional cloud-based centralized model training and inference face significant limitations due to high transmission latency and costs,which restrict user-side in-situ Artificial Intelligence Generated Content(AIGC)service requests.To this end,we propose the Edge Artificial Intelligence Generated Content(Edge AIGC)framework,which can effectively address the challenges of cloud computing by implementing in-situ processing of services close to the data source through edge computing.However,AIGC models usually have a large parameter scale and complex computing requirements,which poses a huge challenge to the storage and computing resources of edge devices.This paper focuses on the edge intelligence model caching and resource allocation problems in the Edge AIGC framework,aiming to improve the cache hit rate and resource utilization of edge devices for models by optimizing the model caching strategy and resource allocation scheme,and realize in-situ AIGC service processing.With the optimization objectives of minimizing service request response time and execution cost in resource-constrained environments,we employ the Twin Delayed Deep Deterministic Policy Gradient algorithm for optimization.Experimental results show that,compared with other methods,our model caching and resource allocation strategies can effectively improve the cache hit rate by at least 41.06%and reduce the response cost as well.展开更多
AlphaPanda(AlphaFold2[1]inspired protein-specific antibody design in a diffusional manner)is an advanced algorithm for designing complementary determining regions(CDRs)of the antibody targeted the specific epitope,com...AlphaPanda(AlphaFold2[1]inspired protein-specific antibody design in a diffusional manner)is an advanced algorithm for designing complementary determining regions(CDRs)of the antibody targeted the specific epitope,combining transformer[2]models,3DCNN[3],and diffusion[4]generative models.展开更多
The growing demand for wireless connectivity has made massive multiple-input multiple-output(MIMO)a cornerstone of modern communication systems.To optimize network performance and resource allocation,an efficient and ...The growing demand for wireless connectivity has made massive multiple-input multiple-output(MIMO)a cornerstone of modern communication systems.To optimize network performance and resource allocation,an efficient and robust approach is joint device activity detection and channel estimation.In this paper,we present an approach utilizing score-based generative models to address the underdetermined nature of channel estimation,which is data-driven and well-suited for the complex and dynamic environment of massive MIMO systems.Our experimental results,based on a comprehensive dataset generated through Monte-Carlo sampling,demonstrate the high precision of our channel estimation approach,with errors reduced to as low as-45 d B,and exceptional accuracy in detecting active devices.展开更多
This critical review provides an in-depth analysis of Large Language Models(LLMs),encompassing their foundational principles,diverse applications,and advanced training methodologies.We critically examine the evolution...This critical review provides an in-depth analysis of Large Language Models(LLMs),encompassing their foundational principles,diverse applications,and advanced training methodologies.We critically examine the evolution from Recurrent Neural Networks(RNNs)to Transformer models,highlighting the significant advancements and innovations in LLM architectures.The review explores state-of-the-art techniques such as in-context learning and various fine-tuning approaches,with an emphasis on optimizing parameter efficiency.We also discuss methods for aligning LLMs with human preferences,including reinforcement learning frameworks and human feedback mechanisms.The emerging technique of retrieval-augmented generation,which integrates external knowledge into LLMs,is also evaluated.Additionally,we address the ethical considerations of deploying LLMs,stressing the importance of responsible and mindful application.By identifying current gaps and suggesting future research directions,this review provides a comprehensive and critical overview of the present state and potential advancements in LLMs.This work serves as an insightful guide for researchers and practitioners in artificial intelligence,offering a unified perspective on the strengths,limitations,and future prospects of LLMs.展开更多
Objective:Generative artificial intelligence(AI)technology,represented by large language models(LLMs),has gradually been developed for traditional Chinese medicine(TCM);however,challenges remain in effectively enhanci...Objective:Generative artificial intelligence(AI)technology,represented by large language models(LLMs),has gradually been developed for traditional Chinese medicine(TCM);however,challenges remain in effectively enhancing AI applications for TCM.Therefore,this study is the first systematic review to analyze LLMs in TCM retrospectively,focusing on and summarizing the evidence of their performance in generative tasks.Methods:We extensively searched electronic databases for articles published until June 2024 to identify publicly available studies on LLMs in TCM.Two investigators independently selected and extracted the related information and evaluation metrics.Based on the available data,this study used descriptive analysis for a comprehensive systematic review of LLM technology related to TCM.Results:Ten studies published between 2023 and 2024 met our eligibility criteria and were included in this review,including 40%LLMs in the TCM vertical domain,40%containing TCM data,and 20%honoring the TCM contribution,with a foundational model parameter range from 1.8 to 33 billion.All included studies used manual or automatic evaluation metrics to evaluate model performance and fully discussed the challenges and contributions through an overview of LLMs in TCM.Conclusions:LLMs have achieved significant advantages in TCM applications and can effectively address intelligent TCM tasks.Further in-depth development of LLMs is needed in various vertical TCM fields,including clinical and fundamental research.Focusing on the functional segmentation development direction of generative AI technologies in TCM application scenarios to meet the practical needs-oriented demands of TCM digitalization is essential.展开更多
The growth of Sakhalin fir(Abies sachalinen-sis)seedlings,an important forest tree species in northern Hokkaido,Japan,is significantly affected by competition from surrounding vegetation,especially evergreen dwarf bam...The growth of Sakhalin fir(Abies sachalinen-sis)seedlings,an important forest tree species in northern Hokkaido,Japan,is significantly affected by competition from surrounding vegetation,especially evergreen dwarf bamboo.In this study,we investigated the height and root collar diameter(RCD)growth of Sakhalin fir seedlings under various degrees of cover by deciduous vegetation and evergreen dwarf bamboo.Generalized additive models were used to quantify the effects of canopy cover and forest floor cover on the relative growth rates of these two parameters.The canopy cover of Sakhalin fir seedlings had a nonlin-ear negative effect on both the height growth of seedlings in the subsequent year and the RCD growth in the current year,given the general growth pattern in this species,where height growth ceases in early summer and RCD growth con-tinues until autumn.Height growth declined sharply after the canopy cover rate exceeded 50%,while RCD growth declined rapidly between 0 and 50%canopy cover rate.The forest floor cover had a greater negative impact on RCD growth than on height growth.These results suggested that Sakhalin fir seedlings respond to vegetative competition by prioritizing height growth for light acquisition at the expense of diameter growth and possibly root growth for below-ground competition.The cover of evergreen dwarf bamboo reduced the height growth of fir seedlings significantly more than the cover of deciduous vegetation.This difference is likely due to the timing of light availability.When competing with deciduous vegetation,Sakhalin fir seedlings exposed to light during the post-snow melt and early spring before the development of the deciduous vegetation canopy can photosynthesize more effectively,leading to greater height growth.The results of this study highlighted the importance of vegetation control considering the type of vegetation for successful Sakhalin fir reforestation.Adjusting the intensity and timing of weeding based on the presence and abundance of dwarf bamboo and other competing vegetation could potentially reduce weeding costs and increase biodiversity in reforested areas.展开更多
The Dicke model,which describes the collective interaction between an ensemble of atoms and a single-mode photon field,serves as a fundamental framework for studying light-matter interactions and quantum electrodynami...The Dicke model,which describes the collective interaction between an ensemble of atoms and a single-mode photon field,serves as a fundamental framework for studying light-matter interactions and quantum electrodynamic phenomena.In this work,we investigate the manifestation of non-Hermitian effects in a generalized Dicke model,where two dissipative atom ensembles interact with a single-mode photon field.We explore the system in the semiclassical limit as a non-Hermitian Dicke model,revealing rich exceptional points(EPs)and diabolic points.Furthermore,we explore the quantum signature of EPs in the Hilbert space,relying on discrete photon numbers.The transition of photons from antibunching to bunching at steady state is unravelled.Our findings deepen the understanding of non-Hermitian physics in light-matter interaction,which is instructive for the design of advanced photonic devices.展开更多
Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textur...Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textures is challenging. This paper introduces a method using generative adversarial networks(GANs) and the contrastive language-image pretraining(CLIP) model to restore and control texture in panoramic images. The GAN model captures complex structures and maintains consistency, while CLIP enables fine-grained texture control via semantic text-image associations. GAN inversion optimizes latent codes for precise texture details. The resulting low dynamic range(LDR) images are converted to high dynamic range(HDR) using the Blender engine for seamless texture blending. Experimental results demonstrate the effectiveness and flexibility of this method in panoramic texture restoration and generation.展开更多
基金supported by the National Key R&D Program of China(No.2023YFA1606701)the National Natural Science Foundation of China(Nos.12175042,11890710,11890714,12047514,12147101,and 12347106)+1 种基金Guangdong Major Project of Basic and Applied Basic Research(No.2020B0301030008)China National Key R&D Program(No.2022YFA1602402).
文摘We employed random distributions and gradient descent methods for the Generator Coordinate Method(GCM)to identify effective basis wave functions,taking halo nuclei ^(6)He and ^(6)Li as examples.By comparing the ground state(0^(+))energy of ^(6)He and the excited state(0^(+))energy of 6 Li calculated with various random distributions and manually selected generation coordinates,we found that the heavy tail characteristic of the logistic distribution better describes the features of the halo nuclei.Subsequently,the Adam algorithm from machine learning was applied to optimize the basis wave functions,indicating that a limited number of basis wave functions can approximate the converged values.These results offer some empirical insights for selecting basis wave functions and contribute to the broader application of machine learning methods in predicting effective basis wave functions.
文摘This paper proposes a multi-objective index-based approach to optimally determine the size and location of multi-distributed generators (DG) units in distribution system with different load models. It is shown that load models can significantly affect the optimal location and sizing of DG resources in distribution systems. The proposed multi-objective function to be optimized includes a short circuit level parameter to represent the protective device requirements. The proposed function also considers a wide range of technical issues such as active and reactive power losses of the system, the voltage profile, the line loading and the MVA intake by the grid. The optimization technique based on particle swarm optimization (PSO) is introduced. The analysis of continuation power flow to determine the effect of DG units on the most sensitive buses to voltage collapse is carried out. The proposed algorithm is tested using the 38-bus radial system and the IEEE 30-bus meshed system. The results show the effectiveness of the proposed algorithm.
基金supported by National Natural Science Foundation of China(62376219 and 62006194)Foundational Research Project in Specialized Discipline(Grant No.G2024WD0146)Faculty Construction Project(Grant No.24GH0201148).
文摘Large language models(LLMs)have undergone significant expansion and have been increasingly integrated across various domains.Notably,in the realm of robot task planning,LLMs harness their advanced reasoning and language comprehension capabilities to formulate precise and efficient action plans based on natural language instructions.However,for embodied tasks,where robots interact with complex environments,textonly LLMs often face challenges due to a lack of compatibility with robotic visual perception.This study provides a comprehensive overview of the emerging integration of LLMs and multimodal LLMs into various robotic tasks.Additionally,we propose a framework that utilizes multimodal GPT-4V to enhance embodied task planning through the combination of natural language instructions and robot visual perceptions.Our results,based on diverse datasets,indicate that GPT-4V effectively enhances robot performance in embodied tasks.This extensive survey and evaluation of LLMs and multimodal LLMs across a variety of robotic tasks enriches the understanding of LLM-centric embodied intelligence and provides forward-looking insights towards bridging the gap in Human-Robot-Environment interaction.
基金Project supported by the Guangdong Basic and Applied Basic Research Foundation of China(No.2023A1515012809)the Natural Science Foundation of Shaanxi Province of China(No.2023-JC-YB-073)the Fundamental Research Funds for the Central Universities of China(No.D5000230066)。
文摘With the miniaturization of devices and the development of modern heating technologies,the generalization of heat conduction and thermoelastic coupling has become crucial,effectively emulating the thermodynamic behavior of materials in ultrashort time scales.Theoretically,generalized heat conductive models are considered in this work.By analogy with mechanical viscoelastic models,this paper further enriches the heat conduction models and gives their one-dimensional physical expression.Numerically,the transient thermoelastic response of the slim strip material under thermal shock is investigated by applying the proposed models.First,the analytical solution in the Laplace domain is obtained by the Laplace transform.Then,the numerical results of the transient responses are obtained by the numerical inverse Laplace transform.Finally,the transient responses of different models are analyzed and compared,and the effects of material parameters are discussed.This work not only opens up new research perspectives on generalized heat conductive and thermoelastic coupling theories,but also is expected to be beneficial for the deeper understanding of the heat wave theory.
基金supported in part by the Shandong Provincial Natural Science Foundation under Grants ZR2023LZH017,ZR2022LZH015 and ZR2024MF066the National Natural Science Foundation of China under Grant 62471493+1 种基金the Tertiary Education Scientific research project of Guangzhou Municipal Education Bureau under Grant 2024312246the Guangzhou Higher Education Teaching Quality and Teaching Reform Project under Grant 2023KCJJD002。
文摘With the rapid development of generative artificial intelligence technology,the traditional cloud-based centralized model training and inference face significant limitations due to high transmission latency and costs,which restrict user-side in-situ Artificial Intelligence Generated Content(AIGC)service requests.To this end,we propose the Edge Artificial Intelligence Generated Content(Edge AIGC)framework,which can effectively address the challenges of cloud computing by implementing in-situ processing of services close to the data source through edge computing.However,AIGC models usually have a large parameter scale and complex computing requirements,which poses a huge challenge to the storage and computing resources of edge devices.This paper focuses on the edge intelligence model caching and resource allocation problems in the Edge AIGC framework,aiming to improve the cache hit rate and resource utilization of edge devices for models by optimizing the model caching strategy and resource allocation scheme,and realize in-situ AIGC service processing.With the optimization objectives of minimizing service request response time and execution cost in resource-constrained environments,we employ the Twin Delayed Deep Deterministic Policy Gradient algorithm for optimization.Experimental results show that,compared with other methods,our model caching and resource allocation strategies can effectively improve the cache hit rate by at least 41.06%and reduce the response cost as well.
基金supported by the Key Project of International Cooperation of Qilu University of Technology(Grant No.:QLUTGJHZ2018008)Shandong Provincial Natural Science Foundation Committee,China(Grant No.:ZR2016HB54)Shandong Provincial Key Laboratory of Microbial Engineering(SME).
文摘AlphaPanda(AlphaFold2[1]inspired protein-specific antibody design in a diffusional manner)is an advanced algorithm for designing complementary determining regions(CDRs)of the antibody targeted the specific epitope,combining transformer[2]models,3DCNN[3],and diffusion[4]generative models.
文摘The growing demand for wireless connectivity has made massive multiple-input multiple-output(MIMO)a cornerstone of modern communication systems.To optimize network performance and resource allocation,an efficient and robust approach is joint device activity detection and channel estimation.In this paper,we present an approach utilizing score-based generative models to address the underdetermined nature of channel estimation,which is data-driven and well-suited for the complex and dynamic environment of massive MIMO systems.Our experimental results,based on a comprehensive dataset generated through Monte-Carlo sampling,demonstrate the high precision of our channel estimation approach,with errors reduced to as low as-45 d B,and exceptional accuracy in detecting active devices.
文摘This critical review provides an in-depth analysis of Large Language Models(LLMs),encompassing their foundational principles,diverse applications,and advanced training methodologies.We critically examine the evolution from Recurrent Neural Networks(RNNs)to Transformer models,highlighting the significant advancements and innovations in LLM architectures.The review explores state-of-the-art techniques such as in-context learning and various fine-tuning approaches,with an emphasis on optimizing parameter efficiency.We also discuss methods for aligning LLMs with human preferences,including reinforcement learning frameworks and human feedback mechanisms.The emerging technique of retrieval-augmented generation,which integrates external knowledge into LLMs,is also evaluated.Additionally,we address the ethical considerations of deploying LLMs,stressing the importance of responsible and mindful application.By identifying current gaps and suggesting future research directions,this review provides a comprehensive and critical overview of the present state and potential advancements in LLMs.This work serves as an insightful guide for researchers and practitioners in artificial intelligence,offering a unified perspective on the strengths,limitations,and future prospects of LLMs.
基金supported by the National Multidisciplinary Innovation Team of Traditional Chinese Medicine(ZYYCXTD-D-202204)China Postdoctoral Science Foundation(2023M742627)+1 种基金Postdoctoral Fellowship Program of CPSF(GZC20231928)Foundation of State Key Laboratory of Component-based Chinese Medicine(CBCM2023201).
文摘Objective:Generative artificial intelligence(AI)technology,represented by large language models(LLMs),has gradually been developed for traditional Chinese medicine(TCM);however,challenges remain in effectively enhancing AI applications for TCM.Therefore,this study is the first systematic review to analyze LLMs in TCM retrospectively,focusing on and summarizing the evidence of their performance in generative tasks.Methods:We extensively searched electronic databases for articles published until June 2024 to identify publicly available studies on LLMs in TCM.Two investigators independently selected and extracted the related information and evaluation metrics.Based on the available data,this study used descriptive analysis for a comprehensive systematic review of LLM technology related to TCM.Results:Ten studies published between 2023 and 2024 met our eligibility criteria and were included in this review,including 40%LLMs in the TCM vertical domain,40%containing TCM data,and 20%honoring the TCM contribution,with a foundational model parameter range from 1.8 to 33 billion.All included studies used manual or automatic evaluation metrics to evaluate model performance and fully discussed the challenges and contributions through an overview of LLMs in TCM.Conclusions:LLMs have achieved significant advantages in TCM applications and can effectively address intelligent TCM tasks.Further in-depth development of LLMs is needed in various vertical TCM fields,including clinical and fundamental research.Focusing on the functional segmentation development direction of generative AI technologies in TCM application scenarios to meet the practical needs-oriented demands of TCM digitalization is essential.
基金supported by the Ministry of Agriculture,Forestry,and Fisheries of Japan (25093 C)JSPS KAKENHI (JP23H02262)
文摘The growth of Sakhalin fir(Abies sachalinen-sis)seedlings,an important forest tree species in northern Hokkaido,Japan,is significantly affected by competition from surrounding vegetation,especially evergreen dwarf bamboo.In this study,we investigated the height and root collar diameter(RCD)growth of Sakhalin fir seedlings under various degrees of cover by deciduous vegetation and evergreen dwarf bamboo.Generalized additive models were used to quantify the effects of canopy cover and forest floor cover on the relative growth rates of these two parameters.The canopy cover of Sakhalin fir seedlings had a nonlin-ear negative effect on both the height growth of seedlings in the subsequent year and the RCD growth in the current year,given the general growth pattern in this species,where height growth ceases in early summer and RCD growth con-tinues until autumn.Height growth declined sharply after the canopy cover rate exceeded 50%,while RCD growth declined rapidly between 0 and 50%canopy cover rate.The forest floor cover had a greater negative impact on RCD growth than on height growth.These results suggested that Sakhalin fir seedlings respond to vegetative competition by prioritizing height growth for light acquisition at the expense of diameter growth and possibly root growth for below-ground competition.The cover of evergreen dwarf bamboo reduced the height growth of fir seedlings significantly more than the cover of deciduous vegetation.This difference is likely due to the timing of light availability.When competing with deciduous vegetation,Sakhalin fir seedlings exposed to light during the post-snow melt and early spring before the development of the deciduous vegetation canopy can photosynthesize more effectively,leading to greater height growth.The results of this study highlighted the importance of vegetation control considering the type of vegetation for successful Sakhalin fir reforestation.Adjusting the intensity and timing of weeding based on the presence and abundance of dwarf bamboo and other competing vegetation could potentially reduce weeding costs and increase biodiversity in reforested areas.
基金supported by the National Key R&D Program of China(Grant No.2022YFA1404400)the National Natural Science Foundation of China(Grant Nos.12125504 and 12305050)+3 种基金Zhejiang Provincial Natural Science Foundation(Grant No.LZ25A050001)the Doctoral Support Program for Young Talents of the China Association for Science and Technologythe Hundred Talents Program of the Chinese Academy of Sciencesthe Natural Science Foundation of Jiangsu Higher Education Institutions of China(Grant No.23KJB140017)。
文摘The Dicke model,which describes the collective interaction between an ensemble of atoms and a single-mode photon field,serves as a fundamental framework for studying light-matter interactions and quantum electrodynamic phenomena.In this work,we investigate the manifestation of non-Hermitian effects in a generalized Dicke model,where two dissipative atom ensembles interact with a single-mode photon field.We explore the system in the semiclassical limit as a non-Hermitian Dicke model,revealing rich exceptional points(EPs)and diabolic points.Furthermore,we explore the quantum signature of EPs in the Hilbert space,relying on discrete photon numbers.The transition of photons from antibunching to bunching at steady state is unravelled.Our findings deepen the understanding of non-Hermitian physics in light-matter interaction,which is instructive for the design of advanced photonic devices.
文摘Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textures is challenging. This paper introduces a method using generative adversarial networks(GANs) and the contrastive language-image pretraining(CLIP) model to restore and control texture in panoramic images. The GAN model captures complex structures and maintains consistency, while CLIP enables fine-grained texture control via semantic text-image associations. GAN inversion optimizes latent codes for precise texture details. The resulting low dynamic range(LDR) images are converted to high dynamic range(HDR) using the Blender engine for seamless texture blending. Experimental results demonstrate the effectiveness and flexibility of this method in panoramic texture restoration and generation.
