In today’s digital era,the rapid evolution of image editing technologies has brought about a significant simplification of image manipulation.Unfortunately,this progress has also given rise to the misuse of manipulat...In today’s digital era,the rapid evolution of image editing technologies has brought about a significant simplification of image manipulation.Unfortunately,this progress has also given rise to the misuse of manipulated images across various domains.One of the pressing challenges stemming from this advancement is the increasing difficulty in discerning between unaltered and manipulated images.This paper offers a comprehensive survey of existing methodologies for detecting image tampering,shedding light on the diverse approaches employed in the field of contemporary image forensics.The methods used to identify image forgery can be broadly classified into two primary categories:classical machine learning techniques,heavily reliant on manually crafted features,and deep learning methods.Additionally,this paper explores recent developments in image forensics,placing particular emphasis on the detection of counterfeit colorization.Image colorization involves predicting colors for grayscale images,thereby enhancing their visual appeal.The advancements in colorization techniques have reached a level where distinguishing between authentic and forged images with the naked eye has become an exceptionally challenging task.This paper serves as an in-depth exploration of the intricacies of image forensics in the modern age,with a specific focus on the detection of colorization forgery,presenting a comprehensive overview of methodologies in this critical field.展开更多
Full-color imaging is essential in digital pathology for accurate tissue analysis.Utilizing advanced optical modulation and phase retrieval algorithms,Fourier ptychographic microscopy(FPM)offers a powerful solution fo...Full-color imaging is essential in digital pathology for accurate tissue analysis.Utilizing advanced optical modulation and phase retrieval algorithms,Fourier ptychographic microscopy(FPM)offers a powerful solution for high-throughput digital pathology,combining high resolution,large field of view,and extended depth of field(DOF).However,the full-color capabilities of FPM are hindered by coherent color artifacts and reduced computational efficiency,which significantly limits its practical applications.Color-transferbased FPM(CFPM)has emerged as a potential solution,theoretically reducing both acquisition and reconstruction threefold time.Yet,existing methods fall short of achieving the desired reconstruction speed and colorization quality.In this study,we report a generalized dual-color-space constrained model for FPM colorization.This model provides a mathematical framework for model-based FPM colorization,enabling a closed-form solution without the need for redundant iterative calculations.Our approach,termed generalized CFPM(gCFPM),achieves colorization within seconds for megapixel-scale images,delivering superior colorization quality in terms of both colorfulness and sharpness,along with an extended DOF.Both simulations and experiments demonstrate that gCFPM surpasses state-of-the-art methods across all evaluated criteria.Our work offers a robust and comprehensive workflow for high-throughput full-color pathological imaging using FPM platforms,laying a solid foundation for future advancements in methodology and engineering.展开更多
Colorization is the practice of adding appropriate chromatic values to monochrome photographs or videos.A real-valued luminance image can be mapped to a three-dimensional color image.However,it is a severely ill-defin...Colorization is the practice of adding appropriate chromatic values to monochrome photographs or videos.A real-valued luminance image can be mapped to a three-dimensional color image.However,it is a severely ill-defined problem and not has a single solution.In this paper,an encoder-decoder Convolutional Neural Network(CNN)model is used for colorizing gray images where the encoder is a Densely Connected Convolutional Network(DenseNet)and the decoder is a conventional CNN.The DenseNet extracts image features from gray images and the conventional CNN outputs a^(*)b^(*)color channels.Due to a large number of desaturated color components compared to saturated color components in the training images,the saturated color components have a strong tendency towards desaturated color components in the predicted a^(*)b^(*)channel.To solve the problems,we rebalance the predicted a^(*)b^(*)color channel by smoothing every subregion individually using the average filter.2 stage k-means clustering technique is applied to divide the subregions.Then we apply Gamma transformation in the entire a^(*)b^(*)channel to saturate the image.We compare our proposed method with several existing methods.From the experimental results,we see that our proposed method has made some notable improvements over the existing methods and color representation of gray-scale images by our proposed method is more plausible to visualize.Additionally,our suggested approach beats other approaches in terms of Peak Signal-to-Noise Ratio(PSNR),Structural Similarity Index Measure(SSIM)and Histogram.展开更多
A new local cost function is proposed in this paper based on the linear relationship assumption between the values of the color components and the intensity component in each local image window,then a new quadratic ob...A new local cost function is proposed in this paper based on the linear relationship assumption between the values of the color components and the intensity component in each local image window,then a new quadratic objective function is derived from it and the globally optimal chrominance values can be computed by solving a sparse linear system of equations.Through the colorization experiments on various test images,it is confirmed that the colorized images obtained by our proposed method have more vivid colors and sharper boundaries than those obtained by the traditional method.The peak signal to noise ratio(PSNR) of the colorized images and the average estimation error of the chrominance values relative to the original images also show that our proposed method gives more precise estimation than the traditional method.展开更多
The effect of single coloring agent Nd(NO3)3 on the crystallization, microstructure and colorization of Li2O-Al2O3-SiO2 (LAS) glass ceramics were investigated by differential thermal analysis (DTA), X-ray diffractomet...The effect of single coloring agent Nd(NO3)3 on the crystallization, microstructure and colorization of Li2O-Al2O3-SiO2 (LAS) glass ceramics were investigated by differential thermal analysis (DTA), X-ray diffractometry (XRD) and scanning electron microscopy (SEM). The introduction of little neodymium has no effect on the crystallization manner and the formation of main crystallization phase, but more neodymium will weaken the crystallization of LAS glass. Little neodymium can increase the glossiness of LAS glass ceramic, while more neodymium can color LAS glass with light purple or red purple. The colorability of neodymium for LAS glass ceramic decreases with the increase of crystallization temperature.展开更多
The decolorization of Direct Black 22 by Aspergillus ficuum has been studied. It was found that Aspergillus ficuum could effectively decolorize Direct Black 22 especially when grown as pelleted mycelia. Results showed...The decolorization of Direct Black 22 by Aspergillus ficuum has been studied. It was found that Aspergillus ficuum could effectively decolorize Direct Black 22 especially when grown as pelleted mycelia. Results showed that the media containing Direct Black 22 at 50 mg/L could be decolorized by 98.05% of the initial color in 24 h. The optimum pH and temperature of decolorization are 4.0 and 33 °C respectively. Aeration was quite beneficial to decolorization. Medium composition and the concentration of Direct Black 22 could affect the rate of decolorization. The dye degraded products assayed by UV-visible spectrophotometer and macroscopic observation showed that the decolorization of Direct Black 22 by mycelial pellets includes two important processes: bioadsorption and biodegradation. The degradation experiment agree with the Michaelis-Menten kinetics equation.展开更多
Video colorization is a challenging and highly ill-posed problem.Although recent years have witnessed remarkable progress in single image colorization,there is relatively less research effort on video colorization,and...Video colorization is a challenging and highly ill-posed problem.Although recent years have witnessed remarkable progress in single image colorization,there is relatively less research effort on video colorization,and existing methods always suffer from severe flickering artifacts(temporal inconsistency)or unsatisfactory colorization.We address this problem from a new perspective,by jointly considering colorization and temporal consistency in a unified framework.Specifically,we propose a novel temporally consistent video colorization(TCVC)framework.TCVC effectively propagates frame-level deep features in a bidirectional way to enhance the temporal consistency of colorization.Furthermore,TCVC introduces a self-regularization learning(SRL)scheme to minimize the differences in predictions obtained using different time steps.SRL does not require any ground-truth color videos for training and can further improve temporal consistency.Experiments demonstrate that our method can not only provide visually pleasing colorized video,but also with clearly better temporal consistency than state-of-the-art methods.A video demo is provided at https://www.youtube.com/watch?v=c7dczMs-olE,while code is available at https://github.com/lyh-18/TCVC-Tem porally-Consistent-Video-Colorization.展开更多
The automatic colorization of anime line drawings is a challenging problem in production pipelines.Recent advances in deep neural networks have addressed this problem;however,collectingmany images of colorization targ...The automatic colorization of anime line drawings is a challenging problem in production pipelines.Recent advances in deep neural networks have addressed this problem;however,collectingmany images of colorization targets in novel anime work before the colorization process starts leads to chicken-and-egg problems and has become an obstacle to using them in production pipelines.To overcome this obstacle,we propose a new patch-based learning method for few-shot anime-style colorization.The learning method adopts an efficient patch sampling technique with position embedding according to the characteristics of anime line drawings.We also present a continuous learning strategy that continuously updates our colorization model using new samples colorized by human artists.The advantage of our method is that it can learn our colorization model from scratch or pre-trained weights using only a few pre-and post-colorized line drawings that are created by artists in their usual colorization work.Therefore,our method can be easily incorporated within existing production pipelines.We quantitatively demonstrate that our colorizationmethod outperforms state-of-the-art methods.展开更多
Video colorization aims to add color to grayscale or monochrome videos.Although existing methods have achieved substantial and noteworthy results in the field of image colorization,video colorization presents more for...Video colorization aims to add color to grayscale or monochrome videos.Although existing methods have achieved substantial and noteworthy results in the field of image colorization,video colorization presents more formidable obstacles due to the additional necessity for temporal consistency.Moreover,there is rarely a systematic review of video colorization methods.In this paper,we aim to review existing state-of-the-art video colorization methods.In addition,maintaining spatial-temporal consistency is pivotal to the process of video colorization.To gain deeper insight into the evolution of existing methods in terms of spatial-temporal consistency,we further review video colorization methods from a novel perspective.Video colorization methods can be categorized into four main categories:optical-flow based methods,scribble-based methods,exemplar-based methods,and fully automatic methods.However,optical-flow based methods rely heavily on accurate optical-flow estimation,scribble-based methods require extensive user interaction and modifications,exemplar-based methods face challenges in obtaining suitable reference images,and fully automatic methods often struggle to meet specific colorization requirements.We also discuss the existing challenges and highlight several future research opportunities worth exploring.展开更多
Video colorization encounters two principal challenges:colorization quality and temporalflicker.Balancing colorization quality and temporal consis-tency is a significant challenge.To address the aforementioned issues,we...Video colorization encounters two principal challenges:colorization quality and temporalflicker.Balancing colorization quality and temporal consis-tency is a significant challenge.To address the aforementioned issues,we employ the transformer model in thefield of video colorization and introduce a pioneer-ing video colorization method named VCTR.Initially,to guarantee the quality of video coloring,we employ a pretrained image coloring network to add color to the grayscale video frame.Next,the feature extraction module for VCTR is utilized to perform feature extraction and propagation on the color frames during the coloriza-tion process.Finally,the transformer module is designed to fully leverage local information via the local feature self-attention layer.Additionally,motion infor-mation from bidirectional opticalflow is utilized to identify correlations across video frames for feature fusion,guaranteeing both the coloring effect and tem-poral consistency.The experimental results demonstrate that VCTR outperforms existing methods on two publicly available datasets,namely,DAVIS and Videvo.VCTR attains the top ranking in the long-series dataset,Videvo,based on the CTBI(Colorization and Temporal-Consistency Balance Index).This achievement underscores VCTR’s ability to strike a commendable balance between colorization quality and temporal consistency.展开更多
Image colorization is a classic and important topic in computer graphics,where the aim is to add color to a monochromatic input image to produce a colorful result.In this survey,we present the history of colorization ...Image colorization is a classic and important topic in computer graphics,where the aim is to add color to a monochromatic input image to produce a colorful result.In this survey,we present the history of colorization research in chronological order and summarize popular algorithms in this field.Early work on colorization mostly focused on developing techniques to improve the colorization quality.In the last few years,researchers have considered more possibilities such as combining colorization with NLP(natural language processing)and focused more on industrial applications.To better control the color,various types of color control are designed,such as providing reference images or color-scribbles.We have created a taxonomy of the colorization methods according to the input type,divided into grayscale,sketch-based and hybrid.The pros and cons are discussed for each algorithm,and they are compared according to their main characteristics.Finally,we discuss how deep learning,and in particular Generative Adversarial Networks(GANs),has changed this field.展开更多
Digital cartoon production requires extensive manual labor to colorize sketches with visually pleasant color composition and color shading.During colorization,the artist usually takes an existing cartoon image as colo...Digital cartoon production requires extensive manual labor to colorize sketches with visually pleasant color composition and color shading.During colorization,the artist usually takes an existing cartoon image as color guidance,particularly when colorizing related characters or an animation sequence.Reference-guided colorization is more intuitive than colorization with other hints,such as color points or scribbles,or text-based hints.Unfortunately,reference-guided colorization is challenging since the style of the colorized image should match the style of the reference image in terms of both global color composition and local color shading.In this paper,we propose a novel learning-based framework which colorizes a sketch based on a color style feature extracted from a reference color image.Our framework contains a color style extractor to extract the color feature from a color image,a colorization network to generate multi-scale output images by combining a sketch and a color feature,and a multi-scale discriminator to improve the reality of the output image.Extensive qualitative and quantitative evaluations show that our method outperforms existing methods,providing both superior visual quality and style reference consistency in the task of reference-based colorization.展开更多
It is of great scientific significance to construct a 3D dynamic structural color with a special color effect based on the microlens array.However,the problems of imperfect mechanisms and poor color quality need to be...It is of great scientific significance to construct a 3D dynamic structural color with a special color effect based on the microlens array.However,the problems of imperfect mechanisms and poor color quality need to be solved.A method of 3D structural color turning on periodic metasurfaces fabricated by the microlens array and self-assembly technology was proposed in this study.In the experiment,Polydimethylsiloxane(PDMS)flexible film was used as a substrate,and SiO2 microspheres were scraped into grooves of the PDMS film to form 3D photonic crystal structures.By adjusting the number of blade-coated times and microsphere concentrations,high-saturation structural color micropatterns were obtained.These films were then matched with microlens arrays to produce dynamic graphics with iridescent effects.The results showed that by blade-coated two times and SiO2 microsphere concentrations of 50%are the best conditions.This method demonstrates the potential for being widely applied in the anticounterfeiting printing and ultra-high-resolution display.展开更多
This paper proposes a structure-aware nonlocal energy optimization framework for interactive image colo- rization with sparse scribbles. Our colorization technique propagates colors to both local intensity-continuous ...This paper proposes a structure-aware nonlocal energy optimization framework for interactive image colo- rization with sparse scribbles. Our colorization technique propagates colors to both local intensity-continuous regions and remote texture-similar regions without explicit image segmentation. We implement the nonlocal principle by computing k nearest neighbors in the high-dimensional feature space. The feature space contains not only image coordinates and intensities but also statistical texture features obtained with the direction-aligned Gabor wavelet filter. Structure maps are utilized to scale texture features to avoid artifacts along high-contrast boundaries. We show various experimental results and comparisons on image colorization, selective recoloring and decoloring, and progressive color editing to demonstrate the effectiveness of the proposed approach.展开更多
Colorization of gray-scale images has attracted many attentions for a long time. An important role of image color is the conveyer of emotions （through color themes）. The colorization with an undesired color theme is...Colorization of gray-scale images has attracted many attentions for a long time. An important role of image color is the conveyer of emotions （through color themes）. The colorization with an undesired color theme is less useful, even it is semantically correct. However this has been rarely considered. Automatic colorization respecting both the semantics and the emotions is undoubtedly a challenge. In this paper~ we propose a complete system for affective image colorization. We only need the user to assist object segmentation along with text labels and an affective word. First, the text labels along with other object characters are jointly used to filter the internet images to give each object a set of semantically correct reference images. Second, we select a set of color themes according to the affective word based on art theories. With these themes, a generic algorithm is used to select the best reference for each object, balancing various requirements. Finally, we propose a hybrid texture synthesis approach for colorization. To the best of our knowledge, it is the first system which is able to efficiently colorize a gray-scale image semantically by an emotionally controllable fashion. Our experiments show the effectiveness of our system, especially the benefit compared with the previous Markov random field （MRF） based method.展开更多
Grayscale image colorization is an important computer graphics problem with a variety of applications. Recent fully automatic colorization methods have made impressive progress by formulating image colorization as a p...Grayscale image colorization is an important computer graphics problem with a variety of applications. Recent fully automatic colorization methods have made impressive progress by formulating image colorization as a pixel-wise prediction task and utilizing deep convolutional neural networks. Though tremendous improvements have been made, the result of automatic colorization is still far from perfect. Specifically, there still exist common pitfalls in maintaining color consistency in homogeneous regions as well as precisely distinguishing colors near region boundaries. To tackle these problems, we propose a novel fully automatic colorization pipeline which involves a boundary-guided CRF （conditional random field） and a CNN-based color transform as post-processing steps. In addition, as there usually exist multiple plausible colorization proposals for a single image, automatic evaluation for different colorization methods remains a challenging task. We further introduce two novel automatic evaluation schemes to efficiently assess colorization quality in terms of spatial coherence and localization. Comprehensive experiments demonstrate great quality improvement in results of our proposed colorization method under multiple evaluation metrics.展开更多
Peel color is an important appearance quality of melons that significantly affects consumer preferences.In this study,a near-isogenic line NIL-G(dark green peel)was generated from B8(grey-green peel)and B15(white peel...Peel color is an important appearance quality of melons that significantly affects consumer preferences.In this study,a near-isogenic line NIL-G(dark green peel)was generated from B8(grey-green peel)and B15(white peel).The F_2 population constructed by crossing NIL-G and B15 was used to study the inheritance pattern of peel color,and bulked-segregant analysis sequencing(BSA-seq)was employed to identify the interval in which the target gene was located.Genetic analysis showed that a dominant gene controls the dark green peel trait at maturity.BSAseq and molecular markers were used to localize the candidate gene in a 263.7 kb interval of chromosome 4,which contained the CmAPRR2 gene with known functions.Moreover,allelic sequence analysis revealed four SNP variations of the CmAPRR2 gene in B15,of which SNP.G614331A was located at the junction of the 6th exon and 6th intron.The G-to-A mutation caused alternative splicing of the transcript of CmAPRR2 in B15,generating two transcripts(CmAPRR2-A and CmAPRR2-B)with premature termination codons.Furthermore,the Kompetitive Allele Specific PCR(KASP)marker,APRR2-G/A,was developed based on this SNP and shown to co-segregate with the peel color phenotype in the F_(2) population.Compared to white-peel B15,the expression level of CmAPRR2 in dark green peel NIL-G was higher at each growth stage.Therefore,CmAPRR2 may be the key gene controlling the fruit color of melons.This study identified a novel allelic variant of CmAPRR2 that leads to white peel formation in mature melons.We also provides a theoretical basis for further research on the gene regulatory mechanism of melon peel colors,which promotes using molecular marker-assisted selection to modify melon peel colors in the future.展开更多
Cholesteric liquid crystals(CLCs)exhibit unique helical superstructures that selectively reflect circularly polarized light,enabling them to dynamically respond to environmental changes with tunable structural colors....Cholesteric liquid crystals(CLCs)exhibit unique helical superstructures that selectively reflect circularly polarized light,enabling them to dynamically respond to environmental changes with tunable structural colors.This dynamic color-changing capability is crucial for applications that require adaptable optical properties,positioning CLCs as key materials in advanced photonic technologies.This review focuses on the mechanisms of dynamic color tuning in CLCs across various forms,including small molecules,cholesteric liquid crystal elastomers(CLCEs),and cholesteric liquid crystal networks(CLCNs),and emphasizes the distinct responsive coloration each structure provides.Key developments in photochromic mechanisms based on azobenzene,dithienylethene,and molecular motor switches,are discussed for their roles in enhancing the stability and tuning range of CLCs.We examine the color-changing behaviors of CLCEs under mechanical stimuli and CLCNs under swelling,highlighting the advantages of each form.Following this,applications of dynamic color-tuning CLCs in information encryption,adaptive camouflage,and smart sensing technologies are explored.The review concludes with an outlook on current challenges and future directions in CLC research,particularly in biomimetic systems and dynamic photonic devices,aiming to broaden their functional applications and impact.展开更多
Dynamic structuralcolors can change in response todifferent environmental stimuli.This ability remains effectiveeven when the size of the speciesresponsible for the structural coloris reduced to a few micrometers,prov...Dynamic structuralcolors can change in response todifferent environmental stimuli.This ability remains effectiveeven when the size of the speciesresponsible for the structural coloris reduced to a few micrometers,providing a promising sensingmechanism for solving microenvironmentalsensing problems inmicro-robotics and microfluidics.However, the lack of dynamicstructural colors that can encoderapidly, easily integrate, and accuratelyreflect changes in physical quantities hinders their use in microscale sensing applications. Herein, we present a 2.5-dimensionaldynamic structural color based on nanogratings of heterogeneous materials, which were obtained by interweaving a pH-responsive hydrogelwith an IP-L photoresist. Transverse gratings printed with pH-responsive hydrogels elongated the period of longitudinal grating in the swollenstate, resulting in pH-tuned structural colors at a 45° incidence. Moreover, the patterned encoding and array printing of dynamic structuralcolors were achieved using grayscale stripe images to accurately encode the periods and heights of the nanogrid structures. Overall, dynamicstructural color networks exhibit promising potential for applications in information encryption and in situ sensing for microfluidic chips.展开更多
Juglans sigillata is an economically valuable nut crop renowned for its nutritional richness,including essential nutrients,antioxidants,and healthy fats,which boost human cardial,brain and gut health.Despite its impor...Juglans sigillata is an economically valuable nut crop renowned for its nutritional richness,including essential nutrients,antioxidants,and healthy fats,which boost human cardial,brain and gut health.Despite its importance,the lack of a complete genome assembly has been a stumbling block in its biological breeding process.Therefore,we generated deep coverage ultralong Oxford Nanopore Technology(ONT)and PacBio HiFi reads to construct a telomere-to-telomere(T2T)genome assembly.The final assembly spans 537.27 Mb with no gaps,demonstrating a remarkable completeness of 98.1%.We utilized a combination of transcriptome data and homologous proteins to annotate the genome,identifying 36018 protein-coding genes.Furthermore,we profiled global cytosine DNA methylations using ONT sequencing data.Global methylome analysis revealed high methylation levels in transposable element(TE)-rich chromosomal regions juxtaposed with comparatively lower methylation in gene-rich areas.By integrating a detailed multi-omics data analysis,we obtained valuable insights into the mechanism underlying endopleura coloration.This investigation led to the identification of eight candidate genes(e.g.ANR)involved in anthocyanin biosynthesis pathways,which are crucial for the development of color in plants.The comprehensive genome assembly and the understanding of the genetic basis of important traits like endopleura coloration will open avenues for more efficient breeding programs and improved crop quality.展开更多
基金supported by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(2021R1I1A3049788).
文摘In today’s digital era,the rapid evolution of image editing technologies has brought about a significant simplification of image manipulation.Unfortunately,this progress has also given rise to the misuse of manipulated images across various domains.One of the pressing challenges stemming from this advancement is the increasing difficulty in discerning between unaltered and manipulated images.This paper offers a comprehensive survey of existing methodologies for detecting image tampering,shedding light on the diverse approaches employed in the field of contemporary image forensics.The methods used to identify image forgery can be broadly classified into two primary categories:classical machine learning techniques,heavily reliant on manually crafted features,and deep learning methods.Additionally,this paper explores recent developments in image forensics,placing particular emphasis on the detection of counterfeit colorization.Image colorization involves predicting colors for grayscale images,thereby enhancing their visual appeal.The advancements in colorization techniques have reached a level where distinguishing between authentic and forged images with the naked eye has become an exceptionally challenging task.This paper serves as an in-depth exploration of the intricacies of image forensics in the modern age,with a specific focus on the detection of colorization forgery,presenting a comprehensive overview of methodologies in this critical field.
基金supported by the National Natural Science Foundation of China(Grant Nos.12104500 and 82430062)the Key Research and Development Projects of Shaanxi Province(Grant No.2023-YBSF-263),the Shenzhen Engineering Research Centre(Grant No.XMHT20230115004)the Shenzhen Science and Technology Innovation Commission(Grant No.KCXFZ20201221173207022).
文摘Full-color imaging is essential in digital pathology for accurate tissue analysis.Utilizing advanced optical modulation and phase retrieval algorithms,Fourier ptychographic microscopy(FPM)offers a powerful solution for high-throughput digital pathology,combining high resolution,large field of view,and extended depth of field(DOF).However,the full-color capabilities of FPM are hindered by coherent color artifacts and reduced computational efficiency,which significantly limits its practical applications.Color-transferbased FPM(CFPM)has emerged as a potential solution,theoretically reducing both acquisition and reconstruction threefold time.Yet,existing methods fall short of achieving the desired reconstruction speed and colorization quality.In this study,we report a generalized dual-color-space constrained model for FPM colorization.This model provides a mathematical framework for model-based FPM colorization,enabling a closed-form solution without the need for redundant iterative calculations.Our approach,termed generalized CFPM(gCFPM),achieves colorization within seconds for megapixel-scale images,delivering superior colorization quality in terms of both colorfulness and sharpness,along with an extended DOF.Both simulations and experiments demonstrate that gCFPM surpasses state-of-the-art methods across all evaluated criteria.Our work offers a robust and comprehensive workflow for high-throughput full-color pathological imaging using FPM platforms,laying a solid foundation for future advancements in methodology and engineering.
基金Taif University Researchers Supporting Project Number(TURSP-2020/10),Taif University,Taif,Saudi Arabia.
文摘Colorization is the practice of adding appropriate chromatic values to monochrome photographs or videos.A real-valued luminance image can be mapped to a three-dimensional color image.However,it is a severely ill-defined problem and not has a single solution.In this paper,an encoder-decoder Convolutional Neural Network(CNN)model is used for colorizing gray images where the encoder is a Densely Connected Convolutional Network(DenseNet)and the decoder is a conventional CNN.The DenseNet extracts image features from gray images and the conventional CNN outputs a^(*)b^(*)color channels.Due to a large number of desaturated color components compared to saturated color components in the training images,the saturated color components have a strong tendency towards desaturated color components in the predicted a^(*)b^(*)channel.To solve the problems,we rebalance the predicted a^(*)b^(*)color channel by smoothing every subregion individually using the average filter.2 stage k-means clustering technique is applied to divide the subregions.Then we apply Gamma transformation in the entire a^(*)b^(*)channel to saturate the image.We compare our proposed method with several existing methods.From the experimental results,we see that our proposed method has made some notable improvements over the existing methods and color representation of gray-scale images by our proposed method is more plausible to visualize.Additionally,our suggested approach beats other approaches in terms of Peak Signal-to-Noise Ratio(PSNR),Structural Similarity Index Measure(SSIM)and Histogram.
基金Supported by the National Natural Science Foundation of China(No.61073089)the Joint Funds of the National Natural Science,Foundation of China(No.U1304616)the Qinhuangdao Research&Development Program of Science&Technology(No.2012021A044)
文摘A new local cost function is proposed in this paper based on the linear relationship assumption between the values of the color components and the intensity component in each local image window,then a new quadratic objective function is derived from it and the globally optimal chrominance values can be computed by solving a sparse linear system of equations.Through the colorization experiments on various test images,it is confirmed that the colorized images obtained by our proposed method have more vivid colors and sharper boundaries than those obtained by the traditional method.The peak signal to noise ratio(PSNR) of the colorized images and the average estimation error of the chrominance values relative to the original images also show that our proposed method gives more precise estimation than the traditional method.
文摘The effect of single coloring agent Nd(NO3)3 on the crystallization, microstructure and colorization of Li2O-Al2O3-SiO2 (LAS) glass ceramics were investigated by differential thermal analysis (DTA), X-ray diffractometry (XRD) and scanning electron microscopy (SEM). The introduction of little neodymium has no effect on the crystallization manner and the formation of main crystallization phase, but more neodymium will weaken the crystallization of LAS glass. Little neodymium can increase the glossiness of LAS glass ceramic, while more neodymium can color LAS glass with light purple or red purple. The colorability of neodymium for LAS glass ceramic decreases with the increase of crystallization temperature.
文摘The decolorization of Direct Black 22 by Aspergillus ficuum has been studied. It was found that Aspergillus ficuum could effectively decolorize Direct Black 22 especially when grown as pelleted mycelia. Results showed that the media containing Direct Black 22 at 50 mg/L could be decolorized by 98.05% of the initial color in 24 h. The optimum pH and temperature of decolorization are 4.0 and 33 °C respectively. Aeration was quite beneficial to decolorization. Medium composition and the concentration of Direct Black 22 could affect the rate of decolorization. The dye degraded products assayed by UV-visible spectrophotometer and macroscopic observation showed that the decolorization of Direct Black 22 by mycelial pellets includes two important processes: bioadsorption and biodegradation. The degradation experiment agree with the Michaelis-Menten kinetics equation.
基金supported by grants from the National Natural Science Foundation of China(61906184)the Joint Lab of CAS–HK,and the Shanghai Committee of Science and Technology,China(20DZ1100800,21DZ1100100).
文摘Video colorization is a challenging and highly ill-posed problem.Although recent years have witnessed remarkable progress in single image colorization,there is relatively less research effort on video colorization,and existing methods always suffer from severe flickering artifacts(temporal inconsistency)or unsatisfactory colorization.We address this problem from a new perspective,by jointly considering colorization and temporal consistency in a unified framework.Specifically,we propose a novel temporally consistent video colorization(TCVC)framework.TCVC effectively propagates frame-level deep features in a bidirectional way to enhance the temporal consistency of colorization.Furthermore,TCVC introduces a self-regularization learning(SRL)scheme to minimize the differences in predictions obtained using different time steps.SRL does not require any ground-truth color videos for training and can further improve temporal consistency.Experiments demonstrate that our method can not only provide visually pleasing colorized video,but also with clearly better temporal consistency than state-of-the-art methods.A video demo is provided at https://www.youtube.com/watch?v=c7dczMs-olE,while code is available at https://github.com/lyh-18/TCVC-Tem porally-Consistent-Video-Colorization.
文摘The automatic colorization of anime line drawings is a challenging problem in production pipelines.Recent advances in deep neural networks have addressed this problem;however,collectingmany images of colorization targets in novel anime work before the colorization process starts leads to chicken-and-egg problems and has become an obstacle to using them in production pipelines.To overcome this obstacle,we propose a new patch-based learning method for few-shot anime-style colorization.The learning method adopts an efficient patch sampling technique with position embedding according to the characteristics of anime line drawings.We also present a continuous learning strategy that continuously updates our colorization model using new samples colorized by human artists.The advantage of our method is that it can learn our colorization model from scratch or pre-trained weights using only a few pre-and post-colorized line drawings that are created by artists in their usual colorization work.Therefore,our method can be easily incorporated within existing production pipelines.We quantitatively demonstrate that our colorizationmethod outperforms state-of-the-art methods.
基金supported by the National Natural Science Foundation of China under Grant Nos.U22B2049 and 62332010.
文摘Video colorization aims to add color to grayscale or monochrome videos.Although existing methods have achieved substantial and noteworthy results in the field of image colorization,video colorization presents more formidable obstacles due to the additional necessity for temporal consistency.Moreover,there is rarely a systematic review of video colorization methods.In this paper,we aim to review existing state-of-the-art video colorization methods.In addition,maintaining spatial-temporal consistency is pivotal to the process of video colorization.To gain deeper insight into the evolution of existing methods in terms of spatial-temporal consistency,we further review video colorization methods from a novel perspective.Video colorization methods can be categorized into four main categories:optical-flow based methods,scribble-based methods,exemplar-based methods,and fully automatic methods.However,optical-flow based methods rely heavily on accurate optical-flow estimation,scribble-based methods require extensive user interaction and modifications,exemplar-based methods face challenges in obtaining suitable reference images,and fully automatic methods often struggle to meet specific colorization requirements.We also discuss the existing challenges and highlight several future research opportunities worth exploring.
基金supported by the National Natural Science Foundation of China(No.62266011)the Science and Technology Foundation of Guizhou Province(No.ZK[2022]119).
文摘Video colorization encounters two principal challenges:colorization quality and temporalflicker.Balancing colorization quality and temporal consis-tency is a significant challenge.To address the aforementioned issues,we employ the transformer model in thefield of video colorization and introduce a pioneer-ing video colorization method named VCTR.Initially,to guarantee the quality of video coloring,we employ a pretrained image coloring network to add color to the grayscale video frame.Next,the feature extraction module for VCTR is utilized to perform feature extraction and propagation on the color frames during the coloriza-tion process.Finally,the transformer module is designed to fully leverage local information via the local feature self-attention layer.Additionally,motion infor-mation from bidirectional opticalflow is utilized to identify correlations across video frames for feature fusion,guaranteeing both the coloring effect and tem-poral consistency.The experimental results demonstrate that VCTR outperforms existing methods on two publicly available datasets,namely,DAVIS and Videvo.VCTR attains the top ranking in the long-series dataset,Videvo,based on the CTBI(Colorization and Temporal-Consistency Balance Index).This achievement underscores VCTR’s ability to strike a commendable balance between colorization quality and temporal consistency.
基金This work was supported by grants from the National Nat-ural Science Foundation of China(No.61872440,No.62061136007 and No.62102403)the Beijing Municipal Natural Science Foun-dation for Distinguished Young Scholars(No.JQ21013)+1 种基金the Youth Innovation Promotion Association CAS,Royal Society Newton Advanced Fellowship(No.NAF\R2\192151)the Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems,Beihang University(No.VRLAB2022C07).
文摘Image colorization is a classic and important topic in computer graphics,where the aim is to add color to a monochromatic input image to produce a colorful result.In this survey,we present the history of colorization research in chronological order and summarize popular algorithms in this field.Early work on colorization mostly focused on developing techniques to improve the colorization quality.In the last few years,researchers have considered more possibilities such as combining colorization with NLP(natural language processing)and focused more on industrial applications.To better control the color,various types of color control are designed,such as providing reference images or color-scribbles.We have created a taxonomy of the colorization methods according to the input type,divided into grayscale,sketch-based and hybrid.The pros and cons are discussed for each algorithm,and they are compared according to their main characteristics.Finally,we discuss how deep learning,and in particular Generative Adversarial Networks(GANs),has changed this field.
基金supported in part by a CIHE Institutional Development Grant No.IDG200107the National Natural Science Foundation of China under Grant No.61973221the Natural Science Foundation of Guangdong Province of China under Grant Nos.2018A030313381 and 2019A1515011165.
文摘Digital cartoon production requires extensive manual labor to colorize sketches with visually pleasant color composition and color shading.During colorization,the artist usually takes an existing cartoon image as color guidance,particularly when colorizing related characters or an animation sequence.Reference-guided colorization is more intuitive than colorization with other hints,such as color points or scribbles,or text-based hints.Unfortunately,reference-guided colorization is challenging since the style of the colorized image should match the style of the reference image in terms of both global color composition and local color shading.In this paper,we propose a novel learning-based framework which colorizes a sketch based on a color style feature extracted from a reference color image.Our framework contains a color style extractor to extract the color feature from a color image,a colorization network to generate multi-scale output images by combining a sketch and a color feature,and a multi-scale discriminator to improve the reality of the output image.Extensive qualitative and quantitative evaluations show that our method outperforms existing methods,providing both superior visual quality and style reference consistency in the task of reference-based colorization.
文摘It is of great scientific significance to construct a 3D dynamic structural color with a special color effect based on the microlens array.However,the problems of imperfect mechanisms and poor color quality need to be solved.A method of 3D structural color turning on periodic metasurfaces fabricated by the microlens array and self-assembly technology was proposed in this study.In the experiment,Polydimethylsiloxane(PDMS)flexible film was used as a substrate,and SiO2 microspheres were scraped into grooves of the PDMS film to form 3D photonic crystal structures.By adjusting the number of blade-coated times and microsphere concentrations,high-saturation structural color micropatterns were obtained.These films were then matched with microlens arrays to produce dynamic graphics with iridescent effects.The results showed that by blade-coated two times and SiO2 microsphere concentrations of 50%are the best conditions.This method demonstrates the potential for being widely applied in the anticounterfeiting printing and ultra-high-resolution display.
基金This work was supported by the National Natural Science Foundation of China under Grant Nos. 61100146 and 61472351, and the Zhejiang Provincial Natural Science Foundation of China under Grant Nos. LY15F020019 and LQ14F020006. Pan was supported by the National Key Technology Research and Development Program of the Ministry of Science and Technology of China under Grant No. 2013BAH24F01. Acknowledgement CVM 2015 anonymous We would like to thank our reviewers for their constructive and helpful comments which definitely improve ttle quality of the paper.
文摘This paper proposes a structure-aware nonlocal energy optimization framework for interactive image colo- rization with sparse scribbles. Our colorization technique propagates colors to both local intensity-continuous regions and remote texture-similar regions without explicit image segmentation. We implement the nonlocal principle by computing k nearest neighbors in the high-dimensional feature space. The feature space contains not only image coordinates and intensities but also statistical texture features obtained with the direction-aligned Gabor wavelet filter. Structure maps are utilized to scale texture features to avoid artifacts along high-contrast boundaries. We show various experimental results and comparisons on image colorization, selective recoloring and decoloring, and progressive color editing to demonstrate the effectiveness of the proposed approach.
基金supported by the National Basic Research 973 Program of China under Grant No.2011CB302201the National Natural Science Foundation of China under Grant Nos.61003094,60931160443+1 种基金funded by Tsinghua National Laboratory for Information Science and Technology(TNList) Cross-Discipline Foundation of Chinasupported by the Innovation Fund of Tsinghua-Tencent Joint Laboratory of China
文摘Colorization of gray-scale images has attracted many attentions for a long time. An important role of image color is the conveyer of emotions （through color themes）. The colorization with an undesired color theme is less useful, even it is semantically correct. However this has been rarely considered. Automatic colorization respecting both the semantics and the emotions is undoubtedly a challenge. In this paper~ we propose a complete system for affective image colorization. We only need the user to assist object segmentation along with text labels and an affective word. First, the text labels along with other object characters are jointly used to filter the internet images to give each object a set of semantically correct reference images. Second, we select a set of color themes according to the affective word based on art theories. With these themes, a generic algorithm is used to select the best reference for each object, balancing various requirements. Finally, we propose a hybrid texture synthesis approach for colorization. To the best of our knowledge, it is the first system which is able to efficiently colorize a gray-scale image semantically by an emotionally controllable fashion. Our experiments show the effectiveness of our system, especially the benefit compared with the previous Markov random field （MRF） based method.
文摘Grayscale image colorization is an important computer graphics problem with a variety of applications. Recent fully automatic colorization methods have made impressive progress by formulating image colorization as a pixel-wise prediction task and utilizing deep convolutional neural networks. Though tremendous improvements have been made, the result of automatic colorization is still far from perfect. Specifically, there still exist common pitfalls in maintaining color consistency in homogeneous regions as well as precisely distinguishing colors near region boundaries. To tackle these problems, we propose a novel fully automatic colorization pipeline which involves a boundary-guided CRF （conditional random field） and a CNN-based color transform as post-processing steps. In addition, as there usually exist multiple plausible colorization proposals for a single image, automatic evaluation for different colorization methods remains a challenging task. We further introduce two novel automatic evaluation schemes to efficiently assess colorization quality in terms of spatial coherence and localization. Comprehensive experiments demonstrate great quality improvement in results of our proposed colorization method under multiple evaluation metrics.
基金supported by the Innovation and Development Program of Beijing Vegetable Research Center,China(KYCX202301)the Construction of Cucurbits Collaboration and Innovation Center,China(XTCX202301)+3 种基金the Youth Research Fund of Beijing Academy of Agriculture and Forestry Sciences,China(QNJJ202426)the National Natural Science Foundation of China(U21A20229 and 32102397)the Scientific Research Foundation of the Higher Education Institutions for Distinguished Young Scholars in Anhui Province,China(2022AH020037)and the Key Research and Development Projects of Anhui Province,China(2023z04020019)。
文摘Peel color is an important appearance quality of melons that significantly affects consumer preferences.In this study,a near-isogenic line NIL-G(dark green peel)was generated from B8(grey-green peel)and B15(white peel).The F_2 population constructed by crossing NIL-G and B15 was used to study the inheritance pattern of peel color,and bulked-segregant analysis sequencing(BSA-seq)was employed to identify the interval in which the target gene was located.Genetic analysis showed that a dominant gene controls the dark green peel trait at maturity.BSAseq and molecular markers were used to localize the candidate gene in a 263.7 kb interval of chromosome 4,which contained the CmAPRR2 gene with known functions.Moreover,allelic sequence analysis revealed four SNP variations of the CmAPRR2 gene in B15,of which SNP.G614331A was located at the junction of the 6th exon and 6th intron.The G-to-A mutation caused alternative splicing of the transcript of CmAPRR2 in B15,generating two transcripts(CmAPRR2-A and CmAPRR2-B)with premature termination codons.Furthermore,the Kompetitive Allele Specific PCR(KASP)marker,APRR2-G/A,was developed based on this SNP and shown to co-segregate with the peel color phenotype in the F_(2) population.Compared to white-peel B15,the expression level of CmAPRR2 in dark green peel NIL-G was higher at each growth stage.Therefore,CmAPRR2 may be the key gene controlling the fruit color of melons.This study identified a novel allelic variant of CmAPRR2 that leads to white peel formation in mature melons.We also provides a theoretical basis for further research on the gene regulatory mechanism of melon peel colors,which promotes using molecular marker-assisted selection to modify melon peel colors in the future.
基金financially supported by the National Natural Science Foundation of China(Nos.52233001,51927805,and 52173110)the Innovation Program of Shanghai Municipal Education Commission(No.2023ZKZD07)the Shanghai Rising-Star Program(No.22QA1401200)。
文摘Cholesteric liquid crystals(CLCs)exhibit unique helical superstructures that selectively reflect circularly polarized light,enabling them to dynamically respond to environmental changes with tunable structural colors.This dynamic color-changing capability is crucial for applications that require adaptable optical properties,positioning CLCs as key materials in advanced photonic technologies.This review focuses on the mechanisms of dynamic color tuning in CLCs across various forms,including small molecules,cholesteric liquid crystal elastomers(CLCEs),and cholesteric liquid crystal networks(CLCNs),and emphasizes the distinct responsive coloration each structure provides.Key developments in photochromic mechanisms based on azobenzene,dithienylethene,and molecular motor switches,are discussed for their roles in enhancing the stability and tuning range of CLCs.We examine the color-changing behaviors of CLCEs under mechanical stimuli and CLCNs under swelling,highlighting the advantages of each form.Following this,applications of dynamic color-tuning CLCs in information encryption,adaptive camouflage,and smart sensing technologies are explored.The review concludes with an outlook on current challenges and future directions in CLC research,particularly in biomimetic systems and dynamic photonic devices,aiming to broaden their functional applications and impact.
基金supported by the National Natural Science Foundation of China(Grant No.61925307).
文摘Dynamic structuralcolors can change in response todifferent environmental stimuli.This ability remains effectiveeven when the size of the speciesresponsible for the structural coloris reduced to a few micrometers,providing a promising sensingmechanism for solving microenvironmentalsensing problems inmicro-robotics and microfluidics.However, the lack of dynamicstructural colors that can encoderapidly, easily integrate, and accuratelyreflect changes in physical quantities hinders their use in microscale sensing applications. Herein, we present a 2.5-dimensionaldynamic structural color based on nanogratings of heterogeneous materials, which were obtained by interweaving a pH-responsive hydrogelwith an IP-L photoresist. Transverse gratings printed with pH-responsive hydrogels elongated the period of longitudinal grating in the swollenstate, resulting in pH-tuned structural colors at a 45° incidence. Moreover, the patterned encoding and array printing of dynamic structuralcolors were achieved using grayscale stripe images to accurately encode the periods and heights of the nanogrid structures. Overall, dynamicstructural color networks exhibit promising potential for applications in information encryption and in situ sensing for microfluidic chips.
基金supported by the Yunnan Seed Laboratory,China(202205AR070001-15)the National Natural Science Foundation of China,China(Grant No.32160697)。
文摘Juglans sigillata is an economically valuable nut crop renowned for its nutritional richness,including essential nutrients,antioxidants,and healthy fats,which boost human cardial,brain and gut health.Despite its importance,the lack of a complete genome assembly has been a stumbling block in its biological breeding process.Therefore,we generated deep coverage ultralong Oxford Nanopore Technology(ONT)and PacBio HiFi reads to construct a telomere-to-telomere(T2T)genome assembly.The final assembly spans 537.27 Mb with no gaps,demonstrating a remarkable completeness of 98.1%.We utilized a combination of transcriptome data and homologous proteins to annotate the genome,identifying 36018 protein-coding genes.Furthermore,we profiled global cytosine DNA methylations using ONT sequencing data.Global methylome analysis revealed high methylation levels in transposable element(TE)-rich chromosomal regions juxtaposed with comparatively lower methylation in gene-rich areas.By integrating a detailed multi-omics data analysis,we obtained valuable insights into the mechanism underlying endopleura coloration.This investigation led to the identification of eight candidate genes(e.g.ANR)involved in anthocyanin biosynthesis pathways,which are crucial for the development of color in plants.The comprehensive genome assembly and the understanding of the genetic basis of important traits like endopleura coloration will open avenues for more efficient breeding programs and improved crop quality.
