With the continuous development of full tensor gradiometer （FTG） measurement techniques, three-dimensional （3D） inversion of FTG data is becoming increasingly used in oil and gas exploration. In the fast processin...With the continuous development of full tensor gradiometer （FTG） measurement techniques, three-dimensional （3D） inversion of FTG data is becoming increasingly used in oil and gas exploration. In the fast processing and interpretation of large-scale high-precision data, the use of the graphics processing unit process unit （GPU） and preconditioning methods are very important in the data inversion. In this paper, an improved preconditioned conjugate gradient algorithm is proposed by combining the symmetric successive over-relaxation （SSOR） technique and the incomplete Choleksy decomposition conjugate gradient algorithm （ICCG）. Since preparing the preconditioner requires extra time, a parallel implement based on GPU is proposed. The improved method is then applied in the inversion of noise- contaminated synthetic data to prove its adaptability in the inversion of 3D FTG data. Results show that the parallel SSOR-ICCG algorithm based on NVIDIA Tesla C2050 GPU achieves a speedup of approximately 25 times that of a serial program using a 2.0 GHz Central Processing Unit （CPU）. Real airbome gravity-gradiometry data from Vinton salt dome （south- west Louisiana, USA） are also considered. Good results are obtained, which verifies the efficiency and feasibility of the proposed parallel method in fast inversion of 3D FTG data.展开更多
The fast convergence without initial value dependence is the key to solving large angle relative orientation.Therefore,a hybrid conjugate gradient algorithm is proposed in this paper.The concrete process is:①stochast...The fast convergence without initial value dependence is the key to solving large angle relative orientation.Therefore,a hybrid conjugate gradient algorithm is proposed in this paper.The concrete process is:①stochastic hill climbing(SHC)algorithm is used to make a random disturbance to the given initial value of the relative orientation element,and the new value to guarantee the optimization direction is generated.②In local optimization,a super-linear convergent conjugate gradient method is used to replace the steepest descent method in relative orientation to improve its convergence rate.③The global convergence condition is that the calculation error is less than the prescribed limit error.The comparison experiment shows that the method proposed in this paper is independent of the initial value,and has higher accuracy and fewer iterations.展开更多
The dropping off of data during information transmission and the storage device’s damage etc.often leads the sampled data to be non-uniform.The paper, based on the stability theory of irregular wavelet frame and the ...The dropping off of data during information transmission and the storage device’s damage etc.often leads the sampled data to be non-uniform.The paper, based on the stability theory of irregular wavelet frame and the irregular weighted wavelet frame operator,proposed an irregular weighted wavelet fame conjugate gradient iterative algorithm for the reconstruction of non-uniformly sampling signal. Compared the experiment results with the iterative algorithm of the Ref.[5],the new algorithm has remarkable advantages in approximation error,running time and so on.展开更多
This paper proposed a new normalized transform domain conjugate gradient algorithm (NT-CGA), which applies the data independent normalized orthogonal transform technique to approximately whiten the input signal and ut...This paper proposed a new normalized transform domain conjugate gradient algorithm (NT-CGA), which applies the data independent normalized orthogonal transform technique to approximately whiten the input signal and utilises the modified conjugate gradient method to perform sample-by-sample updating of the filter weights more efficiently. Simulation results illustrated that the proposed algorithm has the ability to provide a fast convergence speed and lower steady-error compared to that of traditional least mean square algorithm (LMSA), normalized transform domain least mean square algorithm (NT- LMSA), Quasi-Newton least mean square algorithm (Q-LMSA) and time domain conjugate gradient algorithm (TD-CGA) when the input signal is heavily coloured.展开更多
We extend a results presented by Y.F. Hu and C.Storey (1991) [1] on the global convergence result for conjugate gradient methods with different choices for the parameter β k . In this note, the condit...We extend a results presented by Y.F. Hu and C.Storey (1991) [1] on the global convergence result for conjugate gradient methods with different choices for the parameter β k . In this note, the conditions given on β k are milder than that used by Y.F. Hu and C. Storey.展开更多
Minimization algorithms are singular components in four-dimensional variational data assimilation(4DVar).In this paper,the convergence and application of the conjugate gradient algorithm(CGA),which is based on the Lan...Minimization algorithms are singular components in four-dimensional variational data assimilation(4DVar).In this paper,the convergence and application of the conjugate gradient algorithm(CGA),which is based on the Lanczos iterative algorithm and the Hessian matrix derived from tangent linear and adjoint models using a non-hydrostatic framework,are investigated in the 4DVar minimization.First,the influence of the Gram-Schmidt orthogonalization of the Lanczos vector on the convergence of the Lanczos algorithm is studied.The results show that the Lanczos algorithm without orthogonalization fails to converge after the ninth iteration in the 4DVar minimization,while the orthogonalized Lanczos algorithm converges stably.Second,the convergence and computational efficiency of the CGA and quasi-Newton method in batch cycling assimilation experiments are compared on the 4DVar platform of the Global/Regional Assimilation and Prediction System(GRAPES).The CGA is 40%more computationally efficient than the quasi-Newton method,although the equivalent analysis results can be obtained by using either the CGA or the quasi-Newton method.Thus,the CGA based on Lanczos iterations is better for solving the optimization problems in the GRAPES 4DVar system.展开更多
For resolving the problem that a conventional intensity modulated radiotherapy(IMRT)plan designed with the"two-step method"-creates a greater number of apertures and total Monitor Units(MU),the direct apertu...For resolving the problem that a conventional intensity modulated radiotherapy(IMRT)plan designed with the"two-step method"-creates a greater number of apertures and total Monitor Units(MU),the direct aperture optimization(DAO)method using a genetic algorithm and conjugate gradient was studied based on Accurate/Advanced Radiation Therapy System(ARTS)developed by the FDS Team(www.fds.org.cn).展开更多
Since the complexity and structural diversity of man-made compounds are considered, quantitative structure-activity relationships (QSARs)-based fast screening approaches are urgently needed for the assessment of the p...Since the complexity and structural diversity of man-made compounds are considered, quantitative structure-activity relationships (QSARs)-based fast screening approaches are urgently needed for the assessment of the potential risk of endocrine disrupting chemicals (EDCs). The artificial neural net-works (ANN) are capable of recognizing highly nonlinear relationships, so it will have a bright applica-tion prospect in building high-quality QSAR models. As a popular supervised training algorithm in ANN, back-propagation (BP) converges slowly and immerses in vibration frequently. In this paper, a research strategy that BP neural network was improved by conjugate gradient (CG) algorithm with a variable selection method based on genetic algorithm was applied to investigate the QSAR of EDCs. This re-sulted in a robust and highly predictive ANN model with R2 of 0.845 for the training set, q2pred of 0.81 and root-mean-square error (RMSE) of 0.688 for the test set. The result shows that our method can provide a feasible and practical tool for the rapid screening of the estrogen activity of organic compounds.展开更多
In this paper, an iterative algorithm is presented to solve the Sylvester and Lyapunov matrix equations. By this iterative algorithm, for any initial matrix X1, a solution X＊ can be obtained within finite iteration s...In this paper, an iterative algorithm is presented to solve the Sylvester and Lyapunov matrix equations. By this iterative algorithm, for any initial matrix X1, a solution X＊ can be obtained within finite iteration steps in the absence of roundoff errors. Some examples illustrate that this algorithm is very efficient and better than that of [ 1 ] and [2].展开更多
We study a three-dimensional off-lattice protein folding model, which involves two species of residues interacting through Lennard-Jones potentials. By incorporating an extra energy contribution into the original pote...We study a three-dimensional off-lattice protein folding model, which involves two species of residues interacting through Lennard-Jones potentials. By incorporating an extra energy contribution into the original potential function, we replace the original constrained problem with an unconstrained minimization of a mixed potential function. As such an efficient quasi-physical algorithm for solving the protein folding problem is presented. We apply the proposed algorithm to sequences with up to 55 residues and compare the computational results with the putative lowest energy found by several of the most famous algorithms, showing the advantages of our method. The dynamic behavior of the quasi-physlcal algorithm is also discussed.展开更多
A new spectral three-term conjugate gradient algorithm in virtue of the Quasi-Newton equation is developed for solving large-scale unconstrained optimization problems.It is proved that the search directions in this al...A new spectral three-term conjugate gradient algorithm in virtue of the Quasi-Newton equation is developed for solving large-scale unconstrained optimization problems.It is proved that the search directions in this algorithm always satisfy a sufficiently descent condition independent of any line search.Global convergence is established for general objective functions if the strong Wolfe line search is used.Numerical experiments are employed to show its high numerical performance in solving large-scale optimization problems.Particularly,the developed algorithm is implemented to solve the 100 benchmark test problems from CUTE with different sizes from 1000 to 10,000,in comparison with some similar ones in the literature.The numerical results demonstrate that our algorithm outperforms the state-of-the-art ones in terms of less CPU time,less number of iteration or less number of function evaluation.展开更多
A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale ...A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale and congenital heart disease). Momentum term, adaptive learning rate, the forgetting mechanics, and conjugate gradients method are introduced to improve the basic BP algorithm aiming to speed up the convergence of the BP algorithm and enhance the accuracy for diagnosis. A heart disease database consisting of 352 samples is applied to the training and testing courses of the system. The performance of the system is assessed by cross-validation method. It is found that as the basic BP algorithm is improved step by step, the convergence speed and the classification accuracy of the network are enhanced, and the system has great application prospect in supporting heart diseases diagnosis.展开更多
In this paper, we investigate the convergence property of the conjugate gradientalgorithms which depend on the search directionsby using different choices for the scalar oh, where 9k is the gradient of f at ac. Unders...In this paper, we investigate the convergence property of the conjugate gradientalgorithms which depend on the search directionsby using different choices for the scalar oh, where 9k is the gradient of f at ac. Undersome assumptions which are slightly weaker than those in [1], we prove a global convergenceresult which allows ac to be set in a wider range than that in [1].展开更多
基金the Sub-project of National Science and Technology Major Project of China(No.2016ZX05027-002-003)the National Natural Science Foundation of China(No.41404089)+1 种基金the State Key Program of National Natural Science of China(No.41430322)the National Basic Research Program of China(973 Program)(No.2015CB45300)
文摘With the continuous development of full tensor gradiometer （FTG） measurement techniques, three-dimensional （3D） inversion of FTG data is becoming increasingly used in oil and gas exploration. In the fast processing and interpretation of large-scale high-precision data, the use of the graphics processing unit process unit （GPU） and preconditioning methods are very important in the data inversion. In this paper, an improved preconditioned conjugate gradient algorithm is proposed by combining the symmetric successive over-relaxation （SSOR） technique and the incomplete Choleksy decomposition conjugate gradient algorithm （ICCG）. Since preparing the preconditioner requires extra time, a parallel implement based on GPU is proposed. The improved method is then applied in the inversion of noise- contaminated synthetic data to prove its adaptability in the inversion of 3D FTG data. Results show that the parallel SSOR-ICCG algorithm based on NVIDIA Tesla C2050 GPU achieves a speedup of approximately 25 times that of a serial program using a 2.0 GHz Central Processing Unit （CPU）. Real airbome gravity-gradiometry data from Vinton salt dome （south- west Louisiana, USA） are also considered. Good results are obtained, which verifies the efficiency and feasibility of the proposed parallel method in fast inversion of 3D FTG data.
基金National Natural Science Foundation of China(Nos.4156108241161061)。
文摘The fast convergence without initial value dependence is the key to solving large angle relative orientation.Therefore,a hybrid conjugate gradient algorithm is proposed in this paper.The concrete process is:①stochastic hill climbing(SHC)algorithm is used to make a random disturbance to the given initial value of the relative orientation element,and the new value to guarantee the optimization direction is generated.②In local optimization,a super-linear convergent conjugate gradient method is used to replace the steepest descent method in relative orientation to improve its convergence rate.③The global convergence condition is that the calculation error is less than the prescribed limit error.The comparison experiment shows that the method proposed in this paper is independent of the initial value,and has higher accuracy and fewer iterations.
基金supported by Hunan Education Office Foundation under Grant 06C260
文摘The dropping off of data during information transmission and the storage device’s damage etc.often leads the sampled data to be non-uniform.The paper, based on the stability theory of irregular wavelet frame and the irregular weighted wavelet frame operator,proposed an irregular weighted wavelet fame conjugate gradient iterative algorithm for the reconstruction of non-uniformly sampling signal. Compared the experiment results with the iterative algorithm of the Ref.[5],the new algorithm has remarkable advantages in approximation error,running time and so on.
文摘This paper proposed a new normalized transform domain conjugate gradient algorithm (NT-CGA), which applies the data independent normalized orthogonal transform technique to approximately whiten the input signal and utilises the modified conjugate gradient method to perform sample-by-sample updating of the filter weights more efficiently. Simulation results illustrated that the proposed algorithm has the ability to provide a fast convergence speed and lower steady-error compared to that of traditional least mean square algorithm (LMSA), normalized transform domain least mean square algorithm (NT- LMSA), Quasi-Newton least mean square algorithm (Q-LMSA) and time domain conjugate gradient algorithm (TD-CGA) when the input signal is heavily coloured.
文摘We extend a results presented by Y.F. Hu and C.Storey (1991) [1] on the global convergence result for conjugate gradient methods with different choices for the parameter β k . In this note, the conditions given on β k are milder than that used by Y.F. Hu and C. Storey.
基金Supported by the China Meteorological Administration Special Public Welfare Research Fund(GYHY201506003)
文摘Minimization algorithms are singular components in four-dimensional variational data assimilation(4DVar).In this paper,the convergence and application of the conjugate gradient algorithm(CGA),which is based on the Lanczos iterative algorithm and the Hessian matrix derived from tangent linear and adjoint models using a non-hydrostatic framework,are investigated in the 4DVar minimization.First,the influence of the Gram-Schmidt orthogonalization of the Lanczos vector on the convergence of the Lanczos algorithm is studied.The results show that the Lanczos algorithm without orthogonalization fails to converge after the ninth iteration in the 4DVar minimization,while the orthogonalized Lanczos algorithm converges stably.Second,the convergence and computational efficiency of the CGA and quasi-Newton method in batch cycling assimilation experiments are compared on the 4DVar platform of the Global/Regional Assimilation and Prediction System(GRAPES).The CGA is 40%more computationally efficient than the quasi-Newton method,although the equivalent analysis results can be obtained by using either the CGA or the quasi-Newton method.Thus,the CGA based on Lanczos iterations is better for solving the optimization problems in the GRAPES 4DVar system.
基金These works were supported by a grant from the National Natural Science Foundation(No.81101132).
文摘For resolving the problem that a conventional intensity modulated radiotherapy(IMRT)plan designed with the"two-step method"-creates a greater number of apertures and total Monitor Units(MU),the direct aperture optimization(DAO)method using a genetic algorithm and conjugate gradient was studied based on Accurate/Advanced Radiation Therapy System(ARTS)developed by the FDS Team(www.fds.org.cn).
基金the National Natural Science Foundation of China (Grant No. 20507008)the National Natural Science Foundation Key Project of China (Grant No. 20737001)+1 种基金the Natural Science Foundation of Jiangsu Province,China (Grant No. BK200418)the National Basic Research Program of China (973 Program) (Grant No. 2003CB415002)
文摘Since the complexity and structural diversity of man-made compounds are considered, quantitative structure-activity relationships (QSARs)-based fast screening approaches are urgently needed for the assessment of the potential risk of endocrine disrupting chemicals (EDCs). The artificial neural net-works (ANN) are capable of recognizing highly nonlinear relationships, so it will have a bright applica-tion prospect in building high-quality QSAR models. As a popular supervised training algorithm in ANN, back-propagation (BP) converges slowly and immerses in vibration frequently. In this paper, a research strategy that BP neural network was improved by conjugate gradient (CG) algorithm with a variable selection method based on genetic algorithm was applied to investigate the QSAR of EDCs. This re-sulted in a robust and highly predictive ANN model with R2 of 0.845 for the training set, q2pred of 0.81 and root-mean-square error (RMSE) of 0.688 for the test set. The result shows that our method can provide a feasible and practical tool for the rapid screening of the estrogen activity of organic compounds.
基金supported by the National Natural Science Foundation of China (No.10771073)
文摘In this paper, an iterative algorithm is presented to solve the Sylvester and Lyapunov matrix equations. By this iterative algorithm, for any initial matrix X1, a solution X＊ can be obtained within finite iteration steps in the absence of roundoff errors. Some examples illustrate that this algorithm is very efficient and better than that of [ 1 ] and [2].
基金The project partially supported by National Key Basic Research Project of China under Grant No. 2004GB318000 and National Natural Science Foundation of China under Grant No. 10471051
文摘We study a three-dimensional off-lattice protein folding model, which involves two species of residues interacting through Lennard-Jones potentials. By incorporating an extra energy contribution into the original potential function, we replace the original constrained problem with an unconstrained minimization of a mixed potential function. As such an efficient quasi-physical algorithm for solving the protein folding problem is presented. We apply the proposed algorithm to sequences with up to 55 residues and compare the computational results with the putative lowest energy found by several of the most famous algorithms, showing the advantages of our method. The dynamic behavior of the quasi-physlcal algorithm is also discussed.
基金This research is supported by the National Natural Science Foundation of China(Grant No.71671190).
文摘A new spectral three-term conjugate gradient algorithm in virtue of the Quasi-Newton equation is developed for solving large-scale unconstrained optimization problems.It is proved that the search directions in this algorithm always satisfy a sufficiently descent condition independent of any line search.Global convergence is established for general objective functions if the strong Wolfe line search is used.Numerical experiments are employed to show its high numerical performance in solving large-scale optimization problems.Particularly,the developed algorithm is implemented to solve the 100 benchmark test problems from CUTE with different sizes from 1000 to 10,000,in comparison with some similar ones in the literature.The numerical results demonstrate that our algorithm outperforms the state-of-the-art ones in terms of less CPU time,less number of iteration or less number of function evaluation.
基金the Natural Science Foundation of China (No. 30070211).
文摘A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale and congenital heart disease). Momentum term, adaptive learning rate, the forgetting mechanics, and conjugate gradients method are introduced to improve the basic BP algorithm aiming to speed up the convergence of the BP algorithm and enhance the accuracy for diagnosis. A heart disease database consisting of 352 samples is applied to the training and testing courses of the system. The performance of the system is assessed by cross-validation method. It is found that as the basic BP algorithm is improved step by step, the convergence speed and the classification accuracy of the network are enhanced, and the system has great application prospect in supporting heart diseases diagnosis.
文摘In this paper, we investigate the convergence property of the conjugate gradientalgorithms which depend on the search directionsby using different choices for the scalar oh, where 9k is the gradient of f at ac. Undersome assumptions which are slightly weaker than those in [1], we prove a global convergenceresult which allows ac to be set in a wider range than that in [1].
