In seismic data processing, blind deconvolution is a key technology. Introduced in this paper is a flow of one kind of blind deconvolution. The optimal precondition conjugate gradients (PCG) in Kyrlov subspace is als...In seismic data processing, blind deconvolution is a key technology. Introduced in this paper is a flow of one kind of blind deconvolution. The optimal precondition conjugate gradients (PCG) in Kyrlov subspace is also used to improve the stability of the algorithm. The computation amount is greatly decreased.展开更多
Fast solving large-scale linear equations in the finite element analysis is a classical subject in computational mechanics. It is a key technique in computer aided engineering （CAE） and computer aided manufacturing ...Fast solving large-scale linear equations in the finite element analysis is a classical subject in computational mechanics. It is a key technique in computer aided engineering （CAE） and computer aided manufacturing （CAM）. This paper presents a high-efficiency improved symmetric successive over-relaxation （ISSOR） preconditioned conjugate gradient （PCG） method, which maintains lelism consistent with the original form. Ideally, the by 50% as compared with the original algorithm. the convergence and inherent paralcomputation can It is suitable for be reduced nearly high-performance computing with its inherent basic high-efficiency operations. By comparing with the numerical results, it is shown that the proposed method has the best performance.展开更多
The preconditioned conjugate gradient deconvolution method combines the realization of sparse deconvolution and the optimal preconditioned conjugate gradient method to invert to reflection coefficients. This method ca...The preconditioned conjugate gradient deconvolution method combines the realization of sparse deconvolution and the optimal preconditioned conjugate gradient method to invert to reflection coefficients. This method can enhance the frequency of seismic data processing and widen the valid frequency bandwidth. Considering the time-varying nature of seismic signals, we replace the constant wavelet with a multi-scale time-varying wavelet during deconvolution. Numerical tests show that this method can obtain good application results.展开更多
In this paper two theorems with theoretical and practical significance are given in respect to the preconditioned conjugate gradient method (PCCG). The theorems discuss respectively the qualitative property of the ite...In this paper two theorems with theoretical and practical significance are given in respect to the preconditioned conjugate gradient method (PCCG). The theorems discuss respectively the qualitative property of the iterative solution and the construction principle of the iterative matrix. The authors put forward a new incompletely LU factorizing technique for non-M-matrix and the method of constructing the iterative matrix. This improved PCCG is used to calculate the ill-conditioned problems and large-scale three-dimensional finite element problems, and simultaneously contrasted with other methods. The abnormal phenomenon is analyzed when PCCG is used to solve the system of ill-conditioned equations, ft is shown that the method proposed in this paper is quite effective in solving the system of large-scale finite element equations and the system of ill-conditioned equations.展开更多
This paper presents various acceleration techniques tailored for the traditional 3D topology optimization problem.Firstly,the adoption of the finite difference method leads to a sparser stiffness matrix,resulting in m...This paper presents various acceleration techniques tailored for the traditional 3D topology optimization problem.Firstly,the adoption of the finite difference method leads to a sparser stiffness matrix,resulting in more efficient matrix-vector multiplication.Additionally,a fully matrix-free technique is proposed,which only assembles stiffness matrices at the coarsest grid level and does not require complex node numbering.Moreover,an innovative N-cycle multigrid(MG)algorithm is proposed to act as a preconditioner within conjugate gradient(CG)iterations.Finally,to further enhance the optimization process on high-resolution grids,a progressive strategy is implemented.The numerical results confirm that these acceleration techniques are not only efficient,but also capable of achieving lower compliance and reducing memory consumption.MATLAB codes complementing the article can be downloaded from Github.展开更多
The restrictively preconditioned conjugate gradient （RPCG） method is further developed to solve large sparse system of linear equations of a block two-by-two structure. The basic idea of this new approach is that we...The restrictively preconditioned conjugate gradient （RPCG） method is further developed to solve large sparse system of linear equations of a block two-by-two structure. The basic idea of this new approach is that we apply the RPCG method to the normal-residual equation of the block two-by-two linear system and construct each required approximate matrix by making use of the incomplete orthogonal factorization of the involved matrix blocks. Numerical experiments show that the new method, called the restrictively preconditioned conjugate gradient on normal residual （RPCGNR）, is more robust and effective than either the known RPCG method or the standard conjugate gradient on normal residual （CGNR） method when being used for solving the large sparse saddle point problems.展开更多
The strategies that minimize the overall solution time of multiple linear systems in 3D finite element method (FEM) modeling of direct current (DC) resistivity were discussed. A global stiff matrix is assembled and st...The strategies that minimize the overall solution time of multiple linear systems in 3D finite element method (FEM) modeling of direct current (DC) resistivity were discussed. A global stiff matrix is assembled and stored in two parts separately. One part is associated with the volume integral and the other is associated with the subsurface boundary integral. The equivalent multiple linear systems with closer right-hand sides than the original systems were constructed. A recycling Krylov subspace technique was employed to solve the multiple linear systems. The solution of the seed system was used as an initial guess for the subsequent systems. The results of two numerical experiments show that the improved algorithm reduces the iterations and CPU time by almost 50%, compared with the classical preconditioned conjugate gradient method.展开更多
A vorticity-velocity method was used to study the incompressible viscous fluid flow around a circular cylinder with surface suction or blowing. The resulted high order implicit difference equations were effeciently so...A vorticity-velocity method was used to study the incompressible viscous fluid flow around a circular cylinder with surface suction or blowing. The resulted high order implicit difference equations were effeciently solved by the modified incomplete LU decomposition conjugate gradient scheme ( MILU-CG). The effects of surface suction or blowing' s position and strength on the vortex structures in the cylinder wake, as well as on the drag and lift forces at Reynoldes number Re = 100 were investigated numerically. The results show that the suction on the shoulder of the cylinder or the blowing on the rear of the cylinder can effeciently suppress the asymmetry of the vortex wake in the transverse direction and greatly reduce the lift force; the suction on the shoulder of the cylinder, when its strength is properly chosen, can reduce the drag force significantly, too.展开更多
We proposed an improved graphics processing unit(GPU)acceleration approach for three-dimensional structural topology optimization using the element-free Galerkin(EFG)method.This method can effectively eliminate the ra...We proposed an improved graphics processing unit(GPU)acceleration approach for three-dimensional structural topology optimization using the element-free Galerkin(EFG)method.This method can effectively eliminate the race condition under parallelization.We established a structural topology optimization model by combining the EFG method and the solid isotropic microstructures with penalization model.We explored the GPU parallel algorithm of assembling stiffness matrix,solving discrete equation,analyzing sensitivity,and updating design variables in detail.We also proposed a node pair-wise method for assembling the stiffnessmatrix and a node-wise method for sensitivity analysis to eliminate race conditions during the parallelization.Furthermore,we investigated the effects of the thread block size,the number of degrees of freedom,and the convergence error of preconditioned conjugate gradient(PCG)on GPU computing performance.Finally,the results of the three numerical examples demonstrated the validity of the proposed approach and showed the significant acceleration of structural topology optimization.To save the cost of optimization calculation,we proposed the appropriate thread block size and the convergence error of the PCG method.展开更多
Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term.A regularized convex term can usually preserve the image edges well in the restored image...Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term.A regularized convex term can usually preserve the image edges well in the restored image.In this paper,we consider a class of convex and edge-preserving regularization functions,i.e.,multiplicative half-quadratic regularizations,and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations.At each Newton iterate,the preconditioned conjugate gradient method,incorporated with a constraint preconditioner,is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix. The eigenvalue bounds of the preconditioned matrix are deliberately derived,which can be used to estimate the convergence speed of the preconditioned conjugate gradient method.We use experimental results to demonstrate that this new approach is efficient, and the effect of image restoration is reasonably well.展开更多
A hybrid finite difference method and vortex method (HDV), which is based on domain decomposition and proposed by the authors (1992), is improved by using a modified incomplete LU decomposition conjugate gradient meth...A hybrid finite difference method and vortex method (HDV), which is based on domain decomposition and proposed by the authors (1992), is improved by using a modified incomplete LU decomposition conjugate gradient method (MILU-CG), and a high order implicit difference algorithm. The flow around a rotating circular cylinder at Reynolds number R-e = 1000, 200 and the angular to rectilinear speed ratio alpha is an element of (0.5, 3.25) is studied numerically. The long-time full developed features about the variations of the vortex patterns in the wake, and drag, lift forces on the cylinder are given. The calculated streamline contours agreed well with the experimental visualized flow pictures. The existence of critical states and the vortex patterns at the states are given for the first time. The maximum lift to drag force ratio can be obtained nearby the critical states.展开更多
We consider solving integral equations of the second kind defined on the half-line [0, infinity) by the preconditioned conjugate gradient method. Convergence is known to be slow due to the non-compactness of the assoc...We consider solving integral equations of the second kind defined on the half-line [0, infinity) by the preconditioned conjugate gradient method. Convergence is known to be slow due to the non-compactness of the associated integral operator. In this paper, we construct two different circulant integral operators to be used as preconditioners for the method to speed up its convergence rate. We prove that if the given integral operator is close to a convolution-type integral operator, then the preconditioned systems will have spectrum clustered around 1 and hence the preconditioned conjugate gradient method will converge superlinearly. Numerical examples are given to illustrate the fast convergence.展开更多
An inexact Halley＇s method-Halley-PCG（preconditioned conjugate gradient） method is proposed for solving the systems of linear equations for improved Halley method either by Cholesky factorization exactly or by prec...An inexact Halley＇s method-Halley-PCG（preconditioned conjugate gradient） method is proposed for solving the systems of linear equations for improved Halley method either by Cholesky factorization exactly or by preconditioned conjugate gradient method approximately. The convergence result is given and the efficiency of the method compared to the improved Halley＇s method is shown.展开更多
As one of the most important mathematics-physics equations, heat equation has been widely used in engineering area and computing science research. Large-scale heat problems are difficult to solve due to computational ...As one of the most important mathematics-physics equations, heat equation has been widely used in engineering area and computing science research. Large-scale heat problems are difficult to solve due to computational intractability. The parallelization of heat equation is available to improve the simulation model efficiency. In order to solve the three-dimensional heat problems more rapidly, the OpenMP was adopted to parallelize the preconditioned conjugate gradient （PCG） algorithm in this paper. A numerical experiment on the three-dimensional heat equation model was carried out on a computer with four cores. Based on the test results, it is found that the execution time of the original serial PCG program is about 1.71 to 2.81 times of the parallel PCG program executed with different number of threads. The experiment results also demonstrate the available performance of the parallel PCG algorithm based on OpenMP in terms of solution quality and computational performance.展开更多
We present and analyze a robust preconditioned conjugate gradient method for the higher order Lagrangian finite element systems of a class of elliptic problems. An auxiliary linear element stiffness matrix is chosen t...We present and analyze a robust preconditioned conjugate gradient method for the higher order Lagrangian finite element systems of a class of elliptic problems. An auxiliary linear element stiffness matrix is chosen to be the preconditioner for higher order finite elements. Then an algebraic multigrid method of linear finite element is applied for solving the preconditioner. The optimal condition number which is independent of the mesh size is obtained. Numerical experiments confirm the efficiency of the algorithm.展开更多
In this paper,we study the efficiency issue of inexact Newton-type methods for smooth unconstrained optimization problems under standard assumptions from theoretical point of view by discussing a concrete Newton-PCG a...In this paper,we study the efficiency issue of inexact Newton-type methods for smooth unconstrained optimization problems under standard assumptions from theoretical point of view by discussing a concrete Newton-PCG algorithm.In order to compare the algorithm with Newton's method,a ratio between the measures of their approximate efficiencies is investigated.Under mild conditions,it is shown that first,this ratio is larger than 1,which implies that the Newton-PCG algorithm is more efficient than Newton's method,and second,this ratio increases when the dimension n of the problem increases and tends to infinity at least at a rate In n/In 2 when n→∞,which implies that in theory the Newton-PCG algorithm is much more efficient for middle-and large-scale problems.These theoretical results are also supported by our preliminary numerical experiments.展开更多
Support vector machine(SVM)is a widely used method for classification.Proximal support vector machine(PSVM)is an extension of SVM and a promisingmethod to lead to a fast and simple algorithm for generating a classifie...Support vector machine(SVM)is a widely used method for classification.Proximal support vector machine(PSVM)is an extension of SVM and a promisingmethod to lead to a fast and simple algorithm for generating a classifier.Motivated by the fast computational efforts of PSVM and the properties of sparse solution yielded by l1-norm,in this paper,we first propose a PSVM with a cardinality constraint which is eventually relaxed byl1-norm and leads to a trade-offl1−l2 regularized sparse PSVM.Next we convert thisl1−l2 regularized sparse PSVM into an equivalent form of1 regularized least squares(LS)and solve it by a specialized interior-point method proposed by Kim et al.(J SelTop Signal Process 12:1932–4553,2007).Finally,l1−l2 regularized sparse PSVM is illustrated by means of a real-world dataset taken from the University of California,Irvine Machine Learning Repository(UCI Repository).Moreover,we compare the numerical results with the existing models such as generalized eigenvalue proximal SVM(GEPSVM),PSVM,and SVM-Light.The numerical results showthat thel1−l2 regularized sparsePSVMachieves not only better accuracy rate of classification than those of GEPSVM,PSVM,and SVM-Light,but also a sparser classifier compared with the1-PSVM.展开更多
The integration of surface normals for the purpose of computing the shape of a surface in 3D space is a classic problem in computer vision. However,even nowadays it is still a challenging task to devise a method that ...The integration of surface normals for the purpose of computing the shape of a surface in 3D space is a classic problem in computer vision. However,even nowadays it is still a challenging task to devise a method that is flexible enough to work on non-trivial computational domains with high accuracy, robustness,and computational efficiency. By uniting a classic approach for surface normal integration with modern computational techniques, we construct a solver that fulfils these requirements. Building upon the Poisson integration model, we use an iterative Krylov subspace solver as a core step in tackling the task. While such a method can be very efficient, it may only show its full potential when combined with suitable numerical preconditioning and problem-specific initialisation. We perform a thorough numerical study in order to identify an appropriate preconditioner for this purpose.To provide suitable initialisation, we compute this initial state using a recently developed fast marching integrator. Detailed numerical experiments illustrate the benefits of this novel combination. In addition, we show on real-world photometric stereo datasets that the developed numerical framework is flexible enough to tackle modern computer vision applications.展开更多
In this study,a computational framework in the field of artificial intelligence was applied in computational fluid dynamics(CFD)field.This Framework,which was initially proposed by Google Al department,is called"...In this study,a computational framework in the field of artificial intelligence was applied in computational fluid dynamics(CFD)field.This Framework,which was initially proposed by Google Al department,is called"TensorFlow".An improved CFD model based on this framework was developed with a high-order difference method,which is a constrained interpolation profile(CIP)scheme for the base flow solver of the advection term in the Navier-Stokes equations,and preconditioned conjugate gradient(PCG)method was implemented in the model to solve the Poisson equation.Some new features including the convolution,vectorization,and graphics processing unit(GPU)acceleration were implemented to raise the computational efficiency.The model was tested with several benchmark cases and shows good performance.Compared with our former CIP-based model,the present Tensor Flow-based model also shows significantly higher computational efficiency in large-scale computation.The results indicate TensorFlow could be a promising framework for CFD models due to its ability in the computational acceleration and convenience for programming.展开更多
基金With the support of the key project of Knowledge Innovation, CAS(KZCX1-y01, KZCX-SW-18), Fund of the China National Natural Sciences and the Daqing Oilfield with Grant No. 49894190
文摘In seismic data processing, blind deconvolution is a key technology. Introduced in this paper is a flow of one kind of blind deconvolution. The optimal precondition conjugate gradients (PCG) in Kyrlov subspace is also used to improve the stability of the algorithm. The computation amount is greatly decreased.
基金Project supported by the National Natural Science Foundation of China(Nos.5130926141030747+3 种基金41102181and 51121005)the National Basic Research Program of China(973 Program)(No.2011CB013503)the Young Teachers’ Initial Funding Scheme of Sun Yat-sen University(No.39000-1188140)
文摘Fast solving large-scale linear equations in the finite element analysis is a classical subject in computational mechanics. It is a key technique in computer aided engineering （CAE） and computer aided manufacturing （CAM）. This paper presents a high-efficiency improved symmetric successive over-relaxation （ISSOR） preconditioned conjugate gradient （PCG） method, which maintains lelism consistent with the original form. Ideally, the by 50% as compared with the original algorithm. the convergence and inherent paralcomputation can It is suitable for be reduced nearly high-performance computing with its inherent basic high-efficiency operations. By comparing with the numerical results, it is shown that the proposed method has the best performance.
基金This research is sponsored by Key Project of Knowledge Innovation of chinese Academy of Sciences (No. KZCX1-SW-18) and the Precative Project of the Research Institute of Exploration and Development of Daqing Oilfield Co., Ltd.
文摘The preconditioned conjugate gradient deconvolution method combines the realization of sparse deconvolution and the optimal preconditioned conjugate gradient method to invert to reflection coefficients. This method can enhance the frequency of seismic data processing and widen the valid frequency bandwidth. Considering the time-varying nature of seismic signals, we replace the constant wavelet with a multi-scale time-varying wavelet during deconvolution. Numerical tests show that this method can obtain good application results.
文摘In this paper two theorems with theoretical and practical significance are given in respect to the preconditioned conjugate gradient method (PCCG). The theorems discuss respectively the qualitative property of the iterative solution and the construction principle of the iterative matrix. The authors put forward a new incompletely LU factorizing technique for non-M-matrix and the method of constructing the iterative matrix. This improved PCCG is used to calculate the ill-conditioned problems and large-scale three-dimensional finite element problems, and simultaneously contrasted with other methods. The abnormal phenomenon is analyzed when PCCG is used to solve the system of ill-conditioned equations, ft is shown that the method proposed in this paper is quite effective in solving the system of large-scale finite element equations and the system of ill-conditioned equations.
基金X.-P.Wang acknowledges support from the National Natural Science Foundation of China(Grant No.12271461)the Key Project of the NSFC(Grant No.12131010)+3 种基金the Tianyuan Key Project of the NSFC(Grant No.12426307)the Shenzhen Peacock Project(No.2024TC0001)the Shenzhen Science and Technology Innovation Program(Grant No.C10120230046)the Hetao Shenzhen-Hong Kong Science and Technology Innovation Cooperation Zone Project(No.HZQSWSKCCYB-2024016).
文摘This paper presents various acceleration techniques tailored for the traditional 3D topology optimization problem.Firstly,the adoption of the finite difference method leads to a sparser stiffness matrix,resulting in more efficient matrix-vector multiplication.Additionally,a fully matrix-free technique is proposed,which only assembles stiffness matrices at the coarsest grid level and does not require complex node numbering.Moreover,an innovative N-cycle multigrid(MG)algorithm is proposed to act as a preconditioner within conjugate gradient(CG)iterations.Finally,to further enhance the optimization process on high-resolution grids,a progressive strategy is implemented.The numerical results confirm that these acceleration techniques are not only efficient,but also capable of achieving lower compliance and reducing memory consumption.MATLAB codes complementing the article can be downloaded from Github.
基金supported by the National Basic Research Program (No.2005CB321702)the China NNSF Outstanding Young Scientist Foundation (No.10525102)the National Natural Science Foundation (No.10471146),P.R.China
文摘The restrictively preconditioned conjugate gradient （RPCG） method is further developed to solve large sparse system of linear equations of a block two-by-two structure. The basic idea of this new approach is that we apply the RPCG method to the normal-residual equation of the block two-by-two linear system and construct each required approximate matrix by making use of the incomplete orthogonal factorization of the involved matrix blocks. Numerical experiments show that the new method, called the restrictively preconditioned conjugate gradient on normal residual （RPCGNR）, is more robust and effective than either the known RPCG method or the standard conjugate gradient on normal residual （CGNR） method when being used for solving the large sparse saddle point problems.
基金Projects(40974077,41164004)supported by the National Natural Science Foundation of ChinaProject(2007AA06Z134)supported by the National High Technology Research and Development Program of China+2 种基金Projects(2011GXNSFA018003,0832263)supported by the Natural Science Foundation of Guangxi Province,ChinaProject supported by Program for Excellent Talents in Guangxi Higher Education Institution,ChinaProject supported by the Foundation of Guilin University of Technology,China
文摘The strategies that minimize the overall solution time of multiple linear systems in 3D finite element method (FEM) modeling of direct current (DC) resistivity were discussed. A global stiff matrix is assembled and stored in two parts separately. One part is associated with the volume integral and the other is associated with the subsurface boundary integral. The equivalent multiple linear systems with closer right-hand sides than the original systems were constructed. A recycling Krylov subspace technique was employed to solve the multiple linear systems. The solution of the seed system was used as an initial guess for the subsequent systems. The results of two numerical experiments show that the improved algorithm reduces the iterations and CPU time by almost 50%, compared with the classical preconditioned conjugate gradient method.
基金Foundation item:the Natural Science Foundation of Jiangsu Province(BK97056109)
文摘A vorticity-velocity method was used to study the incompressible viscous fluid flow around a circular cylinder with surface suction or blowing. The resulted high order implicit difference equations were effeciently solved by the modified incomplete LU decomposition conjugate gradient scheme ( MILU-CG). The effects of surface suction or blowing' s position and strength on the vortex structures in the cylinder wake, as well as on the drag and lift forces at Reynoldes number Re = 100 were investigated numerically. The results show that the suction on the shoulder of the cylinder or the blowing on the rear of the cylinder can effeciently suppress the asymmetry of the vortex wake in the transverse direction and greatly reduce the lift force; the suction on the shoulder of the cylinder, when its strength is properly chosen, can reduce the drag force significantly, too.
基金This work is supported by the National Natural Science Foundation of China(Nos.51875493,51975503,11802261)The financial support to the first author is gratefully acknowledged.
文摘We proposed an improved graphics processing unit(GPU)acceleration approach for three-dimensional structural topology optimization using the element-free Galerkin(EFG)method.This method can effectively eliminate the race condition under parallelization.We established a structural topology optimization model by combining the EFG method and the solid isotropic microstructures with penalization model.We explored the GPU parallel algorithm of assembling stiffness matrix,solving discrete equation,analyzing sensitivity,and updating design variables in detail.We also proposed a node pair-wise method for assembling the stiffnessmatrix and a node-wise method for sensitivity analysis to eliminate race conditions during the parallelization.Furthermore,we investigated the effects of the thread block size,the number of degrees of freedom,and the convergence error of preconditioned conjugate gradient(PCG)on GPU computing performance.Finally,the results of the three numerical examples demonstrated the validity of the proposed approach and showed the significant acceleration of structural topology optimization.To save the cost of optimization calculation,we proposed the appropriate thread block size and the convergence error of the PCG method.
基金supported by the National Basic Research Program (No.2005CB321702)the National Outstanding Young Scientist Foundation(No. 10525102)the Specialized Research Grant for High Educational Doctoral Program(Nos. 20090211120011 and LZULL200909),Hong Kong RGC grants and HKBU FRGs
文摘Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term.A regularized convex term can usually preserve the image edges well in the restored image.In this paper,we consider a class of convex and edge-preserving regularization functions,i.e.,multiplicative half-quadratic regularizations,and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations.At each Newton iterate,the preconditioned conjugate gradient method,incorporated with a constraint preconditioner,is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix. The eigenvalue bounds of the preconditioned matrix are deliberately derived,which can be used to estimate the convergence speed of the preconditioned conjugate gradient method.We use experimental results to demonstrate that this new approach is efficient, and the effect of image restoration is reasonably well.
文摘A hybrid finite difference method and vortex method (HDV), which is based on domain decomposition and proposed by the authors (1992), is improved by using a modified incomplete LU decomposition conjugate gradient method (MILU-CG), and a high order implicit difference algorithm. The flow around a rotating circular cylinder at Reynolds number R-e = 1000, 200 and the angular to rectilinear speed ratio alpha is an element of (0.5, 3.25) is studied numerically. The long-time full developed features about the variations of the vortex patterns in the wake, and drag, lift forces on the cylinder are given. The calculated streamline contours agreed well with the experimental visualized flow pictures. The existence of critical states and the vortex patterns at the states are given for the first time. The maximum lift to drag force ratio can be obtained nearby the critical states.
文摘We consider solving integral equations of the second kind defined on the half-line [0, infinity) by the preconditioned conjugate gradient method. Convergence is known to be slow due to the non-compactness of the associated integral operator. In this paper, we construct two different circulant integral operators to be used as preconditioners for the method to speed up its convergence rate. We prove that if the given integral operator is close to a convolution-type integral operator, then the preconditioned systems will have spectrum clustered around 1 and hence the preconditioned conjugate gradient method will converge superlinearly. Numerical examples are given to illustrate the fast convergence.
文摘An inexact Halley＇s method-Halley-PCG（preconditioned conjugate gradient） method is proposed for solving the systems of linear equations for improved Halley method either by Cholesky factorization exactly or by preconditioned conjugate gradient method approximately. The convergence result is given and the efficiency of the method compared to the improved Halley＇s method is shown.
文摘As one of the most important mathematics-physics equations, heat equation has been widely used in engineering area and computing science research. Large-scale heat problems are difficult to solve due to computational intractability. The parallelization of heat equation is available to improve the simulation model efficiency. In order to solve the three-dimensional heat problems more rapidly, the OpenMP was adopted to parallelize the preconditioned conjugate gradient （PCG） algorithm in this paper. A numerical experiment on the three-dimensional heat equation model was carried out on a computer with four cores. Based on the test results, it is found that the execution time of the original serial PCG program is about 1.71 to 2.81 times of the parallel PCG program executed with different number of threads. The experiment results also demonstrate the available performance of the parallel PCG algorithm based on OpenMP in terms of solution quality and computational performance.
文摘We present and analyze a robust preconditioned conjugate gradient method for the higher order Lagrangian finite element systems of a class of elliptic problems. An auxiliary linear element stiffness matrix is chosen to be the preconditioner for higher order finite elements. Then an algebraic multigrid method of linear finite element is applied for solving the preconditioner. The optimal condition number which is independent of the mesh size is obtained. Numerical experiments confirm the efficiency of the algorithm.
基金supported by the National Natural Science Foundation of China(Grant No..10371131)the Strategic Research of City University of Hong Kong(Grant No.7001713).
文摘In this paper,we study the efficiency issue of inexact Newton-type methods for smooth unconstrained optimization problems under standard assumptions from theoretical point of view by discussing a concrete Newton-PCG algorithm.In order to compare the algorithm with Newton's method,a ratio between the measures of their approximate efficiencies is investigated.Under mild conditions,it is shown that first,this ratio is larger than 1,which implies that the Newton-PCG algorithm is more efficient than Newton's method,and second,this ratio increases when the dimension n of the problem increases and tends to infinity at least at a rate In n/In 2 when n→∞,which implies that in theory the Newton-PCG algorithm is much more efficient for middle-and large-scale problems.These theoretical results are also supported by our preliminary numerical experiments.
基金This research was supported by the National Natural Science Foundation of China(No.11371242).
文摘Support vector machine(SVM)is a widely used method for classification.Proximal support vector machine(PSVM)is an extension of SVM and a promisingmethod to lead to a fast and simple algorithm for generating a classifier.Motivated by the fast computational efforts of PSVM and the properties of sparse solution yielded by l1-norm,in this paper,we first propose a PSVM with a cardinality constraint which is eventually relaxed byl1-norm and leads to a trade-offl1−l2 regularized sparse PSVM.Next we convert thisl1−l2 regularized sparse PSVM into an equivalent form of1 regularized least squares(LS)and solve it by a specialized interior-point method proposed by Kim et al.(J SelTop Signal Process 12:1932–4553,2007).Finally,l1−l2 regularized sparse PSVM is illustrated by means of a real-world dataset taken from the University of California,Irvine Machine Learning Repository(UCI Repository).Moreover,we compare the numerical results with the existing models such as generalized eigenvalue proximal SVM(GEPSVM),PSVM,and SVM-Light.The numerical results showthat thel1−l2 regularized sparsePSVMachieves not only better accuracy rate of classification than those of GEPSVM,PSVM,and SVM-Light,but also a sparser classifier compared with the1-PSVM.
文摘The integration of surface normals for the purpose of computing the shape of a surface in 3D space is a classic problem in computer vision. However,even nowadays it is still a challenging task to devise a method that is flexible enough to work on non-trivial computational domains with high accuracy, robustness,and computational efficiency. By uniting a classic approach for surface normal integration with modern computational techniques, we construct a solver that fulfils these requirements. Building upon the Poisson integration model, we use an iterative Krylov subspace solver as a core step in tackling the task. While such a method can be very efficient, it may only show its full potential when combined with suitable numerical preconditioning and problem-specific initialisation. We perform a thorough numerical study in order to identify an appropriate preconditioner for this purpose.To provide suitable initialisation, we compute this initial state using a recently developed fast marching integrator. Detailed numerical experiments illustrate the benefits of this novel combination. In addition, we show on real-world photometric stereo datasets that the developed numerical framework is flexible enough to tackle modern computer vision applications.
基金Supported by the National Natural Science Foundation of China(Grant No.51679212,51979245).
文摘In this study,a computational framework in the field of artificial intelligence was applied in computational fluid dynamics(CFD)field.This Framework,which was initially proposed by Google Al department,is called"TensorFlow".An improved CFD model based on this framework was developed with a high-order difference method,which is a constrained interpolation profile(CIP)scheme for the base flow solver of the advection term in the Navier-Stokes equations,and preconditioned conjugate gradient(PCG)method was implemented in the model to solve the Poisson equation.Some new features including the convolution,vectorization,and graphics processing unit(GPU)acceleration were implemented to raise the computational efficiency.The model was tested with several benchmark cases and shows good performance.Compared with our former CIP-based model,the present Tensor Flow-based model also shows significantly higher computational efficiency in large-scale computation.The results indicate TensorFlow could be a promising framework for CFD models due to its ability in the computational acceleration and convenience for programming.
