An estimation approach using least squares method was presented for identificationof model parameters of pressure control in shield tunneling.The state equation ofthe pressure control system for shield tunneling was a...An estimation approach using least squares method was presented for identificationof model parameters of pressure control in shield tunneling.The state equation ofthe pressure control system for shield tunneling was analytically derived based on themass equilibrium principle that the entry mass of the pressure chamber from cutting headwas equal to excluding mass from the screw conveyor.The randomly observed noise wasnumerically simulated and mixed to simulated observation values of system responses.The numerical simulation shows that the state equation of the pressure control system forshield tunneling is reasonable and the proposed estimation approach is effective even ifthe random observation noise exists.The robustness of the controlling procedure is validatedby numerical simulation results.展开更多
A class of preconditioned iterative methods, i.e., preconditioned generalized accelerated overrelaxation （GAOR） methods, is proposed to solve linear systems based on a class of weighted linear least squares problems...A class of preconditioned iterative methods, i.e., preconditioned generalized accelerated overrelaxation （GAOR） methods, is proposed to solve linear systems based on a class of weighted linear least squares problems. The convergence and comparison results are obtained. The comparison results show that the convergence rate of the preconditioned iterative methods is better than that of the original methods. Furthermore, the effectiveness of the proposed methods is shown in the numerical experiment.展开更多
When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To ...When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To solve this problem,we propose to add the nonparametric part(systematic errors)to the partial EIV model,and build the partial EIV model to weaken the influence of systematic errors.Then,having rewritten the model as a nonlinear model,we derive the formula of parameter estimations based on the penalized total least squares criterion.Furthermore,based on the second-order approximation method of precision estimation,we derive the second-order bias and covariance of parameter estimations and calculate the mean square error(MSE).Aiming at the selection of the smoothing factor,we propose to use the U curve method.The experiments show that the proposed method can mitigate the influence of systematic errors to a certain extent compared with the traditional method and get more reliable parameter estimations and its precision information,which validates the feasibility and effectiveness of the proposed method.展开更多
This paper proves that the weighting method via modified Gram-Schmidt（MGS） for solving the equality constrained least squares problem in the limit is equivalent to the direct elimination method via MGS（MGS-eliminat...This paper proves that the weighting method via modified Gram-Schmidt（MGS） for solving the equality constrained least squares problem in the limit is equivalent to the direct elimination method via MGS（MGS-elimination method）. By virtue of this equivalence, the backward and forward roundoff error analysis of the MGS-elimination method is proved. Numerical experiments are provided to verify the results.展开更多
Scientific forecasting water yield of mine is of great significance to the safety production of mine and the colligated using of water resources. The paper established the forecasting model for water yield of mine, co...Scientific forecasting water yield of mine is of great significance to the safety production of mine and the colligated using of water resources. The paper established the forecasting model for water yield of mine, combining neural network with the partial least square method. Dealt with independent variables by the partial least square method, it can not only solve the relationship between independent variables but also reduce the input dimensions in neural network model, and then use the neural network which can solve the non-linear problem better. The result of an example shows that the prediction has higher precision in forecasting and fitting.展开更多
The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning ...The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares. In this paper we reconsider the least squares method from the view point of Deep Learning and we carry out the computation thoroughly for the gradient descent sequence in a very simple setting. Depending on the values of the learning rate, an essential parameter of Deep Learning, the least squares methods of Statistics and Deep Learning reveal an interesting difference.展开更多
The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning ...The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares method, in which a parameter called learning rate plays an important role. It is in general very hard to determine its value. In this paper we generalize the preceding paper [K. Fujii: Least squares method from the view point of Deep Learning: Advances in Pure Mathematics, 8, 485-493, 2018] and give an admissible value of the learning rate, which is easily obtained.展开更多
For geophysical inversion problems,deterministic inversion methods can easily fall into local optimal solutions,while stochastic optimization methods can theoretically converge to global optimal solutions.These proble...For geophysical inversion problems,deterministic inversion methods can easily fall into local optimal solutions,while stochastic optimization methods can theoretically converge to global optimal solutions.These problems have always been a concern for researchers.Among many stochastic optimization methods,particle swarm optimization(PSO)has been applied to solve geophysical inversion problems due to its simple principle and the fact that only a few parameters require adjustment.To overcome the nonuniqueness of inversion,model constraints can be added to PSO optimization.However,using fixed regularization parameters in PSO iteration is equivalent to keeping the default model constraint at a certain level,yielding an inversion result that is considerably affected by the model constraint.This study proposes a hybrid method that combines the regularized least squares method(RLSM)with the PSO method.The RLSM is used to improve the global optimal particle and accelerate convergence,while the adaptive regularization strategy is used to update the regularization parameters to avoid the influence of model constraints on the inversion results.Further,the inversion results of the RLSM and hybrid algorithm are compared and analyzed by considering the audio magnetotelluric synthesis and field data as examples.Experiments show that the proposed hybrid method is superior to the RLSM.Furthermore,compared with the standard PSO algorithm,the hybrid algorithm needs a broader model space but a smaller particle swarm and fewer iteration steps,thus reducing the prior conditions and the computational cost used in the inversion.展开更多
The main purpose of reverse engineering is to convert discrete data pointsinto piecewise smooth, continuous surface models. Before carrying out model reconstruction it issignificant to extract geometric features becau...The main purpose of reverse engineering is to convert discrete data pointsinto piecewise smooth, continuous surface models. Before carrying out model reconstruction it issignificant to extract geometric features because the quality of modeling greatly depends on therepresentation of features. Some fitting techniques of natural quadric surfaces with least-squaresmethod are described. And these techniques can be directly used to extract quadric surfaces featuresduring the process of segmentation for point cloud.展开更多
In this paper we present a nonmonotone trust region method for nonlinear least squares problems with zero-residual and prove its convergence properties. The extensive numerical results are reported which show that the...In this paper we present a nonmonotone trust region method for nonlinear least squares problems with zero-residual and prove its convergence properties. The extensive numerical results are reported which show that the nonmonotone trust region method is generally superior to the usual trust region method.展开更多
The Galerkin and least-squares methods are two classes of the most popular Krylov subspace methOds for solving large linear systems of equations. Unfortunately, both the methods may suffer from serious breakdowns of t...The Galerkin and least-squares methods are two classes of the most popular Krylov subspace methOds for solving large linear systems of equations. Unfortunately, both the methods may suffer from serious breakdowns of the same type: In a breakdown situation the Galerkin method is unable to calculate an approximate solution, while the least-squares method, although does not really break down, is unsucessful in reducing the norm of its residual. In this paper we first establish a unified theorem which gives a relationship between breakdowns in the two methods. We further illustrate theoretically and experimentally that if the coefficient matrix of a lienar system is of high defectiveness with the associated eigenvalues less than 1, then the restarted Galerkin and least-squares methods will be in great risks of complete breakdowns. It appears that our findings may help to understand phenomena observed practically and to derive treatments for breakdowns of this type.展开更多
We extend the oblique projection method given by Y.Saad to solve the generalized least squares problem. The corresponding oblique projection operator is presented and the convergence theorems are proved. Some necessar...We extend the oblique projection method given by Y.Saad to solve the generalized least squares problem. The corresponding oblique projection operator is presented and the convergence theorems are proved. Some necessary and sufficient conditions for computing the solution or the minimum N-norm solution of the min || A x- b ||M2 have been proposed as well.展开更多
The Galerkin-Petrov least squares method is combined with the mixed finite element method to deal with the stationary, incompressible magnetohydrodynamics system of equations with viscosity. A Galerkin-Petrov least sq...The Galerkin-Petrov least squares method is combined with the mixed finite element method to deal with the stationary, incompressible magnetohydrodynamics system of equations with viscosity. A Galerkin-Petrov least squares mixed finite element format for the stationary incompressible magnetohydrodynamics equations is presented. And the existence and error estimates of its solution are derived. Through this method, the combination among the mixed finite element spaces does not demand the discrete Babuska-Brezzi stability conditions so that the mixed finite element spaces could be chosen arbitrartily and the error estimates with optimal order could be obtained.展开更多
A least-squares finite-element method （LSFEM） for the non-conservative shallow-water equations is presented. The model is capable of handling complex topography, steady and unsteady flows, subcritical and supercriti...A least-squares finite-element method （LSFEM） for the non-conservative shallow-water equations is presented. The model is capable of handling complex topography, steady and unsteady flows, subcritical and supercritical flows, and flows with smooth and sharp gradient changes. Advantages of the model include： （1） sources terms, such as the bottom slope, surface stresses and bed frictions, can be treated easily without any special treatment; （2） upwind scheme is no needed; （3） a single approximating space can be used for all variables, and its choice of approximating space is not subject to the Ladyzhenskaya-Babuska-Brezzi （LBB） condition; and （4） the resulting system of equations is symmetric and positive-definite （SPD） which can be solved efficiently with the preconditioned conjugate gradient method. The model is verified with flow over a bump, tide induced flow, and dam-break. Computed results are compared with analytic solutions or other numerical results, and show the model is conservative and accurate. The model is then used to simulate flow past a circular cylinder. Important flow charac-teristics, such as variation of water surface around the cylinder and vortex shedding behind the cylinder are investigated. Computed results compare well with experiment data and other numerical results.展开更多
The following situation in using the method of least squares to solve problems often occurs.After m experiments completed and a solution of least squares obtained,the ( m+1 ) th experiment is made further in order ...The following situation in using the method of least squares to solve problems often occurs.After m experiments completed and a solution of least squares obtained,the ( m+1 ) th experiment is made further in order to improve the results.A method of algebraic operation of special matrices involved in the problem is given in this paper for obtaining a new solution for the m +1 experiments based upon the old solution for the primary m experiments. This method is valid for more general matrices.展开更多
The purpose of this article is to develop and analyze least-squares approximations for the incompressible magnetohydrodynamic equations. The major advantage of the least-squares finite element method is that it is not...The purpose of this article is to develop and analyze least-squares approximations for the incompressible magnetohydrodynamic equations. The major advantage of the least-squares finite element method is that it is not subjected to the so-called Ladyzhenskaya-Babuska-Brezzi （LBB） condition. The authors employ least-squares functionals which involve a discrete inner product which is related to the inner product in H^-1（Ω）.展开更多
As yet various methods have been used for determining the salinity rate of seas and oceans water. The current method of determining salinity rate of seas water has been field examination of various points of sea and d...As yet various methods have been used for determining the salinity rate of seas and oceans water. The current method of determining salinity rate of seas water has been field examination of various points of sea and determining its salinity rate. In the last decade, remote sensing satellite images have had high capability in determining sea waters salinity rate. Regarding that the present methods in remote sensing depend on the studied regions, therefore, the necessity of customization of these methods is felt. Fresh water springs due to impact on water salinity and temperature and also the environment physics and density like sound velocity are very significant and since coasts and islands of Persian Gulf are considered among arid and semi-arid regions and lack drinking water, access to fresh water springs has more significance. After studies performed, preparation of salinity rate observations and catching two series of proper images for felid data for complete coverage of the region, preprocessing and calibration was performed. For this purpose in turning the acquired radiance to reflection, ENVI software was used. The histogram of calibrated shades of gray rates in images was specified, so that reflection of each sample can be extracted from images. In this paper, the rate of least method efficiency in determining salinity rate of Persian Gulf waters was examined and finally identifying fresh water pits using remote sensing technique was done. The obtained results in the least squares methods after combining various bands of image with each other specified that combining 4 bands of 2, 3, 5 and 7 has the least standard deviation rate with training data and test, which is equal to 0.385 and 0.991978.展开更多
An adaptive mixed least squares Galerkin/Petrov finite element method （FEM） is developed for stationary conduction convection problems. The mixed least squares Galerkin/Petrov FEM is consistent and stable for any co...An adaptive mixed least squares Galerkin/Petrov finite element method （FEM） is developed for stationary conduction convection problems. The mixed least squares Galerkin/Petrov FEM is consistent and stable for any combination of discrete velocity and pressure spaces without requiring the Babuska-Brezzi stability condition. Using the general theory of Verfiirth, the posteriori error estimates of the residual type are derived. Finally, numerical tests are presented to illustrate the effectiveness of the method.展开更多
基金Supported by the National Basic Research Program of China(2007CB714006)the National Natural Science Foundation of China(90815023)
文摘An estimation approach using least squares method was presented for identificationof model parameters of pressure control in shield tunneling.The state equation ofthe pressure control system for shield tunneling was analytically derived based on themass equilibrium principle that the entry mass of the pressure chamber from cutting headwas equal to excluding mass from the screw conveyor.The randomly observed noise wasnumerically simulated and mixed to simulated observation values of system responses.The numerical simulation shows that the state equation of the pressure control system forshield tunneling is reasonable and the proposed estimation approach is effective even ifthe random observation noise exists.The robustness of the controlling procedure is validatedby numerical simulation results.
基金supported by the National Natural Science Foundation of China (No. 11071033)the Fundamental Research Funds for the Central Universities (No. 090405013)
文摘A class of preconditioned iterative methods, i.e., preconditioned generalized accelerated overrelaxation （GAOR） methods, is proposed to solve linear systems based on a class of weighted linear least squares problems. The convergence and comparison results are obtained. The comparison results show that the convergence rate of the preconditioned iterative methods is better than that of the original methods. Furthermore, the effectiveness of the proposed methods is shown in the numerical experiment.
基金supported by the National Natural Science Foundation of China,Nos.41874001 and 41664001Support Program for Outstanding Youth Talents in Jiangxi Province,No.20162BCB23050National Key Research and Development Program,No.2016YFB0501405。
文摘When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To solve this problem,we propose to add the nonparametric part(systematic errors)to the partial EIV model,and build the partial EIV model to weaken the influence of systematic errors.Then,having rewritten the model as a nonlinear model,we derive the formula of parameter estimations based on the penalized total least squares criterion.Furthermore,based on the second-order approximation method of precision estimation,we derive the second-order bias and covariance of parameter estimations and calculate the mean square error(MSE).Aiming at the selection of the smoothing factor,we propose to use the U curve method.The experiments show that the proposed method can mitigate the influence of systematic errors to a certain extent compared with the traditional method and get more reliable parameter estimations and its precision information,which validates the feasibility and effectiveness of the proposed method.
基金supported by the Shanghai Leading Academic Discipline Project (Grant No.J50101)
文摘This paper proves that the weighting method via modified Gram-Schmidt（MGS） for solving the equality constrained least squares problem in the limit is equivalent to the direct elimination method via MGS（MGS-elimination method）. By virtue of this equivalence, the backward and forward roundoff error analysis of the MGS-elimination method is proved. Numerical experiments are provided to verify the results.
基金Supported by "863" Program of P. R. China(2002AA2Z4291)
文摘Scientific forecasting water yield of mine is of great significance to the safety production of mine and the colligated using of water resources. The paper established the forecasting model for water yield of mine, combining neural network with the partial least square method. Dealt with independent variables by the partial least square method, it can not only solve the relationship between independent variables but also reduce the input dimensions in neural network model, and then use the neural network which can solve the non-linear problem better. The result of an example shows that the prediction has higher precision in forecasting and fitting.
文摘The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares. In this paper we reconsider the least squares method from the view point of Deep Learning and we carry out the computation thoroughly for the gradient descent sequence in a very simple setting. Depending on the values of the learning rate, an essential parameter of Deep Learning, the least squares methods of Statistics and Deep Learning reveal an interesting difference.
文摘The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares method, in which a parameter called learning rate plays an important role. It is in general very hard to determine its value. In this paper we generalize the preceding paper [K. Fujii: Least squares method from the view point of Deep Learning: Advances in Pure Mathematics, 8, 485-493, 2018] and give an admissible value of the learning rate, which is easily obtained.
基金supported by the National Natural Science Foundation of China(NSFC)[grant number 41374133]
文摘For geophysical inversion problems,deterministic inversion methods can easily fall into local optimal solutions,while stochastic optimization methods can theoretically converge to global optimal solutions.These problems have always been a concern for researchers.Among many stochastic optimization methods,particle swarm optimization(PSO)has been applied to solve geophysical inversion problems due to its simple principle and the fact that only a few parameters require adjustment.To overcome the nonuniqueness of inversion,model constraints can be added to PSO optimization.However,using fixed regularization parameters in PSO iteration is equivalent to keeping the default model constraint at a certain level,yielding an inversion result that is considerably affected by the model constraint.This study proposes a hybrid method that combines the regularized least squares method(RLSM)with the PSO method.The RLSM is used to improve the global optimal particle and accelerate convergence,while the adaptive regularization strategy is used to update the regularization parameters to avoid the influence of model constraints on the inversion results.Further,the inversion results of the RLSM and hybrid algorithm are compared and analyzed by considering the audio magnetotelluric synthesis and field data as examples.Experiments show that the proposed hybrid method is superior to the RLSM.Furthermore,compared with the standard PSO algorithm,the hybrid algorithm needs a broader model space but a smaller particle swarm and fewer iteration steps,thus reducing the prior conditions and the computational cost used in the inversion.
基金This project is supported by Research Foundation for Doctoral Program of Higher Education, China (No.98033532)
文摘The main purpose of reverse engineering is to convert discrete data pointsinto piecewise smooth, continuous surface models. Before carrying out model reconstruction it issignificant to extract geometric features because the quality of modeling greatly depends on therepresentation of features. Some fitting techniques of natural quadric surfaces with least-squaresmethod are described. And these techniques can be directly used to extract quadric surfaces featuresduring the process of segmentation for point cloud.
基金State Major Key Project for Basic ResearchesDecision Making and Information System Laboratory+1 种基金 Academy of Science of China Natural Science Foundation of Tsinghua University.
文摘In this paper we present a nonmonotone trust region method for nonlinear least squares problems with zero-residual and prove its convergence properties. The extensive numerical results are reported which show that the nonmonotone trust region method is generally superior to the usual trust region method.
文摘The Galerkin and least-squares methods are two classes of the most popular Krylov subspace methOds for solving large linear systems of equations. Unfortunately, both the methods may suffer from serious breakdowns of the same type: In a breakdown situation the Galerkin method is unable to calculate an approximate solution, while the least-squares method, although does not really break down, is unsucessful in reducing the norm of its residual. In this paper we first establish a unified theorem which gives a relationship between breakdowns in the two methods. We further illustrate theoretically and experimentally that if the coefficient matrix of a lienar system is of high defectiveness with the associated eigenvalues less than 1, then the restarted Galerkin and least-squares methods will be in great risks of complete breakdowns. It appears that our findings may help to understand phenomena observed practically and to derive treatments for breakdowns of this type.
基金Supported by the National Natural Science Foundation of China
文摘We extend the oblique projection method given by Y.Saad to solve the generalized least squares problem. The corresponding oblique projection operator is presented and the convergence theorems are proved. Some necessary and sufficient conditions for computing the solution or the minimum N-norm solution of the min || A x- b ||M2 have been proposed as well.
基金Project supported by the National Natural Science Foundation of China (Nos.10471100 and 40437017)the Science and Technology Foundation of Beijing Jiaotong University
文摘The Galerkin-Petrov least squares method is combined with the mixed finite element method to deal with the stationary, incompressible magnetohydrodynamics system of equations with viscosity. A Galerkin-Petrov least squares mixed finite element format for the stationary incompressible magnetohydrodynamics equations is presented. And the existence and error estimates of its solution are derived. Through this method, the combination among the mixed finite element spaces does not demand the discrete Babuska-Brezzi stability conditions so that the mixed finite element spaces could be chosen arbitrartily and the error estimates with optimal order could be obtained.
基金the National Science Council ot Taiwan,China for funding this research(Project no.:NSC 94-2218-E-035-011)
文摘A least-squares finite-element method （LSFEM） for the non-conservative shallow-water equations is presented. The model is capable of handling complex topography, steady and unsteady flows, subcritical and supercritical flows, and flows with smooth and sharp gradient changes. Advantages of the model include： （1） sources terms, such as the bottom slope, surface stresses and bed frictions, can be treated easily without any special treatment; （2） upwind scheme is no needed; （3） a single approximating space can be used for all variables, and its choice of approximating space is not subject to the Ladyzhenskaya-Babuska-Brezzi （LBB） condition; and （4） the resulting system of equations is symmetric and positive-definite （SPD） which can be solved efficiently with the preconditioned conjugate gradient method. The model is verified with flow over a bump, tide induced flow, and dam-break. Computed results are compared with analytic solutions or other numerical results, and show the model is conservative and accurate. The model is then used to simulate flow past a circular cylinder. Important flow charac-teristics, such as variation of water surface around the cylinder and vortex shedding behind the cylinder are investigated. Computed results compare well with experiment data and other numerical results.
文摘The following situation in using the method of least squares to solve problems often occurs.After m experiments completed and a solution of least squares obtained,the ( m+1 ) th experiment is made further in order to improve the results.A method of algebraic operation of special matrices involved in the problem is given in this paper for obtaining a new solution for the m +1 experiments based upon the old solution for the primary m experiments. This method is valid for more general matrices.
基金supported by the National Basic Research Program of China (2005CB321701)NSF of mathematics research special fund of Hebei Province(08M005)
文摘The purpose of this article is to develop and analyze least-squares approximations for the incompressible magnetohydrodynamic equations. The major advantage of the least-squares finite element method is that it is not subjected to the so-called Ladyzhenskaya-Babuska-Brezzi （LBB） condition. The authors employ least-squares functionals which involve a discrete inner product which is related to the inner product in H^-1（Ω）.
文摘As yet various methods have been used for determining the salinity rate of seas and oceans water. The current method of determining salinity rate of seas water has been field examination of various points of sea and determining its salinity rate. In the last decade, remote sensing satellite images have had high capability in determining sea waters salinity rate. Regarding that the present methods in remote sensing depend on the studied regions, therefore, the necessity of customization of these methods is felt. Fresh water springs due to impact on water salinity and temperature and also the environment physics and density like sound velocity are very significant and since coasts and islands of Persian Gulf are considered among arid and semi-arid regions and lack drinking water, access to fresh water springs has more significance. After studies performed, preparation of salinity rate observations and catching two series of proper images for felid data for complete coverage of the region, preprocessing and calibration was performed. For this purpose in turning the acquired radiance to reflection, ENVI software was used. The histogram of calibrated shades of gray rates in images was specified, so that reflection of each sample can be extracted from images. In this paper, the rate of least method efficiency in determining salinity rate of Persian Gulf waters was examined and finally identifying fresh water pits using remote sensing technique was done. The obtained results in the least squares methods after combining various bands of image with each other specified that combining 4 bands of 2, 3, 5 and 7 has the least standard deviation rate with training data and test, which is equal to 0.385 and 0.991978.
基金Supported by the National Natural Science Foundation of China （10231060）, the Special Research Found of Doctoral Program of Higher Education of China（200d0319003 ）, the Research Project of Xuzhou Institute of Technology（ XKY200622）.
基金supported by the National Natural Science Foundation of China(Nos.10871156 and 11171269)the Fund of Xi'an Jiaotong University(No.2009xjtujc30)
文摘An adaptive mixed least squares Galerkin/Petrov finite element method （FEM） is developed for stationary conduction convection problems. The mixed least squares Galerkin/Petrov FEM is consistent and stable for any combination of discrete velocity and pressure spaces without requiring the Babuska-Brezzi stability condition. Using the general theory of Verfiirth, the posteriori error estimates of the residual type are derived. Finally, numerical tests are presented to illustrate the effectiveness of the method.
