Based on the least-square minimization a computationally efficient learning algorithm for the Principal Component Analysis(PCA) is derived. The dual learning rate parameters are adaptively introduced to make the propo...Based on the least-square minimization a computationally efficient learning algorithm for the Principal Component Analysis(PCA) is derived. The dual learning rate parameters are adaptively introduced to make the proposed algorithm providing the capability of the fast convergence and high accuracy for extracting all the principal components. It is shown that all the information needed for PCA can be completely represented by the unnormalized weight vector which is updated based only on the corresponding neuron input-output product. The convergence performance of the proposed algorithm is briefly analyzed.The relation between Oja’s rule and the least squares learning rule is also established. Finally, a simulation example is given to illustrate the effectiveness of this algorithm for PCA.展开更多
In this paper,a new recursive least squares(RLS)identification algorithm with variable-direction forgetting(VDF)is proposed for multi-output systems.The objective is to enhance parameter estimation performance under n...In this paper,a new recursive least squares(RLS)identification algorithm with variable-direction forgetting(VDF)is proposed for multi-output systems.The objective is to enhance parameter estimation performance under non-persistent excitation.The proposed algorithm performs oblique projection decomposition of the information matrix,such that forgetting is applied only to directions where new information is received.Theoretical proofs show that even without persistent excitation,the information matrix remains lower and upper bounded,and the estimation error variance converges to be within a finite bound.Moreover,detailed analysis is made to compare with a recently reported VDF algorithm that exploits eigenvalue decomposition(VDF-ED).It is revealed that under non-persistent excitation,part of the forgotten subspace in the VDF-ED algorithm could discount old information without receiving new data,which could produce a more ill-conditioned information matrix than our proposed algorithm.Numerical simulation results demonstrate the efficacy and advantage of our proposed algorithm over this recent VDF-ED algorithm.展开更多
Kalman filter is commonly used in data filtering and parameters estimation of nonlinear system,such as projectile's trajectory estimation and control.While there is a drawback that the prior error covariance matri...Kalman filter is commonly used in data filtering and parameters estimation of nonlinear system,such as projectile's trajectory estimation and control.While there is a drawback that the prior error covariance matrix and filter parameters are difficult to be determined,which may result in filtering divergence.As to the problem that the accuracy of state estimation for nonlinear ballistic model strongly depends on its mathematical model,we improve the weighted least squares method(WLSM)with minimum model error principle.Invariant embedding method is adopted to solve the cost function including the model error.With the knowledge of measurement data and measurement error covariance matrix,we use gradient descent algorithm to determine the weighting matrix of model error.The uncertainty and linearization error of model are recursively estimated by the proposed method,thus achieving an online filtering estimation of the observations.Simulation results indicate that the proposed recursive estimation algorithm is insensitive to initial conditions and of good robustness.展开更多
Vehicle mass is an important parameter in vehicle dynamics control systems. Although many algorithms have been developed for the estimation of mass, none of them have yet taken into account the different types of resi...Vehicle mass is an important parameter in vehicle dynamics control systems. Although many algorithms have been developed for the estimation of mass, none of them have yet taken into account the different types of resistance that occur under different conditions. This paper proposes a vehicle mass estimator. The estimator incorporates road gradient information in the longitudinal accelerometer signal, and it removes the road grade from the longitudinal dynamics of the vehicle. Then, two different recursive least square method （RLSM） schemes are proposed to estimate the driving resistance and the mass independently based on the acceleration partition under different conditions. A 6 DOF dynamic model of four In-wheel Motor Vehicle is built to assist in the design of the algorithm and in the setting of the parameters. The acceleration limits are determined to not only reduce the estimated error but also ensure enough data for the resistance estimation and mass estimation in some critical situations. The modification of the algorithm is also discussed to improve the result of the mass estimation. Experiment data on asphalt road, plastic runway, and gravel road and on sloping roads are used to validate the estimation algorithm. The adaptability of the algorithm is improved by using data collected under several critical operating conditions. The experimental results show the error of the estimation process to be within 2.6%, which indicates that the algorithm can estimate mass with great accuracy regardless of the road surface and gradient changes and that it may be valuable in engineering applications. This paper proposes a recursive least square vehicle mass estimation method based on acceleration partition.展开更多
A multi-loop adaptive internal model control (IMC) strategy based on a dynamic partial least squares (PLS) frame-work is proposed to account for plant model errors caused by slow aging,drift in operational conditions,...A multi-loop adaptive internal model control (IMC) strategy based on a dynamic partial least squares (PLS) frame-work is proposed to account for plant model errors caused by slow aging,drift in operational conditions,or environmental changes.Since PLS decomposition structure enables multi-loop controller design within latent spaces,a multivariable adaptive control scheme can be converted easily into several independent univariable control loops in the PLS space.In each latent subspace,once the model error exceeds a specific threshold,online adaptation rules are implemented separately to correct the plant model mismatch via a recursive least squares (RLS) algorithm.Because the IMC extracts the inverse of the minimum part of the internal model as its structure,the IMC controller is self-tuned by explicitly updating the parameters,which are parts of the internal model.Both parameter convergence and system stability are briefly analyzed,and proved to be effective.Finally,the proposed control scheme is tested and evaluated using a widely-used benchmark of a multi-input multi-output (MIMO) system with pure delay.展开更多
RLS and LMS blind adaptive multi-user detection algorithm and multi-user detector was proposed to solve the problem of multi-user signal detection problem encountered in underwater acoustic communication networks.In s...RLS and LMS blind adaptive multi-user detection algorithm and multi-user detector was proposed to solve the problem of multi-user signal detection problem encountered in underwater acoustic communication networks.In simulation analysis,RLS and the LMS blind adaptive multi-user detector were designed and tested for synchronous and asynchronous multi-user communication process.The results of SIR comparison and MMSE comparison show that,both of the two methods can realize blind adaptive detection when any user change in multi-user communication,during this process,the training communication sequences are not needed.The RLS algorithm has about 5 dB higher in SIR compared with LMS algorithm,and the convergence velocity of RLS algorithm is also higher than LMS algorithm when the communication users change.RLS algorithm has better ability in multi-user detection than that of LMS algorithm,and it has great attraction and guiding significance for solving the problem of multiple access interference(MAI) in multi-user communication.展开更多
In this paper establishing model of the fault diagnosis of hydraulic equipment isdescribed in details. It also studies the advantage of the recursion least square method. When theLSM is used in compuring the fault of...In this paper establishing model of the fault diagnosis of hydraulic equipment isdescribed in details. It also studies the advantage of the recursion least square method. When theLSM is used in compuring the fault of hydraulic equipment, not only does it save the computerCPU-time and memory, but it also has a high computation speed and,makes it easy to identifythe estimation parameters.展开更多
针对并联型有源电力滤波器(active power filter,APF)谐波检测环节的延时和谐波电流跟踪环节的鲁棒性差、跟踪精度不高的问题,建立了系统解耦后的数学模型,提出了基于递归最小二乘(recursive least squares,RLS)算法的并联型APF全局积...针对并联型有源电力滤波器(active power filter,APF)谐波检测环节的延时和谐波电流跟踪环节的鲁棒性差、跟踪精度不高的问题,建立了系统解耦后的数学模型,提出了基于递归最小二乘(recursive least squares,RLS)算法的并联型APF全局积分滑模变结构控制策略。谐波检测环节采用改进的瞬时无功功率理论的id-iq法,用RLS自适应滤波器替换传统的Butterworth低通滤波器,解决了传统的Butterworth低通滤波器因延时而导致的一个基波周期(20 ms)内检测盲区问题。谐波电流跟踪环节采用全局积分滑模变结构控制方法,引入了全局积分滑模面,运用Lyapunov稳定性理论导出的控制律兼顾了全局滑模的快速性和积分滑模的准确性。在解决了谐波检测环节延时的情况下,将全局积分滑模控制策略与传统的PI控制和滞环控制对比,仿真实验结果表明:全局积分滑模控制对指令电流具有更高的跟踪精度,且具有更低的电网侧电流总谐波畸变率(total harmonic distortion,THD)。展开更多
基金Supported by the National Natural Science Foundation of Chinathe Science foundation of Guangxi Educational Administration
文摘Based on the least-square minimization a computationally efficient learning algorithm for the Principal Component Analysis(PCA) is derived. The dual learning rate parameters are adaptively introduced to make the proposed algorithm providing the capability of the fast convergence and high accuracy for extracting all the principal components. It is shown that all the information needed for PCA can be completely represented by the unnormalized weight vector which is updated based only on the corresponding neuron input-output product. The convergence performance of the proposed algorithm is briefly analyzed.The relation between Oja’s rule and the least squares learning rule is also established. Finally, a simulation example is given to illustrate the effectiveness of this algorithm for PCA.
基金supported by the National Natural Science Foundation of China(61803163,61991414,61873301)。
文摘In this paper,a new recursive least squares(RLS)identification algorithm with variable-direction forgetting(VDF)is proposed for multi-output systems.The objective is to enhance parameter estimation performance under non-persistent excitation.The proposed algorithm performs oblique projection decomposition of the information matrix,such that forgetting is applied only to directions where new information is received.Theoretical proofs show that even without persistent excitation,the information matrix remains lower and upper bounded,and the estimation error variance converges to be within a finite bound.Moreover,detailed analysis is made to compare with a recently reported VDF algorithm that exploits eigenvalue decomposition(VDF-ED).It is revealed that under non-persistent excitation,part of the forgotten subspace in the VDF-ED algorithm could discount old information without receiving new data,which could produce a more ill-conditioned information matrix than our proposed algorithm.Numerical simulation results demonstrate the efficacy and advantage of our proposed algorithm over this recent VDF-ED algorithm.
基金This work is supported by Postgraduate Research&Practice Innovation Program of Jiangsu Province(KYCX18_0467)Jiangsu Province,China.During the revision of this paper,the author is supported by China Scholarship Council(No.201906840021)China to continue some research related to data processing.
文摘Kalman filter is commonly used in data filtering and parameters estimation of nonlinear system,such as projectile's trajectory estimation and control.While there is a drawback that the prior error covariance matrix and filter parameters are difficult to be determined,which may result in filtering divergence.As to the problem that the accuracy of state estimation for nonlinear ballistic model strongly depends on its mathematical model,we improve the weighted least squares method(WLSM)with minimum model error principle.Invariant embedding method is adopted to solve the cost function including the model error.With the knowledge of measurement data and measurement error covariance matrix,we use gradient descent algorithm to determine the weighting matrix of model error.The uncertainty and linearization error of model are recursively estimated by the proposed method,thus achieving an online filtering estimation of the observations.Simulation results indicate that the proposed recursive estimation algorithm is insensitive to initial conditions and of good robustness.
基金Supported by National Basic Research Program of China(Grant No.2011CB711200)
文摘Vehicle mass is an important parameter in vehicle dynamics control systems. Although many algorithms have been developed for the estimation of mass, none of them have yet taken into account the different types of resistance that occur under different conditions. This paper proposes a vehicle mass estimator. The estimator incorporates road gradient information in the longitudinal accelerometer signal, and it removes the road grade from the longitudinal dynamics of the vehicle. Then, two different recursive least square method （RLSM） schemes are proposed to estimate the driving resistance and the mass independently based on the acceleration partition under different conditions. A 6 DOF dynamic model of four In-wheel Motor Vehicle is built to assist in the design of the algorithm and in the setting of the parameters. The acceleration limits are determined to not only reduce the estimated error but also ensure enough data for the resistance estimation and mass estimation in some critical situations. The modification of the algorithm is also discussed to improve the result of the mass estimation. Experiment data on asphalt road, plastic runway, and gravel road and on sloping roads are used to validate the estimation algorithm. The adaptability of the algorithm is improved by using data collected under several critical operating conditions. The experimental results show the error of the estimation process to be within 2.6%, which indicates that the algorithm can estimate mass with great accuracy regardless of the road surface and gradient changes and that it may be valuable in engineering applications. This paper proposes a recursive least square vehicle mass estimation method based on acceleration partition.
基金Project supported by the National Natural Science Foundation of China (No.60574047)the National High-Tech R & D Program (863)of China (No.2007AA04Z168)the Research Fund for the Doctoral Program of Higher Education of China (No.20050335018)
文摘A multi-loop adaptive internal model control (IMC) strategy based on a dynamic partial least squares (PLS) frame-work is proposed to account for plant model errors caused by slow aging,drift in operational conditions,or environmental changes.Since PLS decomposition structure enables multi-loop controller design within latent spaces,a multivariable adaptive control scheme can be converted easily into several independent univariable control loops in the PLS space.In each latent subspace,once the model error exceeds a specific threshold,online adaptation rules are implemented separately to correct the plant model mismatch via a recursive least squares (RLS) algorithm.Because the IMC extracts the inverse of the minimum part of the internal model as its structure,the IMC controller is self-tuned by explicitly updating the parameters,which are parts of the internal model.Both parameter convergence and system stability are briefly analyzed,and proved to be effective.Finally,the proposed control scheme is tested and evaluated using a widely-used benchmark of a multi-input multi-output (MIMO) system with pure delay.
基金financially supported by Key Technologies R&D Program of Shandong Province(2015GSF115018)Natural Science Foundation of Shandong Province(ZR2013FL027+1 种基金ZR2013DM 014)Youth Foundation of Shandong Academy of Science(2013QN030)
文摘RLS and LMS blind adaptive multi-user detection algorithm and multi-user detector was proposed to solve the problem of multi-user signal detection problem encountered in underwater acoustic communication networks.In simulation analysis,RLS and the LMS blind adaptive multi-user detector were designed and tested for synchronous and asynchronous multi-user communication process.The results of SIR comparison and MMSE comparison show that,both of the two methods can realize blind adaptive detection when any user change in multi-user communication,during this process,the training communication sequences are not needed.The RLS algorithm has about 5 dB higher in SIR compared with LMS algorithm,and the convergence velocity of RLS algorithm is also higher than LMS algorithm when the communication users change.RLS algorithm has better ability in multi-user detection than that of LMS algorithm,and it has great attraction and guiding significance for solving the problem of multiple access interference(MAI) in multi-user communication.
文摘In this paper establishing model of the fault diagnosis of hydraulic equipment isdescribed in details. It also studies the advantage of the recursion least square method. When theLSM is used in compuring the fault of hydraulic equipment, not only does it save the computerCPU-time and memory, but it also has a high computation speed and,makes it easy to identifythe estimation parameters.
文摘针对并联型有源电力滤波器(active power filter,APF)谐波检测环节的延时和谐波电流跟踪环节的鲁棒性差、跟踪精度不高的问题,建立了系统解耦后的数学模型,提出了基于递归最小二乘(recursive least squares,RLS)算法的并联型APF全局积分滑模变结构控制策略。谐波检测环节采用改进的瞬时无功功率理论的id-iq法,用RLS自适应滤波器替换传统的Butterworth低通滤波器,解决了传统的Butterworth低通滤波器因延时而导致的一个基波周期(20 ms)内检测盲区问题。谐波电流跟踪环节采用全局积分滑模变结构控制方法,引入了全局积分滑模面,运用Lyapunov稳定性理论导出的控制律兼顾了全局滑模的快速性和积分滑模的准确性。在解决了谐波检测环节延时的情况下,将全局积分滑模控制策略与传统的PI控制和滞环控制对比,仿真实验结果表明:全局积分滑模控制对指令电流具有更高的跟踪精度,且具有更低的电网侧电流总谐波畸变率(total harmonic distortion,THD)。
