With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main devel...With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main development direction in harmonic control subjects. This paper, based on linear regression analysis of basic equation and improvement equation, deduced the least squares estimation (LSE) iterative algorithm and obtained the real-time estimates of regression coefficients, and then calculated the level of the harmonic impedance and emission estimates in real time. This paper used power system simulation software Matlab/Simulink as analysis tool and analyzed the user side of the harmonic amplitude and phase fluctuations PCC (point of common coupling) at the harmonic emission level, thus the research has a certain theoretical significance. The development of this algorithm combined with the instrument can be used in practical engineering.展开更多
This paper proposes a recursive least squares algorithm for a nonlinear additive system with time delay.By the Weierstrass approximation theorem and the key term separation principle, the model can be simplified as an...This paper proposes a recursive least squares algorithm for a nonlinear additive system with time delay.By the Weierstrass approximation theorem and the key term separation principle, the model can be simplified as an identification model. Based on the identification model, a recursive least squares identification algorithm is used to estimate all the unknown parameters of the time-delayed additive system. An example is provided to show the effectiveness of the proposed algorithm.展开更多
Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order ...Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order of the underlying model isunknown.On the basis of several universal formulae for updating nonsymmetric projec-tion operators,this paper presents three kinds of LS algorithms,called nonsymmetric,symmetric and square root normalized fast ORLS algorithms,respectively.As to the au-thors’ knowledge,the first and the third have not been so far provided,and the second isone of those which have the lowest computational requirement.Several simplified versionsof the algorithms are also considered.展开更多
The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge...The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge extraction. All these desired properties depend crucially on the ability to construct appropriate parsimonious models by the modelling process, and a basic principle in practical nonlinear data modelling is the parsimonious principle of ensuring the smallest possible model that explains the training data. There exists a vast amount of works in the area of sparse modelling, and a widely adopted approach is based on the linear-in-the-parameters data modelling that include the radial basis function network, the neurofuzzy network and all the sparse kernel modelling techniques. A well tested strategy for parsimonious modelling from data is the orthogonal least squares (OLS) algorithm for forward selection modelling, which is capable of constructing sparse models that generalise well. This contribution continues this theme and provides a unified framework for sparse modelling from data that includes regression and classification, which belong to supervised learning, and probability density function estimation, which is an unsupervised learning problem. The OLS forward selection method based on the leave-one-out test criteria is presented within this unified data-modelling framework. Examples from regression, classification and density estimation applications are used to illustrate the effectiveness of this generic parsimonious modelling approach from data.展开更多
A new channel estimation and data detection joint algorithm is proposed for multi-input multi-output （MIMO） - orthogonal frequency division multiplexing （OFDM） system using linear minimum mean square error （LMMSE...A new channel estimation and data detection joint algorithm is proposed for multi-input multi-output （MIMO） - orthogonal frequency division multiplexing （OFDM） system using linear minimum mean square error （LMMSE）- based space-alternating generalized expectation-maximization （SAGE） algorithm. In the proposed algorithm, every sub-frame of the MIMO-OFDM system is divided into some OFDM sub-blocks and the LMMSE-based SAGE algorithm in each sub-block is used. At the head of each sub-flame, we insert training symbols which are used in the initial estimation at the beginning. Channel estimation of the previous sub-block is applied to the initial estimation in the current sub-block by the maximum-likelihood （ML） detection to update channel estimatjon and data detection by iteration until converge. Then all the sub-blocks can be finished in turn. Simulation results show that the proposed algorithm can improve the bit error rate （BER） performance.展开更多
We study the least squares estimation of drift parameters for a class of stochastic differential equations driven by small a-stable noises, observed at n regularly spaced time points ti = i/n, i = 1,...,n on [0, 1]. U...We study the least squares estimation of drift parameters for a class of stochastic differential equations driven by small a-stable noises, observed at n regularly spaced time points ti = i/n, i = 1,...,n on [0, 1]. Under some regularity conditions, we obtain the consistency and the rate of convergence of the least squares estimator （LSE） when a small dispersion parameter ε→0 and n →∞ simultaneously. The asymptotic distribution of the LSE in our setting is shown to be stable, which is completely different from the classical cases where asymptotic distributions are normal.展开更多
In this paper, two approaches are developed for directly identifying single-rate models of dual-rate stochastic systems in which the input updating frequency is an integer multiple of the output sampling frequency. Th...In this paper, two approaches are developed for directly identifying single-rate models of dual-rate stochastic systems in which the input updating frequency is an integer multiple of the output sampling frequency. The first is the generalized Yule-Walker algorithm and the second is a two-stage algorithm based on the correlation technique. The basic idea is to directly identify the parameters of underlying single-rate models instead of the lifted models of dual-rate systems from the dual-rate input-output data, assuming that the measurement data are stationary and ergodic. An example is given.展开更多
Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear mode...Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.展开更多
In this paper, a new method for solving the parameters of multivariate EIV model is proposed. The likelihood function of multivariate EIV model is constructed based on the principle of maximum likelihood estimation. T...In this paper, a new method for solving the parameters of multivariate EIV model is proposed. The likelihood function of multivariate EIV model is constructed based on the principle of maximum likelihood estimation. The formula for solving the parameters is deduced, and two algorithms for solving the parameters were given. Finally, a real calculation example and a simulation example are used to verify the results, and the results of the proposed method are compared with those of the existing methods. The results show that the proposed method can achieve the same results as the existing methods, which verifies the feasibility of the proposed method.展开更多
针对传统稀疏系统辨识算法对测量噪声和调谐参数敏感的问题,提出了一种全范围零吸引最小均方(full-range zero-attracting least mean square,FZA-LMS)稀疏系统辨识算法。该算法能够有效处理零吸引范围内的近零系数和小系数,进一步优化...针对传统稀疏系统辨识算法对测量噪声和调谐参数敏感的问题,提出了一种全范围零吸引最小均方(full-range zero-attracting least mean square,FZA-LMS)稀疏系统辨识算法。该算法能够有效处理零吸引范围内的近零系数和小系数,进一步优化零吸引范围外的大系数,降低稳态均方误差(mean square deviation,MSD),提升收敛速度,增强对调谐参数和测量噪声的鲁棒性。仿真实验结果表明,与传统稀疏系统辨识算法相比,提出的算法在稀疏声学回声信道下表现出更低的稳态MSD,对调谐参数和测量噪声具有更强的鲁棒性。针对水声信道估计场景下的复数信道,进一步提出了算法的复数形式。实验结果表明,在该场景下,复数形式算法相较于其他算法具有更优越的性能表现。展开更多
文摘With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main development direction in harmonic control subjects. This paper, based on linear regression analysis of basic equation and improvement equation, deduced the least squares estimation (LSE) iterative algorithm and obtained the real-time estimates of regression coefficients, and then calculated the level of the harmonic impedance and emission estimates in real time. This paper used power system simulation software Matlab/Simulink as analysis tool and analyzed the user side of the harmonic amplitude and phase fluctuations PCC (point of common coupling) at the harmonic emission level, thus the research has a certain theoretical significance. The development of this algorithm combined with the instrument can be used in practical engineering.
基金the National Natural Science Foundation of China(No.61403165)the Natural Science Foundation of Jiangsu Province(Nos.BK20131109 and BK20141115)+1 种基金the Project of Philosophy and Social Science Research in Colleges and Universities in Jiangsu Province(No.2014SJD381)the Post Doctoral Foundation of Jiangsu Province(No.1501015A)
文摘This paper proposes a recursive least squares algorithm for a nonlinear additive system with time delay.By the Weierstrass approximation theorem and the key term separation principle, the model can be simplified as an identification model. Based on the identification model, a recursive least squares identification algorithm is used to estimate all the unknown parameters of the time-delayed additive system. An example is provided to show the effectiveness of the proposed algorithm.
文摘Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order of the underlying model isunknown.On the basis of several universal formulae for updating nonsymmetric projec-tion operators,this paper presents three kinds of LS algorithms,called nonsymmetric,symmetric and square root normalized fast ORLS algorithms,respectively.As to the au-thors’ knowledge,the first and the third have not been so far provided,and the second isone of those which have the lowest computational requirement.Several simplified versionsof the algorithms are also considered.
文摘The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge extraction. All these desired properties depend crucially on the ability to construct appropriate parsimonious models by the modelling process, and a basic principle in practical nonlinear data modelling is the parsimonious principle of ensuring the smallest possible model that explains the training data. There exists a vast amount of works in the area of sparse modelling, and a widely adopted approach is based on the linear-in-the-parameters data modelling that include the radial basis function network, the neurofuzzy network and all the sparse kernel modelling techniques. A well tested strategy for parsimonious modelling from data is the orthogonal least squares (OLS) algorithm for forward selection modelling, which is capable of constructing sparse models that generalise well. This contribution continues this theme and provides a unified framework for sparse modelling from data that includes regression and classification, which belong to supervised learning, and probability density function estimation, which is an unsupervised learning problem. The OLS forward selection method based on the leave-one-out test criteria is presented within this unified data-modelling framework. Examples from regression, classification and density estimation applications are used to illustrate the effectiveness of this generic parsimonious modelling approach from data.
基金Supported by the National Natural Science Foundation of China （No. 61001105）, the National Science and Technology Major Projects （No. 2011ZX03001- 007- 03） and Beijing Natural Science Foundation （No. 4102043）.
文摘A new channel estimation and data detection joint algorithm is proposed for multi-input multi-output （MIMO） - orthogonal frequency division multiplexing （OFDM） system using linear minimum mean square error （LMMSE）- based space-alternating generalized expectation-maximization （SAGE） algorithm. In the proposed algorithm, every sub-frame of the MIMO-OFDM system is divided into some OFDM sub-blocks and the LMMSE-based SAGE algorithm in each sub-block is used. At the head of each sub-flame, we insert training symbols which are used in the initial estimation at the beginning. Channel estimation of the previous sub-block is applied to the initial estimation in the current sub-block by the maximum-likelihood （ML） detection to update channel estimatjon and data detection by iteration until converge. Then all the sub-blocks can be finished in turn. Simulation results show that the proposed algorithm can improve the bit error rate （BER） performance.
基金supported by FAU Start-up funding at the C. E. Schmidt Collegeof Science
文摘We study the least squares estimation of drift parameters for a class of stochastic differential equations driven by small a-stable noises, observed at n regularly spaced time points ti = i/n, i = 1,...,n on [0, 1]. Under some regularity conditions, we obtain the consistency and the rate of convergence of the least squares estimator （LSE） when a small dispersion parameter ε→0 and n →∞ simultaneously. The asymptotic distribution of the LSE in our setting is shown to be stable, which is completely different from the classical cases where asymptotic distributions are normal.
基金This work was supported by the National Natural Science Foundation of China (No. 60574051).
文摘In this paper, two approaches are developed for directly identifying single-rate models of dual-rate stochastic systems in which the input updating frequency is an integer multiple of the output sampling frequency. The first is the generalized Yule-Walker algorithm and the second is a two-stage algorithm based on the correlation technique. The basic idea is to directly identify the parameters of underlying single-rate models instead of the lifted models of dual-rate systems from the dual-rate input-output data, assuming that the measurement data are stationary and ergodic. An example is given.
文摘Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.
文摘In this paper, a new method for solving the parameters of multivariate EIV model is proposed. The likelihood function of multivariate EIV model is constructed based on the principle of maximum likelihood estimation. The formula for solving the parameters is deduced, and two algorithms for solving the parameters were given. Finally, a real calculation example and a simulation example are used to verify the results, and the results of the proposed method are compared with those of the existing methods. The results show that the proposed method can achieve the same results as the existing methods, which verifies the feasibility of the proposed method.
文摘针对传统稀疏系统辨识算法对测量噪声和调谐参数敏感的问题,提出了一种全范围零吸引最小均方(full-range zero-attracting least mean square,FZA-LMS)稀疏系统辨识算法。该算法能够有效处理零吸引范围内的近零系数和小系数,进一步优化零吸引范围外的大系数,降低稳态均方误差(mean square deviation,MSD),提升收敛速度,增强对调谐参数和测量噪声的鲁棒性。仿真实验结果表明,与传统稀疏系统辨识算法相比,提出的算法在稀疏声学回声信道下表现出更低的稳态MSD,对调谐参数和测量噪声具有更强的鲁棒性。针对水声信道估计场景下的复数信道,进一步提出了算法的复数形式。实验结果表明,在该场景下,复数形式算法相较于其他算法具有更优越的性能表现。
