For nonlinear state estimation driven by non-Gaussian noise,the estimator is required to be updated iteratively.Since the iterative update approximates a linear process,it fails to capture the nonlinearity of observat...For nonlinear state estimation driven by non-Gaussian noise,the estimator is required to be updated iteratively.Since the iterative update approximates a linear process,it fails to capture the nonlinearity of observation models,and this further degrades filtering accuracy and consistency.Given the flaws of nonlinear iteration,this work incorporates a recursive strategy into generalized M-estimation rather than the iterative strategy.The proposed algorithm extends nonlinear recursion to nonlinear systems using the statistical linear regression method.The recursion allows for the gradual release of observation information and consequently enables the update to proceed along the nonlinear direction.Considering the correlated state and observation noise induced by recursions,a separately reweighting strategy is adopted to build a robust nonlinear system.Analogous to the nonlinear recursion,a robust nonlinear recursive update strategy is proposed,where the associated covariances and the observation noise statistics are updated recursively to ensure the consistency of observation noise statistics,thereby completing the nonlinear solution of the robust system.Compared with the iterative update strategies under non-Gaussian observation noise,the recursive update strategy can facilitate the estimator to achieve higher filtering accuracy,stronger robustness,and better consistency.Therefore,the proposed strategy is more suitable for the robust nonlinear filtering framework.展开更多
In this paper,the newly-derived maximum correntropy Kalman filter(MCKF)is re-derived from the M-estimation perspective,where the MCKF can be viewed as a special case of the M-estimations and the Gaussian kernel functi...In this paper,the newly-derived maximum correntropy Kalman filter(MCKF)is re-derived from the M-estimation perspective,where the MCKF can be viewed as a special case of the M-estimations and the Gaussian kernel function is a special case of many robust cost functions.Based on the derivation process,a unified form for the robust Gaussian filters(RGF)based on M-estimation is proposed to suppress the outliers and non-Gaussian noise in the measurement.The RGF provides a unified form for one Gaussian filter with different cost functions and a unified form for one robust filter with different approximating methods for the involved Gaussian integrals.Simulation results show that RGF with different weighting functions and different Gaussian integral approximation methods has robust antijamming performance.展开更多
The M-estimate of parameters in the errors-in-variables (EV) model Y =xτβ0+∈,X =x+u ((∈,uτ)τ is a (p+1)-dimensional spherical error, Coy[(∈, uτ)τ] =σ2Ip+1)being considered. The M-estimate βn,, of β0 under ...The M-estimate of parameters in the errors-in-variables (EV) model Y =xτβ0+∈,X =x+u ((∈,uτ)τ is a (p+1)-dimensional spherical error, Coy[(∈, uτ)τ] =σ2Ip+1)being considered. The M-estimate βn,, of β0 under a general ρ(·) function and the estimateof σ2 are given, the strong consistency and asymptotic normality of βn as well as are obtained. The conditions for the ρ(·) function in this paper are similar to that of linearexpression of M-estimates in the linear regression model.展开更多
The strong consistency of M-estimates of the regression coefficients in a linear model under some mild conditions is established, which is an essential improvement over the relevant results in the literature on the mo...The strong consistency of M-estimates of the regression coefficients in a linear model under some mild conditions is established, which is an essential improvement over the relevant results in the literature on the moment condition. Especially, in some important circumstances, onlyE|ψ(ek)|q for some q > 1 is needed, where ψ{ek} is some score function of random error.展开更多
The authors establish the approximations to the distribution of M-estimates in a linear model by the bootstrap and the linear representation of bootstrap M-estimation, and prove that the approximation is valid in prob...The authors establish the approximations to the distribution of M-estimates in a linear model by the bootstrap and the linear representation of bootstrap M-estimation, and prove that the approximation is valid in probability 1. A simulation is made to show the effects of bootstrap approximation, randomly weighted approximation and normal approximation.展开更多
The existing collaborative recommendation algorithms have lower robustness against shilling attacks.With this problem in mind,in this paper we propose a robust collaborative recommendation algorithm based on k-distanc...The existing collaborative recommendation algorithms have lower robustness against shilling attacks.With this problem in mind,in this paper we propose a robust collaborative recommendation algorithm based on k-distance and Tukey M-estimator.Firstly,we propose a k-distancebased method to compute user suspicion degree(USD).The reliable neighbor model can be constructed through incorporating the user suspicion degree into user neighbor model.The influence of attack profiles on the recommendation results is reduced through adjusting similarities among users.Then,Tukey M-estimator is introduced to construct robust matrix factorization model,which can realize the robust estimation of user feature matrix and item feature matrix and reduce the influence of attack profiles on item feature matrix.Finally,a robust collaborative recommendation algorithm is devised by combining the reliable neighbor model and robust matrix factorization model.Experimental results show that the proposed algorithm outperforms the existing methods in terms of both recommendation accuracy and robustness.展开更多
Recursive algorithms are very useful for computing M-estimators of regression coefficients and scatter parameters. In this article, it is shown that for a nondecreasing ul （t）, under some mild conditions the recursi...Recursive algorithms are very useful for computing M-estimators of regression coefficients and scatter parameters. In this article, it is shown that for a nondecreasing ul （t）, under some mild conditions the recursive M-estimators of regression coefficients and scatter parameters are strongly consistent and the recursive M-estimator of the regression coefficients is also asymptotically normal distributed. Furthermore, optimal recursive M-estimators, asymptotic efficiencies of recursive M-estimators and asymptotic relative efficiencies between recursive M-estimators of regression coefficients are studied.展开更多
In this paper, to keep scale inveriance, we propose an approximate M-estrmation for the mixed regression model and show consistency of the estimation under weaker conditions than that in [1].
This paper adopts satellite channel brightness temperature simulation to study M-estimator variational retrieval. This approach combines both the advantages of classical variational inversion and robust M-estimators. ...This paper adopts satellite channel brightness temperature simulation to study M-estimator variational retrieval. This approach combines both the advantages of classical variational inversion and robust M-estimators. Classical variational inversion depends on prior quality control to elim- inate outliers, and its errors follow a Gaussian distribution. We coupled the M-estimators to the framework of classical variational inversion to obtain a M-estimator variational inversion. The cost function contains the M-estimator to guarantee the robustness to outliers and improve the retrieval re- sults. The experimental evaluation adopts Feng Yun-3A （FY-3A） simulated data to add to the Gaussian and Non-Gaussian error. The variational in- version is used to obtain the inversion brightness temperature, and temperature and humidity data are used for validation. The preliminary results demonstrate the potential of M-estimator variational retrieval.展开更多
In this paper, by using the Brouwer fixed point theorem, we consider the existence and uniqueness of the solution for local linear regression with variable window breadth.
The vanishing point detection technology helps automatic driving. In this paper, the straight lines on the road associated with the vanishing point are extracted efficiently by using the regional division and angle li...The vanishing point detection technology helps automatic driving. In this paper, the straight lines on the road associated with the vanishing point are extracted efficiently by using the regional division and angle limitation. And, the vanishing point is detected robustly by using the fast M-estimation method. Proposed method could detect straight-line features associated with vanishing point detection efficient on the road. And the vanishing point was detected exactly by the effect of the fast M-estimation method when the straight-line features not associated with vanishing point detection were detected. The processing time of the proposed method was faster than the camera flame rate （30 fps）. Thus, the proposed method is capable of real-time processing.展开更多
In real-world applications, datasets frequently contain outliers, which can hinder the generalization ability of machine learning models. Bayesian classifiers, a popular supervised learning method, rely on accurate pr...In real-world applications, datasets frequently contain outliers, which can hinder the generalization ability of machine learning models. Bayesian classifiers, a popular supervised learning method, rely on accurate probability density estimation for classifying continuous datasets. However, achieving precise density estimation with datasets containing outliers poses a significant challenge. This paper introduces a Bayesian classifier that utilizes optimized robust kernel density estimation to address this issue. Our proposed method enhances the accuracy of probability density distribution estimation by mitigating the impact of outliers on the training sample’s estimated distribution. Unlike the conventional kernel density estimator, our robust estimator can be seen as a weighted kernel mapping summary for each sample. This kernel mapping performs the inner product in the Hilbert space, allowing the kernel density estimation to be considered the average of the samples’ mapping in the Hilbert space using a reproducing kernel. M-estimation techniques are used to obtain accurate mean values and solve the weights. Meanwhile, complete cross-validation is used as the objective function to search for the optimal bandwidth, which impacts the estimator. The Harris Hawks Optimisation optimizes the objective function to improve the estimation accuracy. The experimental results show that it outperforms other optimization algorithms regarding convergence speed and objective function value during the bandwidth search. The optimal robust kernel density estimator achieves better fitness performance than the traditional kernel density estimator when the training data contains outliers. The Naïve Bayesian with optimal robust kernel density estimation improves the generalization in the classification with outliers.展开更多
We propose a novel method that combines gray system theory and robust M-estimation method to suppress the interference in controlled-source electromagnetic data. We estimate the standard deviation of the data using a ...We propose a novel method that combines gray system theory and robust M-estimation method to suppress the interference in controlled-source electromagnetic data. We estimate the standard deviation of the data using a gray model because of the weak dependence of the gray system on data distribution and size. We combine the proposed and threshold method to identify and eliminate outliers. Robust M-estimation is applied to suppress the effect of the outliers and improve the accuracy. We treat the M-estimators of the preserved data as the true data. We use our method to reject the outliers in simulated signals containing noise to verify the feasibility of our proposed method. The processed values are observed to be approximate to the expected values with high accuracy. The maximum relative error is 3.6676%, whereas the minimum is 0.0251%. In processing field data, we observe that the proposed method eliminates outliers, minimizes the root-mean-square error, and improves the reliability of controlled-source electromagnetic data in follow-up processing and interpretation.展开更多
Conventional adaptive filtering algorithms often exhibit performance degradation when processing multipath interference in raw echoes of spaceborne synthetic aperture radar(SAR)systems due to anomalous outliers,manife...Conventional adaptive filtering algorithms often exhibit performance degradation when processing multipath interference in raw echoes of spaceborne synthetic aperture radar(SAR)systems due to anomalous outliers,manifesting as insufficient convergence and low estimation accuracy.To address this issue,this study proposes a novel robust adaptive filtering algorithm,namely the M-estimation-based minimum error entropy with affine projection(APMMEE)algorithm.This algorithm inherits the joint multi-data-block update mechanism of the affine projection algorithm,enabling rapid adaptation to the dynamic characteristics of raw echoes and achieving fast convergence.Meanwhile,it incorporates the M-estimation-based minimum error entropy(MMEE)criterion,which weights error samples in raw echoes through M-estimation functions,effectively suppressing outlier interference during the algorithm update.Both the system identification simulations and practical multipath interference suppression experiments using raw echoes demonstrate that the proposed APMMEE algorithm exhibits superior filtering performance.展开更多
As a production quality index of hematite grinding process,particle size(PS)is hard to be measured in real time.To achieve the PS estimation,this paper proposes a novel data driven model of PS using stochastic configu...As a production quality index of hematite grinding process,particle size(PS)is hard to be measured in real time.To achieve the PS estimation,this paper proposes a novel data driven model of PS using stochastic configuration network(SCN)with robust technique,namely,robust SCN(RSCN).Firstly,this paper proves the universal approximation property of RSCN with weighted least squares technique.Secondly,three robust algorithms are presented by employing M-estimation with Huber loss function,M-estimation with interquartile range(IQR)and nonparametric kernel density estimation(NKDE)function respectively to set the penalty weight.Comparison experiments are first carried out based on the UCI standard data sets to verify the effectiveness of these methods,and then the data-driven PS model based on the robust algorithms are established and verified.Experimental results show that the RSCN has an excellent performance for the PS estimation.展开更多
Outlier in one variable will smear the estimation of other measurements in data reconciliation （DR）. In this article, a novel robust method is proposed for nonlinear dynamic data reconciliation, to reduce the influe...Outlier in one variable will smear the estimation of other measurements in data reconciliation （DR）. In this article, a novel robust method is proposed for nonlinear dynamic data reconciliation, to reduce the influence of outliers on the result of DR. This method introduces a penalty function matrix in a conventional least-square objective function, to assign small weights for outliers and large weights for normal measurements. To avoid the loss of data information, element-wise Mahalanobis distance is proposed, as an improvement on vector-wise distance, to construct a penalty function matrix. The correlation of measurement error is also considered in this article. The method introduces the robust statistical theory into conventional least square estimator by constructing the penalty weight matrix and gets not only good robustness but also simple calculation. Simulation of a continuous stirred tank reactor, verifies the effectiveness of the proposed algorithm.展开更多
Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct ...Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct search techniques for maximizing the log-likelihood to obtain ML estimators instead of using the traditional EM algorithm. The density function of the GAL is only continuous but not differentiable with respect to the parameters and the appearance of the Bessel function in the density make it difficult to obtain the asymptotic covariance matrix for the entire GAL family. Using M-estimation theory, the properties of the ML estimators are investigated in this paper. The ML estimators are shown to be consistent for the GAL family and their asymptotic normality can only be guaranteed for the asymmetric Laplace (AL) family. The asymptotic covariance matrix is obtained for the AL family and it completes the results obtained previously in the literature. For the general GAL model, alternative methods of inferences based on quadratic distances (QD) are proposed. The QD methods appear to be overall more efficient than likelihood methods infinite samples using sample sizes n ≤5000 and the range of parameters often encountered for financial data. The proposed methods only require that the moment generating function of the parametric model exists and has a closed form expression and can be used for other models.展开更多
基金co-supported by the National Natural Science Foundation of China(No.62303246,No.62103204)the China Postdoctoral Science Foundation(No.2023M731788)。
文摘For nonlinear state estimation driven by non-Gaussian noise,the estimator is required to be updated iteratively.Since the iterative update approximates a linear process,it fails to capture the nonlinearity of observation models,and this further degrades filtering accuracy and consistency.Given the flaws of nonlinear iteration,this work incorporates a recursive strategy into generalized M-estimation rather than the iterative strategy.The proposed algorithm extends nonlinear recursion to nonlinear systems using the statistical linear regression method.The recursion allows for the gradual release of observation information and consequently enables the update to proceed along the nonlinear direction.Considering the correlated state and observation noise induced by recursions,a separately reweighting strategy is adopted to build a robust nonlinear system.Analogous to the nonlinear recursion,a robust nonlinear recursive update strategy is proposed,where the associated covariances and the observation noise statistics are updated recursively to ensure the consistency of observation noise statistics,thereby completing the nonlinear solution of the robust system.Compared with the iterative update strategies under non-Gaussian observation noise,the recursive update strategy can facilitate the estimator to achieve higher filtering accuracy,stronger robustness,and better consistency.Therefore,the proposed strategy is more suitable for the robust nonlinear filtering framework.
基金supported by the Basic Science Center Program of the National Natural Science Foundation of China(62388101)the National Natural Science Foundation of China(61873275).
文摘In this paper,the newly-derived maximum correntropy Kalman filter(MCKF)is re-derived from the M-estimation perspective,where the MCKF can be viewed as a special case of the M-estimations and the Gaussian kernel function is a special case of many robust cost functions.Based on the derivation process,a unified form for the robust Gaussian filters(RGF)based on M-estimation is proposed to suppress the outliers and non-Gaussian noise in the measurement.The RGF provides a unified form for one Gaussian filter with different cost functions and a unified form for one robust filter with different approximating methods for the involved Gaussian integrals.Simulation results show that RGF with different weighting functions and different Gaussian integral approximation methods has robust antijamming performance.
文摘The M-estimate of parameters in the errors-in-variables (EV) model Y =xτβ0+∈,X =x+u ((∈,uτ)τ is a (p+1)-dimensional spherical error, Coy[(∈, uτ)τ] =σ2Ip+1)being considered. The M-estimate βn,, of β0 under a general ρ(·) function and the estimateof σ2 are given, the strong consistency and asymptotic normality of βn as well as are obtained. The conditions for the ρ(·) function in this paper are similar to that of linearexpression of M-estimates in the linear regression model.
基金This work was partially supported by the National Natural Science Foundation of China (Grant No. 10171094), and Ph. D. Program Foundation of the Ministry of Education of China (Grant No. 2000035803).
文摘The strong consistency of M-estimates of the regression coefficients in a linear model under some mild conditions is established, which is an essential improvement over the relevant results in the literature on the moment condition. Especially, in some important circumstances, onlyE|ψ(ek)|q for some q > 1 is needed, where ψ{ek} is some score function of random error.
基金supported by Fund of 211 Program of SHUFEFund of Educational Committee of Shanghai
文摘The authors establish the approximations to the distribution of M-estimates in a linear model by the bootstrap and the linear representation of bootstrap M-estimation, and prove that the approximation is valid in probability 1. A simulation is made to show the effects of bootstrap approximation, randomly weighted approximation and normal approximation.
基金National Natural Science Foundation of China under Grant No.61379116，Natural Science Foundation of Hebei Province under Grant No.F2015203046 and No.F2013203124，Key Program of Research on Science and Technology of Higher Education Institutions of Hebei Province under Grant No.ZH2012028
文摘The existing collaborative recommendation algorithms have lower robustness against shilling attacks.With this problem in mind,in this paper we propose a robust collaborative recommendation algorithm based on k-distance and Tukey M-estimator.Firstly,we propose a k-distancebased method to compute user suspicion degree(USD).The reliable neighbor model can be constructed through incorporating the user suspicion degree into user neighbor model.The influence of attack profiles on the recommendation results is reduced through adjusting similarities among users.Then,Tukey M-estimator is introduced to construct robust matrix factorization model,which can realize the robust estimation of user feature matrix and item feature matrix and reduce the influence of attack profiles on item feature matrix.Finally,a robust collaborative recommendation algorithm is devised by combining the reliable neighbor model and robust matrix factorization model.Experimental results show that the proposed algorithm outperforms the existing methods in terms of both recommendation accuracy and robustness.
基金supported by the Natural Sciences and Engineering Research Council of Canadathe National Natural Science Foundation of China+2 种基金the Doctorial Fund of Education Ministry of Chinasupported by the Natural Sciences and Engineering Research Council of Canadasupported by the National Natural Science Foundation of China
文摘Recursive algorithms are very useful for computing M-estimators of regression coefficients and scatter parameters. In this article, it is shown that for a nondecreasing ul （t）, under some mild conditions the recursive M-estimators of regression coefficients and scatter parameters are strongly consistent and the recursive M-estimator of the regression coefficients is also asymptotically normal distributed. Furthermore, optimal recursive M-estimators, asymptotic efficiencies of recursive M-estimators and asymptotic relative efficiencies between recursive M-estimators of regression coefficients are studied.
文摘In this paper, to keep scale inveriance, we propose an approximate M-estrmation for the mixed regression model and show consistency of the estimation under weaker conditions than that in [1].
基金Supported by Special Scientific Research Fund of Meteorological Public Welfare Profession of China(GYHY201406028)Meteorological Open Research Fund for Huaihe River Basin(HRM201407)Anhui Meteorological Bureau Science and Technology Development Fund(RC201506)
文摘This paper adopts satellite channel brightness temperature simulation to study M-estimator variational retrieval. This approach combines both the advantages of classical variational inversion and robust M-estimators. Classical variational inversion depends on prior quality control to elim- inate outliers, and its errors follow a Gaussian distribution. We coupled the M-estimators to the framework of classical variational inversion to obtain a M-estimator variational inversion. The cost function contains the M-estimator to guarantee the robustness to outliers and improve the retrieval re- sults. The experimental evaluation adopts Feng Yun-3A （FY-3A） simulated data to add to the Gaussian and Non-Gaussian error. The variational in- version is used to obtain the inversion brightness temperature, and temperature and humidity data are used for validation. The preliminary results demonstrate the potential of M-estimator variational retrieval.
文摘In this paper, by using the Brouwer fixed point theorem, we consider the existence and uniqueness of the solution for local linear regression with variable window breadth.
文摘The vanishing point detection technology helps automatic driving. In this paper, the straight lines on the road associated with the vanishing point are extracted efficiently by using the regional division and angle limitation. And, the vanishing point is detected robustly by using the fast M-estimation method. Proposed method could detect straight-line features associated with vanishing point detection efficient on the road. And the vanishing point was detected exactly by the effect of the fast M-estimation method when the straight-line features not associated with vanishing point detection were detected. The processing time of the proposed method was faster than the camera flame rate （30 fps）. Thus, the proposed method is capable of real-time processing.
文摘In real-world applications, datasets frequently contain outliers, which can hinder the generalization ability of machine learning models. Bayesian classifiers, a popular supervised learning method, rely on accurate probability density estimation for classifying continuous datasets. However, achieving precise density estimation with datasets containing outliers poses a significant challenge. This paper introduces a Bayesian classifier that utilizes optimized robust kernel density estimation to address this issue. Our proposed method enhances the accuracy of probability density distribution estimation by mitigating the impact of outliers on the training sample’s estimated distribution. Unlike the conventional kernel density estimator, our robust estimator can be seen as a weighted kernel mapping summary for each sample. This kernel mapping performs the inner product in the Hilbert space, allowing the kernel density estimation to be considered the average of the samples’ mapping in the Hilbert space using a reproducing kernel. M-estimation techniques are used to obtain accurate mean values and solve the weights. Meanwhile, complete cross-validation is used as the objective function to search for the optimal bandwidth, which impacts the estimator. The Harris Hawks Optimisation optimizes the objective function to improve the estimation accuracy. The experimental results show that it outperforms other optimization algorithms regarding convergence speed and objective function value during the bandwidth search. The optimal robust kernel density estimator achieves better fitness performance than the traditional kernel density estimator when the training data contains outliers. The Naïve Bayesian with optimal robust kernel density estimation improves the generalization in the classification with outliers.
基金supported by the National Natural Science Foundation of China(No.41227803)the State High-Tech Development Plan of China(No.2014AA06A602)the Fundamental Research Funds for the Central Universities of Central South University(No.2017557)
文摘We propose a novel method that combines gray system theory and robust M-estimation method to suppress the interference in controlled-source electromagnetic data. We estimate the standard deviation of the data using a gray model because of the weak dependence of the gray system on data distribution and size. We combine the proposed and threshold method to identify and eliminate outliers. Robust M-estimation is applied to suppress the effect of the outliers and improve the accuracy. We treat the M-estimators of the preserved data as the true data. We use our method to reject the outliers in simulated signals containing noise to verify the feasibility of our proposed method. The processed values are observed to be approximate to the expected values with high accuracy. The maximum relative error is 3.6676%, whereas the minimum is 0.0251%. In processing field data, we observe that the proposed method eliminates outliers, minimizes the root-mean-square error, and improves the reliability of controlled-source electromagnetic data in follow-up processing and interpretation.
基金supported by Shandong Provincial Natural Science Foundation(No.ZR2022MF314).
文摘Conventional adaptive filtering algorithms often exhibit performance degradation when processing multipath interference in raw echoes of spaceborne synthetic aperture radar(SAR)systems due to anomalous outliers,manifesting as insufficient convergence and low estimation accuracy.To address this issue,this study proposes a novel robust adaptive filtering algorithm,namely the M-estimation-based minimum error entropy with affine projection(APMMEE)algorithm.This algorithm inherits the joint multi-data-block update mechanism of the affine projection algorithm,enabling rapid adaptation to the dynamic characteristics of raw echoes and achieving fast convergence.Meanwhile,it incorporates the M-estimation-based minimum error entropy(MMEE)criterion,which weights error samples in raw echoes through M-estimation functions,effectively suppressing outlier interference during the algorithm update.Both the system identification simulations and practical multipath interference suppression experiments using raw echoes demonstrate that the proposed APMMEE algorithm exhibits superior filtering performance.
基金Projects(61603393,61741318)supported in part by the National Natural Science Foundation of ChinaProject(BK20160275)supported by the Natural Science Foundation of Jiangsu Province,China+1 种基金Project(2015M581885)supported by the Postdoctoral Science Foundation of ChinaProject(PAL-N201706)supported by the Open Project Foundation of State Key Laboratory of Synthetical Automation for Process Industries of Northeastern University,China
文摘As a production quality index of hematite grinding process,particle size(PS)is hard to be measured in real time.To achieve the PS estimation,this paper proposes a novel data driven model of PS using stochastic configuration network(SCN)with robust technique,namely,robust SCN(RSCN).Firstly,this paper proves the universal approximation property of RSCN with weighted least squares technique.Secondly,three robust algorithms are presented by employing M-estimation with Huber loss function,M-estimation with interquartile range(IQR)and nonparametric kernel density estimation(NKDE)function respectively to set the penalty weight.Comparison experiments are first carried out based on the UCI standard data sets to verify the effectiveness of these methods,and then the data-driven PS model based on the robust algorithms are established and verified.Experimental results show that the RSCN has an excellent performance for the PS estimation.
基金Supported by the National Natural Science Foundation of China （No.60504033）
文摘Outlier in one variable will smear the estimation of other measurements in data reconciliation （DR）. In this article, a novel robust method is proposed for nonlinear dynamic data reconciliation, to reduce the influence of outliers on the result of DR. This method introduces a penalty function matrix in a conventional least-square objective function, to assign small weights for outliers and large weights for normal measurements. To avoid the loss of data information, element-wise Mahalanobis distance is proposed, as an improvement on vector-wise distance, to construct a penalty function matrix. The correlation of measurement error is also considered in this article. The method introduces the robust statistical theory into conventional least square estimator by constructing the penalty weight matrix and gets not only good robustness but also simple calculation. Simulation of a continuous stirred tank reactor, verifies the effectiveness of the proposed algorithm.
文摘Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct search techniques for maximizing the log-likelihood to obtain ML estimators instead of using the traditional EM algorithm. The density function of the GAL is only continuous but not differentiable with respect to the parameters and the appearance of the Bessel function in the density make it difficult to obtain the asymptotic covariance matrix for the entire GAL family. Using M-estimation theory, the properties of the ML estimators are investigated in this paper. The ML estimators are shown to be consistent for the GAL family and their asymptotic normality can only be guaranteed for the asymmetric Laplace (AL) family. The asymptotic covariance matrix is obtained for the AL family and it completes the results obtained previously in the literature. For the general GAL model, alternative methods of inferences based on quadratic distances (QD) are proposed. The QD methods appear to be overall more efficient than likelihood methods infinite samples using sample sizes n ≤5000 and the range of parameters often encountered for financial data. The proposed methods only require that the moment generating function of the parametric model exists and has a closed form expression and can be used for other models.
