To estimate the spreading sequence of the direct sequence spread spectrum (DSSS) signal, a fast algorithm based on maximum likelihood function is proposed, and the theoretical derivation of the algorithm is provided. ...To estimate the spreading sequence of the direct sequence spread spectrum (DSSS) signal, a fast algorithm based on maximum likelihood function is proposed, and the theoretical derivation of the algorithm is provided. By simplifying the objective function of maximum likelihood estimation, the algorithm can realize sequence synchronization and sequence estimation via adaptive iteration and sliding window. Since it avoids the correlation matrix computation, the algorithm significantly reduces the storage requirement and the computation complexity. Simulations show that it is a fast convergent algorithm, and can perform well in low signal to noise ratio (SNR).展开更多
随着风电渗透率的持续上升,电力系统的惯量水平显著下降,对系统频率稳定性构成了新的挑战。为有效评估风电并网情况下电力系统节点惯量的变化,提出了一种基于受控自回归滑动平均(autoregressive moving average with exogenous variable...随着风电渗透率的持续上升,电力系统的惯量水平显著下降,对系统频率稳定性构成了新的挑战。为有效评估风电并网情况下电力系统节点惯量的变化,提出了一种基于受控自回归滑动平均(autoregressive moving average with exogenous variable,ARMAX)模型的改进最大似然估计(maximum likelihood estimation,MLE)参数辨识方法对系统机组直接相连节点进行惯量评估。首先,构建ARMAX模型对发电机组直接相连节点的动态特性进行建模,并利用改进MLE对模型参数进行辨识,以评估与机组直接相连的节点惯量。然后,基于k-means聚类算法对发电机组节点惯量进行分区,计算得到系统区域惯量和中心频率,并进一步对非发电机组节点频率进行自适应多项式拟合计算,得到其系统节点惯量。最后,搭建IEEE39含风力发电机组节点系统,绘制热力图直观展示电力系统节点和区域的惯量分布,验证了所提改进方法的有效性。该方法有助于精准识别系统中不同节点的动态响应特性,为风电并网系统的分析和规划提供了有力支持。展开更多
By taking the subsequence out of the input-output sequence of a system polluted by white noise, an independent observation sequence and its probability density are obtained and then a maximum likelihood estimation of ...By taking the subsequence out of the input-output sequence of a system polluted by white noise, an independent observation sequence and its probability density are obtained and then a maximum likelihood estimation of the identification parameters is given. In order to decrease the asymptotic error, a corrector of maximum likelihood (CML) estimation with its recursive algorithm is given. It has been proved that the corrector has smaller asymptotic error than the least square methods. A simulation example shows that the corrector of maximum likelihood estimation is of higher approximating precision to the true parameters than the least square methods.展开更多
This paper presents a closed-form robust phase correlation based algorithm for performing image registration to subpixel accuracy.The subpixel translational shift information is directly obtained from the phase of the...This paper presents a closed-form robust phase correlation based algorithm for performing image registration to subpixel accuracy.The subpixel translational shift information is directly obtained from the phase of the normalized cross power spectrum by using Maximum Likelihood Estimation(MLE).The proposed algorithm also has slighter time complexity.Experimental results show that the proposed algorithm yields superior registration precision on the Cramér-Rao Bound(CRB) in the presence of aliasing and noise.展开更多
Iteration methods and their convergences of the maximum likelihoodestimator are discussed in this paper.We study Gauss-Newton method and give a set ofsufficient conditions for the convergence of asymptotic numerical s...Iteration methods and their convergences of the maximum likelihoodestimator are discussed in this paper.We study Gauss-Newton method and give a set ofsufficient conditions for the convergence of asymptotic numerical stability.The modifiedGauss-Newton method is also studied and the sufficient conditions of the convergence arepresented.Two numerical examples are given to illustrate our results.展开更多
Aiming at the solving problem of improved nonhomogeneous Poisson process( NHPP) model in engineering application,the immune clone maximum likelihood estimation( MLE)method for solving model parameters was proposed. Th...Aiming at the solving problem of improved nonhomogeneous Poisson process( NHPP) model in engineering application,the immune clone maximum likelihood estimation( MLE)method for solving model parameters was proposed. The minimum negative log-likelihood function was used as the objective function to optimize instead of using iterative method to solve complex system of equations,and the problem of parameter estimation of improved NHPP model was solved by immune clone algorithm. And the interval estimation of reliability indices was given by using fisher information matrix method and delta method. An example of failure truncated data from multiple numerical control( NC) machine tools was taken to prove the method. and the results show that the algorithm has a higher convergence rate and computational accuracy, which demonstrates the feasibility of the method.展开更多
This paper deals with the problems of consistency and strong consistency of the maximum likelihood estimators of the mean and variance of the drift fractional Brownian motions observed at discrete time instants. Both ...This paper deals with the problems of consistency and strong consistency of the maximum likelihood estimators of the mean and variance of the drift fractional Brownian motions observed at discrete time instants. Both the central limit theorem and the Berry-Ess′een bounds for these estimators are obtained by using the Stein’s method via Malliavin calculus.展开更多
According to the principle, “The failure data is the basis of software reliability analysis”, we built a software reliability expert system (SRES) by adopting the artificial intelligence technology. By reasoning out...According to the principle, “The failure data is the basis of software reliability analysis”, we built a software reliability expert system (SRES) by adopting the artificial intelligence technology. By reasoning out the conclusion from the fitting results of failure data of a software project, the SRES can recommend users “the most suitable model” as a software reliability measurement model. We believe that the SRES can overcome the inconsistency in applications of software reliability models well. We report investigation results of singularity and parameter estimation methods of experimental models in SRES.展开更多
Maximum likelihood estimation(MLE)is an effective method for localizing radioactive sources in a given area.However,it requires an exhaustive search for parameter estimation,which is time-consuming.In this study,heuri...Maximum likelihood estimation(MLE)is an effective method for localizing radioactive sources in a given area.However,it requires an exhaustive search for parameter estimation,which is time-consuming.In this study,heuristic techniques were employed to search for radiation source parameters that provide the maximum likelihood by using a network of sensors.Hence,the time consumption of MLE would be effectively reduced.First,the radiation source was detected using the k-sigma method.Subsequently,the MLE was applied for parameter estimation using the readings and positions of the detectors that have detected the radiation source.A comparative study was performed in which the estimation accuracy and time consump-tion of the MLE were evaluated for traditional methods and heuristic techniques.The traditional MLE was performed via a grid search method using fixed and multiple resolutions.Additionally,four commonly used heuristic algorithms were applied:the firefly algorithm(FFA),particle swarm optimization(PSO),ant colony optimization(ACO),and artificial bee colony(ABC).The experiment was conducted using real data collected by the Low Scatter Irradiator facility at the Savannah River National Laboratory as part of the Intelligent Radiation Sensing System program.The comparative study showed that the estimation time was 3.27 s using fixed resolution MLE and 0.59 s using multi-resolution MLE.The time consumption for the heuristic-based MLE was 0.75,0.03,0.02,and 0.059 s for FFA,PSO,ACO,and ABC,respectively.The location estimation error was approximately 0.4 m using either the grid search-based MLE or the heuristic-based MLE.Hence,heuristic-based MLE can provide comparable estimation accuracy through a less time-consuming process than traditional MLE.展开更多
As a widely used reconstruction algorithm in quantum state tomography, maximum likelihood estimation tends to assign a rank-deficient matrix, which decreases estimation accuracy for certain quantum states. Fortunately...As a widely used reconstruction algorithm in quantum state tomography, maximum likelihood estimation tends to assign a rank-deficient matrix, which decreases estimation accuracy for certain quantum states. Fortunately, hedged maximum likelihood estimation （HMLE） [Phys. Rev. Lett. 105 （2010）200504] was proposed to avoid this problem. Here we study more details about this proposal in the two-qubit case and further improve its performance. We ameliorate the HMLE method by updating the hedging function based on the purity of the estimated state. Both performances of HMLE and ameliorated HMLE are demonstrated by numerical simulation and experimental implementation on the Werner states of polarization-entangled photons.展开更多
This paper considers the asymptotic efficiency of the maximum likelihood estimator (MLE) for the Box-Cox transformation model with heteroscedastic disturbances. The MLE under the normality assumption (BC MLE) is a con...This paper considers the asymptotic efficiency of the maximum likelihood estimator (MLE) for the Box-Cox transformation model with heteroscedastic disturbances. The MLE under the normality assumption (BC MLE) is a consistent and asymptotically efficient estimator if the “small ” condition is satisfied and the number of parameters is finite. However, the BC MLE cannot be asymptotically efficient and its rate of convergence is slower than ordinal order when the number of parameters goes to infinity. Anew consistent estimator of order is proposed. One important implication of this study is that estimation methods should be carefully chosen when the model contains many parameters in actual empirical studies.展开更多
Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear mode...Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.展开更多
基金supported by Joint Foundation of and China Academy of Engineering Physical (10676006)
文摘To estimate the spreading sequence of the direct sequence spread spectrum (DSSS) signal, a fast algorithm based on maximum likelihood function is proposed, and the theoretical derivation of the algorithm is provided. By simplifying the objective function of maximum likelihood estimation, the algorithm can realize sequence synchronization and sequence estimation via adaptive iteration and sliding window. Since it avoids the correlation matrix computation, the algorithm significantly reduces the storage requirement and the computation complexity. Simulations show that it is a fast convergent algorithm, and can perform well in low signal to noise ratio (SNR).
文摘随着风电渗透率的持续上升,电力系统的惯量水平显著下降,对系统频率稳定性构成了新的挑战。为有效评估风电并网情况下电力系统节点惯量的变化,提出了一种基于受控自回归滑动平均(autoregressive moving average with exogenous variable,ARMAX)模型的改进最大似然估计(maximum likelihood estimation,MLE)参数辨识方法对系统机组直接相连节点进行惯量评估。首先,构建ARMAX模型对发电机组直接相连节点的动态特性进行建模,并利用改进MLE对模型参数进行辨识,以评估与机组直接相连的节点惯量。然后,基于k-means聚类算法对发电机组节点惯量进行分区,计算得到系统区域惯量和中心频率,并进一步对非发电机组节点频率进行自适应多项式拟合计算,得到其系统节点惯量。最后,搭建IEEE39含风力发电机组节点系统,绘制热力图直观展示电力系统节点和区域的惯量分布,验证了所提改进方法的有效性。该方法有助于精准识别系统中不同节点的动态响应特性,为风电并网系统的分析和规划提供了有力支持。
文摘By taking the subsequence out of the input-output sequence of a system polluted by white noise, an independent observation sequence and its probability density are obtained and then a maximum likelihood estimation of the identification parameters is given. In order to decrease the asymptotic error, a corrector of maximum likelihood (CML) estimation with its recursive algorithm is given. It has been proved that the corrector has smaller asymptotic error than the least square methods. A simulation example shows that the corrector of maximum likelihood estimation is of higher approximating precision to the true parameters than the least square methods.
文摘This paper presents a closed-form robust phase correlation based algorithm for performing image registration to subpixel accuracy.The subpixel translational shift information is directly obtained from the phase of the normalized cross power spectrum by using Maximum Likelihood Estimation(MLE).The proposed algorithm also has slighter time complexity.Experimental results show that the proposed algorithm yields superior registration precision on the Cramér-Rao Bound(CRB) in the presence of aliasing and noise.
文摘Iteration methods and their convergences of the maximum likelihoodestimator are discussed in this paper.We study Gauss-Newton method and give a set ofsufficient conditions for the convergence of asymptotic numerical stability.The modifiedGauss-Newton method is also studied and the sufficient conditions of the convergence arepresented.Two numerical examples are given to illustrate our results.
基金National CNC Special Project,China(No.2010ZX04001-032)the Youth Science and Technology Foundation of Gansu Province,China(No.145RJYA307)
文摘Aiming at the solving problem of improved nonhomogeneous Poisson process( NHPP) model in engineering application,the immune clone maximum likelihood estimation( MLE)method for solving model parameters was proposed. The minimum negative log-likelihood function was used as the objective function to optimize instead of using iterative method to solve complex system of equations,and the problem of parameter estimation of improved NHPP model was solved by immune clone algorithm. And the interval estimation of reliability indices was given by using fisher information matrix method and delta method. An example of failure truncated data from multiple numerical control( NC) machine tools was taken to prove the method. and the results show that the algorithm has a higher convergence rate and computational accuracy, which demonstrates the feasibility of the method.
基金supported by the National Science Foundations (DMS0504783 DMS0604207)National Science Fund for Distinguished Young Scholars of China (70825005)
文摘This paper deals with the problems of consistency and strong consistency of the maximum likelihood estimators of the mean and variance of the drift fractional Brownian motions observed at discrete time instants. Both the central limit theorem and the Berry-Ess′een bounds for these estimators are obtained by using the Stein’s method via Malliavin calculus.
基金the National Natural Science Foundation of China
文摘According to the principle, “The failure data is the basis of software reliability analysis”, we built a software reliability expert system (SRES) by adopting the artificial intelligence technology. By reasoning out the conclusion from the fitting results of failure data of a software project, the SRES can recommend users “the most suitable model” as a software reliability measurement model. We believe that the SRES can overcome the inconsistency in applications of software reliability models well. We report investigation results of singularity and parameter estimation methods of experimental models in SRES.
文摘Maximum likelihood estimation(MLE)is an effective method for localizing radioactive sources in a given area.However,it requires an exhaustive search for parameter estimation,which is time-consuming.In this study,heuristic techniques were employed to search for radiation source parameters that provide the maximum likelihood by using a network of sensors.Hence,the time consumption of MLE would be effectively reduced.First,the radiation source was detected using the k-sigma method.Subsequently,the MLE was applied for parameter estimation using the readings and positions of the detectors that have detected the radiation source.A comparative study was performed in which the estimation accuracy and time consump-tion of the MLE were evaluated for traditional methods and heuristic techniques.The traditional MLE was performed via a grid search method using fixed and multiple resolutions.Additionally,four commonly used heuristic algorithms were applied:the firefly algorithm(FFA),particle swarm optimization(PSO),ant colony optimization(ACO),and artificial bee colony(ABC).The experiment was conducted using real data collected by the Low Scatter Irradiator facility at the Savannah River National Laboratory as part of the Intelligent Radiation Sensing System program.The comparative study showed that the estimation time was 3.27 s using fixed resolution MLE and 0.59 s using multi-resolution MLE.The time consumption for the heuristic-based MLE was 0.75,0.03,0.02,and 0.059 s for FFA,PSO,ACO,and ABC,respectively.The location estimation error was approximately 0.4 m using either the grid search-based MLE or the heuristic-based MLE.Hence,heuristic-based MLE can provide comparable estimation accuracy through a less time-consuming process than traditional MLE.
基金Supported by the National Natural Science Foundation of China under Grant Nos 11574291,61108009 and 61222504
文摘As a widely used reconstruction algorithm in quantum state tomography, maximum likelihood estimation tends to assign a rank-deficient matrix, which decreases estimation accuracy for certain quantum states. Fortunately, hedged maximum likelihood estimation （HMLE） [Phys. Rev. Lett. 105 （2010）200504] was proposed to avoid this problem. Here we study more details about this proposal in the two-qubit case and further improve its performance. We ameliorate the HMLE method by updating the hedging function based on the purity of the estimated state. Both performances of HMLE and ameliorated HMLE are demonstrated by numerical simulation and experimental implementation on the Werner states of polarization-entangled photons.
文摘This paper considers the asymptotic efficiency of the maximum likelihood estimator (MLE) for the Box-Cox transformation model with heteroscedastic disturbances. The MLE under the normality assumption (BC MLE) is a consistent and asymptotically efficient estimator if the “small ” condition is satisfied and the number of parameters is finite. However, the BC MLE cannot be asymptotically efficient and its rate of convergence is slower than ordinal order when the number of parameters goes to infinity. Anew consistent estimator of order is proposed. One important implication of this study is that estimation methods should be carefully chosen when the model contains many parameters in actual empirical studies.
文摘Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.
