期刊文献+

两种Zipf定律拟合方法的对比实证研究

Comparative Empirical Study on Zipf's Law with two Fitting Methods
原文传递
导出
摘要 采用普通最小二乘法和最大似然估计两种方法分别对Zipf定律的分布进行拟合比较研究。普通最小二乘法是目前曲线拟合中普遍采用的方法,而最大似然估计是曲线拟合更为合理的方法。分别利用三组中文和三组英文语料,对两种方法进行对比实证研究,结果发现最大似然估计方法的拟合更合理,对Zipf定律的拟合比普通最小二乘法好,同时发现英文词汇比中文更好地符合Zipf定律分布,即中文语料不严格符合经典的Zipf定律分布。本研究可以为幂律拟合的研究提供一些参考。 Respectively with the methods of Ordinary Least Square and Maximum Likelihood Estimation, this paper does a fitting comparative study on the distribution of Zipf' s law. Ordinary Least Square is a popular method in curvefitting, while the Maximum Likelihood is a more reasonable approach. Based on the three Chinese corpuses and three English eorpuses, this paper empirically compares the two fitting methods. The results show that Maximum Likelihood Estimation is much better than Ordinary Least Square at calculating the slope of Zips' s law; English corpus more accorded with the Zipf' s law distribution than Chinese ones, which means Chinese corpus doesn' t strictly conform to the classic Zipf' s law distribution. This paper provides a reference for the power - law fitting research.
出处 《图书情报工作》 CSSCI 北大核心 2012年第24期71-76,126,共7页 Library and Information Service
基金 国家社会科学基金一般项目"以创新和质量为导向的哲学社会科学评价体系实证研究"(项目编号:12BTQ037)研究成果之一
关键词 Zipf定律 普通最小二乘法 最大似然估计 Zipf' s law ordinary least square maximum likelihood estimation
  • 相关文献

参考文献22

  • 1Zipf G K. Human behaviour and the Principle of Least-Effort [M]. Cambridge. Addison-Wesley, 1949.
  • 2Jayaram B D, Vidya M N. Zipf' s law for Indian languages [ J ]. Journal of Quantitative Linguistics, 2008, 15 (4) . 293 - 317.
  • 3Tuzzi A, Popescu I I, Ahmann G. Zipf' s laws in Italian Texts [ J ]. Journal of Quantitative Linguistics, 2009, 16 ( 4 ) . 354 - 367.
  • 4姜望琪.Zipf与省力原则[J].同济大学学报(社会科学版),2005,16(1):87-95. 被引量:149
  • 5Sheng Long, Li Chunguang. English and Chinese languages as weighted complex networks [ J ]. Pbysica A, 2009, 388 ( 12 ) . 2561 - 2570.
  • 6Ha L Q, Sicilia-Garcia E I, Ming J, et al. Extension of Zipf' s law to words and phrases[ C ]//Proceedings of the 19th International Conference on Computational Linguistics. Stroudsburg.Association for Computational Linguistics, 2002.315 - 320.
  • 7Mandelbrot B. Structure formelledes texts at communication [ J ]. Word, 1954 (10). 1-27.
  • 8Axtell R L. Zipf distribution of U. S. firm sizes [ J ]. Science, 2001, 293(5536) .1818 - 1820.
  • 9Urzua C M. A simple and efficient test for Zipf' s law [J]. Eco- nomics Letters, 2000, 66 (3) .257 - 260.
  • 10Gabaix X, Ibragimov R. 2007. Rank -1/2. A simple way to im- prove OLS estimation of tail exponents [ J ]. Journal of Business and Economic Statistics, 2011, 9( 1 ). 24-39.

二级参考文献28

  • 1刘永丹.用于汉语文献自动标引的词典结构研究[J].情报学报,1995,14(1):9-15. 被引量:1
  • 2苏新宁.汉语词切分标引算法的改进[J].情报学报,1996,15(6):426-430. 被引量:9
  • 3[4]A Short Biography of Alfred James Lotka,prepared by the National Institue of Standards and Technology.http://www.nist.gov/dads/HTML/lotkaslaw.html.
  • 4[5]Atlas,J.D.& S.C.Levinson.It-clefts,Informativeness,and Logical Form:Radical Pragmatics[A].Radical Pragmatics[C].Ed.P.Cole.New York:Academic Press,1981.1-61.
  • 5[6]Carston,R.Informativeness,Relevance and Scalar Implicature[A].Relevance Theory:Applications and Implications[C].Ed.R.Carston & S.Uchida.Amsterdam:John Benjamins,1998.179-236.
  • 6[7]Catriona T.and J.R.Hurford.Modelling Zipfian Distributions in Language.(paper presented at the Language Evolution and Computation Workshop/Course at the 15th European Summer School on Logic,Language and Information,Vienna,Auguast 2003.from http://www.ling.ed.ac.uk/~jim.)
  • 7[8]Grice,H.P.Logic and Conversation[A].Syntax and Semantics 3:Speech Acts[C].Ed.P.Cole & J.Morgan.New York:Academic Press,1975.41-58.
  • 8[9]Grice,H.P.Further Notes on Logic and Conversation[A].Syntax and Semantics 9:Pragmatics[C].Ed.P.Cole.New York:Academic Press,1978.113-128.
  • 9[10]Hanley,M.L.Word Index to James Joyce's Ulysses[M].Madison,Wis,1937.
  • 10[11]Horn,L.R.Toward a New Taxonomy for Pragmatic Inference:Q-based and R-based Implicature[A].Meaning,Form,and Use in Context:Linguistic Applications[C].Ed.D.Schiffrin.Washington,D.C.:Georgetown University Press,1984.11-42.

共引文献176

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部