期刊文献+

面向有效错误定位的测试用例优选方法 被引量:9

Test Case Selection for Improving the Effectiveness of Software Fault Localization
在线阅读 下载PDF
导出
摘要 针对已有测试用例选择方法在提高错误定位有效性方面存在局限性的问题,首先,定义"失效覆盖向量相似度优先排序"准则,将执行路径与失效执行路径相似的成功测试用例赋予较高的优先级;然后定义"失效覆盖等价划分优化选择"准则,选择能够最大区分失效执行语句的成功测试用例集合;在此基础上,建立测试用例优选模型(effective selection,ES).不同于已有方法,ES充分利用失效执行路径来提高错误定位的有效性.该模型被应用于优选Siemens测试用例集合,其结果被应用于Tarantula等4种错误定位方法.结果表明,ES在约简率Reduction和衡量错误定位有效性的Expense_increase两个指标方面,均优于已有的基于语句和基于向量的测试用例约简方法.ES不但可以获得97%以上的约简率,提高错误定位的效率,而且具有较低的Expense_increase,显著提高了错误定位的有效性. Existing approaches to test case selection usually focus on how to improve the efficiency of testing,rather than the effectiveness of fault localization.To solve this problem,a test case selection approach is proposed.Firstly,"test case prioritization criterion by similarity of failure coverage vector" is proposed to prioritize the passed test case whose execution path is more similar to that of the failed test case.Secondly,"test case selection criterion by equivalent failure coverage division" is defined to select passed test cases,which can maximally differentiate the statements in the failure execution path.Finally,the test case selection model ES is created based on these two criteria.Different from existing approaches,ES takes advantage of the execution path of the failed test case to improve the effectiveness of fault localization.It has been applied to analyze the Siemens benchmark,and the selected test cases have been used as input of four popular coverage-based fault localization techniques.Experimental results show that in terms of the Reduction and Expense_increase metrics,ES is better than the existing statement-based and vector-based test case reduction approaches.ES can get a Reduction of over 97%,which indicates that it can greatly improve the efficiency of fault localization.In particular,ES can also achieve a low Expense_ increase,which means it can significantly improve the effectiveness of fault localization.
出处 《计算机研究与发展》 EI CSCD 北大核心 2014年第4期865-873,共9页 Journal of Computer Research and Development
基金 国家自然科学基金项目(61202092 61173021) 高等学校博士学科点专项科研基金项目(20112302120052) 中央高校基本科研业务费专项资金项目(HIT.NSRIF.201178) 黑龙江省高教学会"十二五"重点规划课题(HGJXH B1110957) 哈尔滨青年科技创新人才项目(RC2013QN010001)
关键词 错误定位 覆盖分析 测试用例 约简 优选 fault localization coverage analysis test case reduction selection
  • 相关文献

参考文献16

  • 1虞凯,林梦香.自动化软件错误定位技术研究进展[J].计算机学报,2011,34(8):1411-1422. 被引量:46
  • 2柳永坡,吴际,金茂忠,杨海燕,贾晓霞,刘雪梅.基于贝叶斯统计推理的故障定位实验研究[J].计算机研究与发展,2010,47(4):707-715. 被引量:9
  • 3Jiang B, Zhang Z, Chan W K, et al. Adaptive random test case prioritization [C]//Proc of the 2009 IEEEJACM Int Conf on Automated Software Engineering. NewYork: ACM, 2009:233-244.
  • 4Jones J A, Harrold M J, Stasko J. Visualization of test information to assist fault localization [C] //Proc of the 24th Int Conf on Software Engineering. New York: ACM, 2002: 467-477.
  • 5Ahreu R, Zoeteweij P, Van Gemund A J C. On the accuracy of spectrum-based fault localization [C] //Proc of the 2007 Testing: Academic and Industrial Conf Practice and Research Techniques MUTATION. Piscataway, NJ: IEEE, 2007: 89-98.
  • 6Wong W, Qi Y, Zhao L, et al. Effective fault localization using code coverage [C] //Proc of the 31st Annual Int Computer Software and Applications Conf. Piscataway, NJ: IEEE, 2007:449-456.
  • 7Naish L,Lee H J, Ranamohanarao K. A model for spectra- based software diagnosis [J]. ACM Trans on Software Engineering and Methodology, 2011, 20(3) : 11 : 1-32.
  • 8Zhang X, Gupta N. l.oeating faulty code by multiple points slicing [J]. Software Practice 8,. Experience, 2007, 37 (9) : 935-961.
  • 9Wong W E, Qi Y. Effective program debugging based on execution slices and inter block data dependency [J]. Journal of Systems and Software, 2006, 79(7): 891-903.
  • 10Jeffrey D, Nagarajan V, Gupta R, et al. Execution supression: An automated iterative technique for locating memory errors [J]. ACM Trans on Programming Languages and Systems, 2010, 32(5): 17:1-36.

二级参考文献75

  • 1李诺,金茂忠,刘超.一种Java程序度量工具的设计实现[J].电子学报,2004,32(F12):175-179. 被引量:2
  • 2Zeller A,Hildebrandt R.Simplifying and isolating failure-inducing input[J].IEEE Trans on Software Engineering,2002,28(2):183-200.
  • 3Harrold M J,Rothermel G,Sayre K,et al.An empirical investigation of the relationship between spectra differences and regression faults[J].Journal of Software Testing,Verification,and Reliability,2000,10(3):171-194.
  • 4Morell L J.A theory of fault-based testing[J].IEEE Trans on Software Engineering,1990,16(8):844-857.
  • 5Voas J M.PIE:A dynamic failure-based technique[J].IEEE Trans on Software Engineering,1992,18(8):717-727.
  • 6Jones J A,Harrold M J,Stasko J.Visualization of test information to assist fault localization[C]//Proc of the 24th Int Conf on Software Engineering(ICSE 2002).New York:ACM,2002:467-477.
  • 7Kusumoto S,Nishimatsu A,Nishie K,et al.Experimental evaluation of program slicing for fault localization[J].Empirical Software Engineering,2002,7(1):49-76.
  • 8Francel M A.Fault localization through execution traces[D].Atlanta:Georgia Institute of Technology,2002.
  • 9Renieris M,Reiss S P.Fault localization with nearest neighbor queries[C]//Proc of the 18th IEEE Int Conf on Automated Software Engineering (ASE 2003).Los Alamitos,CA:IEEE Computer Society,2003:30-39.
  • 10Jones J A,Harrold M J.Empirical evaluation of the Tarantula automatic fault-localization technique[C]//Proc of the 20th IEEE/ACM Int Conf on Automated Software Engineering (ASE 2005).New York:ACM,2005:273-282.

共引文献52

同被引文献73

  • 1孙继荣,李志蜀,倪建成,李宝林.回归测试用例集优化策略[J].吉林大学学报(工学版),2008,38(S2):184-190. 被引量:3
  • 2单梁,强浩,李军,王执铨.基于Tent映射的混沌优化算法[J].控制与决策,2005,20(2):179-182. 被引量:226
  • 3尚冬娟,郝克刚,葛玮,李海军.软件测试中的测试用例及复用研究[J].计算机技术与发展,2006,16(1):69-72. 被引量:33
  • 4沈嘉懿,李芳,徐飞玉,Hans Uszkoreit.中文组织机构名称与简称的识别[J].中文信息学报,2007,21(6):17-21. 被引量:32
  • 5JONES J A. Fault localization using visualization of test information[C]//Proceedings of the 26th IEEE International Conference on Software Engineering. Piscataway:IEEE, 2004:54-56.
  • 6WONG W E, WEI T, QI Y,et al. A crosstab-based statistical method for effective fault localization[C]//Proceedings of the 20081st International Conference on Software Testing, Verification, and Validation. Piscataway:IEEE, 2008:42-51.
  • 7NAISH L, LEE H J, RAMAMOHANARAO K. A model for spectra-based software diagnosis[J]. ACM Transactions on Software Engineering and Methodology, 2011,20(3):11.
  • 8SANTELICES R, JONES J A, YU Y,et al. Lightweight fault-localization using multiple coverage types[C]//Proceedings of the IEEE 31st International Conference on Software Engineering. Piscataway:IEEE, 2009:56-66.
  • 9AGRAWAL H, HORGAN J R. Dynamic program slicing[C]//Proceedings of the ACM Conference on Programming Language Design and Implementation. New York:ACM, 1990:246-256.
  • 10ALVES E, GLIGORIC M, JAGANNATH V,et al. Fault-localization using dynamic slicing and change impact analysis[C]//Proceedings of the 201126th IEEE/ACM International Conference on Automated Software Engineering. Washington, DC:IEEE Computer Society, 2011:520-523.

引证文献9

二级引证文献33

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部