Computer Engineering and Applications ›› 2018, Vol. 54 ›› Issue (13): 41-46.DOI: 10.3778/j.issn.1002-8331.1705-0330

Previous Articles     Next Articles

Method based on OTT strategy of combinatorial test case prioritization

ZHANG Na1, LIN Qingxia1, BAO Xiaoan1, WU Biao2, ZHANG Wei1   

  1. 1. School of Information & Electronics, Zhejiang Sci-Tech University, Hangzhou 310018, China
    2. The Graduate School of East Asian Studies, Yamaguchi University, 753-8513, Japan
  • Online:2018-07-01 Published:2018-07-17

基于OTT策略的组合测试用例优先级排序方法

张  娜1,林青霞1,包晓安1,吴  彪2,张  唯1   

  1. 1.浙江理工大学 信息学院,杭州 310018

Abstract: The use of combinatorial coverage for the sorting criteria can meet the coverage requirements as soon as possible, but the sorting factor is single and the defect detection capability is unstable in the combinatorial test case priority sorting method. In response to this problem, this paper proposes a method of sorting priority combination of test cases based on One-Test-at-a-Time(OTT) and introduces three test case priority factors which are multi-coverage under coverage rate, test case failure rate and test case importance degree. This method can use the online test feedback of test cases to adjust the priority of combinatorial test cases. Experiments show that this method has more competitive ability in defect detection capability and stability compared with original, single-coverage and multi-coverage combined test priority sorting method.

Key words: combinatorial testing, prioritization, multi-coverage under coverage rate, test case failure rate, test case importance degree

摘要: 在组合测试用例优先级排序问题中,通常采用组合覆盖率为排序标准,该方法能够尽快满足覆盖率的要求,但其排序影响因子较为单一,缺陷检测能力不稳定。针对此问题,该文结合One-Test-at-a-Time(OTT)策略提出了一种在线调整的组合测试用例优先级排序方法,引入多重待覆盖率、测试用例失效率和测试用例重要程度3个影响因子用于衡量组合测试用例优先级。根据测试用例的在线测试反馈信息,该方法能够实时调整组合测试用例的优先级,增加了优先级排序的准确性。实验结果表明,相较于original、基于单一覆盖和多重覆盖的组合测试优先级排序方法,该方法在缺陷检测能力和稳定性上具有更强的竞争力。

关键词: 组合测试, 优先级, 多重待覆盖率, 测试用例失效率, 测试用例重要程度