Are concurrency coverage metrics effective for testing: a comprehensive empirical investigation

Cited 7 time in webofscience Cited 0 time in scopus
  • Hit : 279
  • Download : 0
Testing multithreaded programs is inherently challenging, as programs can exhibit numerous thread interactions. To help engineers test these programs cost-effectively, researchers have proposed concurrency coverage metrics. These metrics are intended to be used as predictors for testing effectiveness and provide targets for test generation. The effectiveness of these metrics, however, remains largely unexamined. In this work, we explore the impact of concurrency coverage metrics on testing effectiveness and examine the relationship between coverage, fault detection, and test suite size. We study eight existing concurrency coverage metrics and six new metrics formed by combining complementary metrics. Our results indicate that the metrics are moderate to strong predictors of testing effectiveness and effective at providing test generation targets. Nevertheless, metric effectiveness varies across programs, and even combinations of complementary metrics do not consistently provide effective testing. These results highlight the need for additional work on concurrency coverage metrics.
Publisher
WILEY-BLACKWELL
Issue Date
2015-06
Language
English
Article Type
Article
Citation

SOFTWARE TESTING VERIFICATION & RELIABILITY, v.25, no.4, pp.334 - 370

ISSN
0960-0833
DOI
10.1002/stvr.1539
URI
http://hdl.handle.net/10203/198773
Appears in Collection
CS-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 7 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0