The Oracle Problem in Software Testing: A Survey

Cited 406 time in webofscience Cited 516 time in scopus
  • Hit : 559
  • Download : 0
Testing involves examining the behaviour of a system in order to discover potential faults. Given an input for a system, the challenge of distinguishing the corresponding desired, correct behaviour from potentially incorrect behavior is called the "test oracle problem". Test oracle automation is important to remove a current bottleneck that inhibits greater overall test automation. Without test oracle automation, the human has to determine whether observed behaviour is correct. The literature on test oracles has introduced techniques for oracle automation, including modelling, specifications, contract-driven development and metamorphic testing. When none of these is completely adequate, the final source of test oracle information remains the human, who may be aware of informal specifications, expectations, norms and domain specific information that provide informal oracle guidance. All forms of test oracles, even the humble human, involve challenges of reducing cost and increasing benefit. This paper provides a comprehensive survey of current approaches to the test oracle problem and an analysis of trends in this important area of software testing research and practice.
Publisher
IEEE COMPUTER SOC
Issue Date
2015-05
Language
English
Article Type
Article
Keywords

AUTOMATED TEST ORACLES; ALGEBRAIC SPECIFICATIONS; PRACTICAL APPROACH; JAVA CLASSES; BLACK-BOX; GENERATION; PROGRAMS; CHECKING; SYSTEMS; VERIFICATION

Citation

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, v.41, no.5, pp.507 - 525

ISSN
0098-5589
DOI
10.1109/TSE.2014.2372785
URI
http://hdl.handle.net/10203/204028
Appears in Collection
CS-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 406 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0