Article
 

Taming Compiler Fuzzers

Public Deposited

Downloadable Content

Download PDF
https://ir.library.oregonstate.edu/concern/articles/dz010r329

Descriptions

Attribute NameValues
Creator
Abstract
  • Aggressive random testing tools (“fuzzers”) are impressively effective at finding compiler bugs. For example, a single test-case generator has resulted in more than 1,700 bugs reported for a single JavaScript engine. However, fuzzers can be frustrating to use: they indiscriminately and repeatedly find bugs that may not be severe enough to fix right away. Currently, users filter out undesirable test cases using ad hoc methods such as disallowing problematic features in tests and grepping test results. This paper formulates and addresses the fuzzer taming problem: given a potentially large number of random test cases that trigger failures, order them such that diverse, interesting test cases are highly ranked. Our evaluation shows our ability to solve the fuzzer taming problem for 3,799 test cases triggering 46 bugs in a C compiler and 2,603 test cases triggering 28 bugs in a JavaScript engine.
  • © ACM, 2013. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM SIGPLAN Notices, {VOL# 48, ISS# 6, (June 2013)} http://doi.acm.org/10.1145/2491956.2462173
  • Keywords: bug reporting, random testing, compiler defect, automated testing, compiler testing, test-case reduction, fuzz testing
Resource Type
DOI
Date Available
Date Issued
Citation
  • Chen, Y., Groce, A., Zhang, C., Wong, W., Fern, X., Eide, E., & Regehr, J. (2013). Taming compiler fuzzers. ACM SIGPLAN Notices, 48(6), 197-207.
Journal Title
Journal Volume
  • 48
Journal Issue/Number
  • 6
Rights Statement
Funding Statement (additional comments about funding)
  • We thank Google for a research award supporting Yang Chen. A portion of this work was funded by NSF grants CCF-1217824 and CCF-1054786.
Publisher
Peer Reviewed
Language
Replaces

Relationships

Parents:

This work has no parents.

Items