Supporting Thorough Artifact Evaluation with Occam
Abstract: Efforts such as Artifact Evaluation (AE) have been growing, gradually making software evaluation an integral part of scientific publication. In this paper, we describe how Occam can help to mitigate some of the challenges faced by both authors and reviewers. For authors, Occam provides the means to package their artifacts with enough detail to be used within experiments that can be easily repeated. For the reviewers, Occam provides the means to thoroughly evaluate artifacts by: allowing them to repeat the author's experiments; providing the ability to modify inputs, parameters, and software to run different experiments.
Archive Materials
Back to ResCuE-HPC: 1st Workshop on Reproducible, Customizable, and Portable Workflows for HPC Archive Listing
Back to Full Workshop Archive Listing