Evaluating the artifacts of SIGCOMM papers

Saucez, Damien;Iannone, Luigi;Bonaventure, Olivier
(2019) Computer Communications Review — Vol. 49, n° 2, p. 44-47 (2019)

Files

acmdl19-308.pdf
  • Open Access
  • Adobe PDF
  • 1.37 MB

Details

Authors
Abstract
A growing fraction of the papers published by CCR and at SIGCOMM-sponsored conferences include artifacts such as software or datasets. Besides CCR, these artifacts were rarely evaluated. During the last months of 2018, we organised two different Artifacts Evaluation Committees to which authors could submit the artifacts of their papers for evaluation. The first one evaluated the papers accepted by Conext’18 shortly after the TPC decision. It assigned ACM reproducibility badges to 12 different papers. The second one evaluated papers accepted by CCR and any SIGCOMM-sponsored conference. 28 papers received ACM reproducibility badges. We report on the results of a short survey among artifacts authors and reviewers and provide some suggestions for future artifacts evaluations.
Affiliations

Citations

Saucez, D., Iannone, L., & Bonaventure, O. (2019). Evaluating the artifacts of SIGCOMM papers. Computer Communications Review, 49(2), 44-47. https://doi.org/10.1145/3336937.3336944 (Original work published 2019)