-
Notifications
You must be signed in to change notification settings - Fork 18
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Clarified submission instructions for USENIX Security '25 + fixed typ…
…os (#85) Updated and clarified Submission instructions
- Loading branch information
Showing
4 changed files
with
128 additions
and
133 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,21 +1,21 @@ | ||
--- | ||
title: Badges | ||
order: 30 | ||
--- | ||
|
||
Submitted artifacts could select to be evaluated against the following badges: | ||
|
||
<style> | ||
table th:first-of-type { | ||
width: 20%; | ||
} | ||
table th:nth-of-type(2) { | ||
width: 70%; | ||
} | ||
</style> | ||
|
||
| USENIX Badges | Description | | ||
|:-------------:|:------------| | ||
|  | **Artifacts Available:** As per the new Open Science policy of USENIX Security, all accepted papers are mandated to qualify for this badge. To earn this badge, the AEC must judge that the artifacts as described in the Open Science section of the paper have been made available for retrieval, permanently and publicly. The archived copy of the artifacts must be accessible via a long-term stable reference or DOI. For this purpose, we recommend [Zenodo](https://zenodo.org/), but other valid hosting options include institutional and third-party digital repositories (e.g., [FigShare](https://figshare.com/), [Dryad](https://datadryad.org/stash/), [Software Heritage](https://archive.softwareheritage.org/)). Unlike in previous iterations, software development repositories such as [GitHub](https://github.com/), or [GitLab](https://about.gitlab.com/) and personal webpages are **not acceptable** for this badge. Other than making the artifacts available, this badge does not mandate any further requirements on functionality, correctness, or documentation. | ||
|  | **Artifacts Functional:** To earn this badge, the AEC must judge that the artifacts conform to the expectations set by the paper in terms of functionality, usability, and relevance. In short, do the artifacts work and are they useful for producing outcomes associated with the paper? The AEC will consider three aspects of the artifacts in particular. <br>**Documentation**: are the artifacts sufficiently documented to enable them to be exercised by readers of the paper? <br>**Completeness**: do the submitted artifacts include all of the key components described in the paper? <br>**Exercisability**: do the submitted artifacts include the scripts and data needed to run the experiments described in the paper, and can the software be successfully executed? | | ||
|  | **Results Reproduced:** To earn this badge, the AEC must judge that they can use the submitted artifacts to obtain the main results presented in the paper. In short, is it possible for the AEC to independently repeat the experiments and obtain results that support the main claims made by the paper? The goal of this effort is not to reproduce the results exactly, but instead to generate results independently within an allowed tolerance such that the main claims of the paper are validated. | | ||
--- | ||
title: Badges | ||
order: 30 | ||
--- | ||
|
||
Submitted artifacts can be evaluated against the following badges: | ||
|
||
<style> | ||
table th:first-of-type { | ||
width: 20%; | ||
} | ||
table th:nth-of-type(2) { | ||
width: 70%; | ||
} | ||
</style> | ||
|
||
| USENIX Badges | Description | | ||
|:-------------:|:------------| | ||
|  | **Artifacts Available:** As per the new "Open-Science policy" of USENIX Security, **all accepted papers are mandated to qualify for this badge**. To earn this badge, the AEC must judge that the artifacts described in the "Open-Science section" of the paper have been **made available for retrieval, permanently and publicly**. The archived copy of the artifacts must be accessible via a long-term stable reference or DOI. For this purpose, we recommend [Zenodo](https://zenodo.org/), but other valid hosting options include institutional and third-party digital repositories (e.g., [FigShare](https://figshare.com/), [Dryad](https://datadryad.org/stash/), or [Software Heritage](https://archive.softwareheritage.org/)). Unlike previous iterations, software development repositories such as [GitHub](https://github.com/), [GitLab](https://about.gitlab.com/), or personal web pages are **not acceptable** for this badge. Other than making the artifacts available, this badge does not mandate any further requirements on functionality, correctness, or documentation. | ||
|  | **Artifacts Functional:** To earn this badge, the AEC must judge that the artifacts **conform to the expectations set by the paper in terms of functionality, usability, and relevance**. In short, do the artifacts work, and are they useful for producing outcomes associated with the paper? The AEC will consider three aspects of the artifacts in particular: <br>**Documentation**: are the artifacts sufficiently documented to enable them to be exercised by readers of the paper? <br>**Completeness**: do the submitted artifacts include all of the key components described in the paper? <br>**Exercisability**: do the submitted artifacts include the scripts and data needed to run the experiments described in the paper, and can the software be successfully executed? | | ||
|  | **Results Reproduced:** To earn this badge, the AEC must judge that they **can use the submitted artifacts to obtain the main results presented in the paper**. In short, could the AEC independently repeat the experiments and obtain results that support the main claims made by the paper? The goal of this effort is not to reproduce the results exactly but instead to generate results independently within an allowed tolerance such that the main claims of the paper are validated. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.