Artifact Evaluation
ACM Conference on AI and Agentic Systems (ACM CAIS 2026)
San Jose, CA • May 26–29, 2026
Overview
The Artifact Evaluation (AE) process is a community service intended to strengthen the long-term value of accepted papers by encouraging authors to provide substantial supplementary materials for review. These artifacts enable future researchers to reproduce, compare, and extend prior work more effectively. ACM CAIS invites authors of accepted papers to submit their artifacts for evaluation. Research artifacts are digital objects developed by the authors for use in the reported study or generated during the experimental process.
Artifact evaluation is optional at ACM CAIS'26. Authors of accepted papers may submit their artifacts shortly after receiving the acceptance notification, but they are strongly encouraged to prepare these materials in advance. If an artifact passes evaluation, the paper will receive one or more official ACM AE badges displayed on its first page, and the final camera-ready version must include an appendix describing the artifact.
The AE process for ACM CAIS'26 is single-blind, meaning that reviewers will know the identities of the authors, but authors will not know which Artifact Evaluation Committee (AEC) members reviewed their artifacts. To preserve reviewer anonymity, authors should not embed analytics or other tracking tools in websites hosting their artifacts during the artifact evaluation period. In cases where tracking is unavoidable, authors should notify the AEC Chairs in advance so that AEC members can take appropriate precautions.
More detailed information about artifact packaging, formatting, and evaluation criteria can be found here.
Important Dates
| Artifact registration opens | Tue, April 21, 2026 |
| Artifact submission deadline | Thu, April 23, 2026 (11:59 PM AoE) |
| Artifact decision notification | Fri, May 8, 2026 |
Badges
CAIS is an ACM conference and thus uses ACM's official artifact evaluation badges. Authors can apply for, and be awarded, one of following three badge combinations:
|
Available, Functional, and Reproduced: for the vast majority of software artifacts, and hardware artifacts whenever possible. |
|
Available and Functional: for datasets, as well as artifacts that require custom environments authors can't give access to. |
|
Functional and Reproduced: for software and hardware artifacts that the authors cannot make public. |
Artifacts submitted for the first target may still be awarded one of the other two badges if they do not pass the availability or reproducibility evaluation. Authors cannot apply for other combinations of badges as these make little sense, such as "an artifact that is not public, does not appear functional, but outputs the right numbers".
Authors and AEC members are encouraged to read the following badge awarding guidelines.
Call for AEC members
We are pleased to invite you to serve as a reviewer on the Artifact Evaluation Committee for ACM CAIS. This role is well suited for PhD students, postdocs, and industry practitioners. Prior AE experience as an author or reviewer is especially valued, but not required.
We are looking for reviewers who can provide detailed, constructive evaluations and review 1-2 artifacts during the AE review period. AEC members assess artifact quality, reproducibility, and relevance. They also provide clear feedback to help authors improve their work and participate in committee discussions on artifact badge decisions. In return, AEC members gain early insight into emerging research, opportunities to connect with peers in the community, and recognition for their service on the ACM CAIS website and potentially in the conference proceedings.
Prospective reviewers are encouraged to read the following guidelines.
Application process:
- Self-nomination form: Please fill this self-nomination form
- Self-nomination deadline: April 12, 2026
- Decision notification: April 14, 2026
Artifact Evaluation Chairs
Bogdan 'Bo' Stoica
University of Illinois at Urbana-Champaign