On the Organisation of Program Verification Competitions
Huisman, Marieke and Klebanov, Vladimir and Monahan, Rosemary (2012) On the Organisation of Program Verification Competitions. Proceedings of the 1st International Workshop on Comparative Empirical Evaluation of Reasoning Systems, 873 . pp. 50-59. ISSN 1613-0073 AbstractIn this paper, we discuss the challenges that have to be addressed
when organising program verification competitions. Our focus is
on competitions for verification systems where the participants both formalise
an informally stated requirement and (typically) provide some
guidance for the tool to show it. The paper draws its insights from
our experiences with organising a program verification competition at
FoVeOOS 2011. We discuss in particular the following aspects: challenge
selection, on-site versus online organisation, team composition and judging.
We conclude with a list of recommendations for future competition
organisers. | Keywords: | Program Verification Competitions; |
|---|
| Subjects: | Science & Engineering > Computer Science |
|---|
| ID Code: | 3893 |
|---|
| Deposited By: | Rosemary Monahan |
|---|
| Deposited On: | 24 Sep 2012 16:39 |
|---|
| Journal or Publication Title: | Proceedings of the 1st International Workshop on Comparative Empirical Evaluation of Reasoning Systems |
|---|
| Publisher: | CEUR |
|---|
| Refereed: | Yes |
|---|
| URL: | http://ceur-ws.org/Vol-873/ |
|---|
Repository Staff Only: item control page
|
![[img]](http://eprints.nuim.ie/style/images/fileicons/application_pdf.png)