Test-Suite Inspection

View and Validate the Test-Suite

Input Given to this Service about the Test-Suite (URL Query)

Key Value
programName sv-benchmarks/c/reducercommutativity/rangesum20.i
programSHA ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
witnessName results-validated/tbf-testsuite-validator-esbmc-falsi.2019-02-06_0616.logfiles/test-comp19_prop-coverage-branches.rangesum20.yml.files/test-suite.zip
witnessSHA 8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85

Information about the Test-Suite from Competition Database

from https://test-comp.sosy-lab.org/2019/results/witnessInfoByHash/8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85.json

Key Value
creationtime 2019-02-06T00:21 CET (comp)
error-programhash Key 'programhash' not present.
error-specification-exists Key 'specification' not present.
witness-file fileByHash/8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85.zip
witness-number-of-tests 0
witness-sha256 8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85
witness-size 22
witness-type test-suite

The following keys are missing in the witness XML file: sourcecodelang, producer, specification, programfile, programhash, architecture.

Available Results for the Program from Test-Suite Store Test-Comp '24

Trying to find witnesses for program (ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15, sv-benchmarks/c/reducercommutativity/rangesum20.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum20.i, ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
from https://test-comp.sosy-lab.org/2024/results/witnessListByProgramHashJSON/ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '23

Trying to find witnesses for program (ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15, sv-benchmarks/c/reducercommutativity/rangesum20.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum20.i, ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
from https://test-comp.sosy-lab.org/2023/results/witnessListByProgramHashJSON/ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '22

Trying to find witnesses for program (ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15, sv-benchmarks/c/reducercommutativity/rangesum20.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum20.i, ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
from https://test-comp.sosy-lab.org/2022/results/witnessListByProgramHashJSON/ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '21

Trying to find witnesses for program (ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15, sv-benchmarks/c/reducercommutativity/rangesum20.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum20.i, ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
from https://test-comp.sosy-lab.org/2021/results/witnessListByProgramHashJSON/ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '20

Trying to find witnesses for program (ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15, sv-benchmarks/c/reducercommutativity/rangesum20.i).

Found 13 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum20.i, ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
from https://test-comp.sosy-lab.org/2020/results/witnessListByProgramHashJSON/ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite
Download c2b4f4e Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) test-suite LibKluzzer 0.6 9 14 Mon Dec 9 09:47:09 CET 2019
Download 7d8e621 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) test-suite LibKluzzer 0.6 9 14 Mon Dec 9 02:36:11 CET 2019
Download 5a22e19 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite Tracer-X 2 20 2019-12-09T18:13:11Z
Download f8345c9 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite Symbiotic 2 9 2019-12-09 11:07:56
Download ece7a67 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite KLEE 2.1-pre-test-comp 3 6 2019-12-08T23:54:27Z
Download 94e5159 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite CPAchecker 1.8-svn-32236 / testcomp20 7 3 2019-12-09T07:47:09+01:00
Download e567a29 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite Tracer-X 2 20 2019-12-09T15:57:34Z
Download ddb0a95 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite Symbiotic 1 10 2019-12-09 11:40:33
Download df99fcc Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite KLEE 2.1-pre-test-comp 1 6 2019-12-08T23:08:11Z
Download c7aa92d Inspect Inspect
Validate
COVER EDGES(@DECISIONEDGE) test-suite CPAchecker 1.8-svn-32283M / tigertestcomp20 3 2 2019-12-09T07:22:05+01:00
Download 9add2c1 Inspect Inspect
Validate
COVER EDGES(@CALL(__VERIFIER_error)) test-suite CPAchecker 1.8-svn-32283M / tigertestcomp20 0 1 2019-12-09T07:34:50+01:00
Download a7be698 Inspect Inspect
Validate
CHECK( LTL(G ! call(__VERIFIER_error())) ) test-suite Legion 4 3 2019-12-09 09:17:21.243679
Download e5b6edb Inspect Inspect
Validate
CHECK( LTL(G ! call(__VERIFIER_error())) ) test-suite Legion 31 17 2019-12-09 02:54:16.824634

Available Results for the Program from Test-Suite Store Test-Comp '19

Trying to find witnesses for program (ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15, sv-benchmarks/c/reducercommutativity/rangesum20.i).

Found 8 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum20.i, ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15
from https://test-comp.sosy-lab.org/2019/results/witnessListByProgramHashJSON/ba03910c4491171ab76870ab4758329e93bd5a9463481cc53366002d0ed13f15.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite
Download 1bbf514 Inspect Inspect
Validate
test-suite Symbiotic 1 3 2019-02-06T14:55 CET (comp)
Download 9c1c7ab Inspect Inspect
Validate
test-suite Symbiotic 2 1 2019-02-06T09:47 CET (comp)
Download cda6735 Inspect Inspect
Validate
test-suite Symbiotic 1 1 2019-02-06T08:19 CET (comp)
Download c84cb60 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite KLEE 2.0.0-pre-test-comp 3 6 2019-02-06T00:48:14Z
Download e144269 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite CPAchecker 1.8-svn 30375 7 3 2019-02-06T03:34:48+01:00
Download 53ff6a5 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite KLEE 2.0.0-pre-test-comp 1 3 2019-02-05T22:41:09Z
Download 9b97970 Inspect Inspect
Validate
COVER EDGES(@DECISIONEDGE) test-suite CPAchecker 1.8-svn 30541M / tigertestcomp19 3 2 2019-02-06T04:32:48+01:00
Download c3da4cf Inspect Inspect
Validate
COVER EDGES(@CALL(__VERIFIER_error)) test-suite CPAchecker 1.8-svn 30541M / tigertestcomp19 0 1 2019-02-06T00:42:19+01:00