Test-Suite Inspection

View and Validate the Test-Suite

Input Given to this Service about the Test-Suite (URL Query)

Key Value
programName sv-benchmarks/c/reducercommutativity/rangesum.i
programSHA da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
witnessName results-validated/tbf-testsuite-validator-symbiotic.2019-02-06_1452.logfiles/test-comp19_prop-coverage-error-call.rangesum.yml.files/test-suite.zip
witnessSHA 9314463c75f400ffdd35e5930e17208031f3f3a36d6c2b10940ef5df827e8f09

Information about the Test-Suite from Competition Database

from https://test-comp.sosy-lab.org/2019/results/witnessInfoByHash/9314463c75f400ffdd35e5930e17208031f3f3a36d6c2b10940ef5df827e8f09.json

Key Value
architecture 64bit
creationtime 2019-02-06T14:55 CET (comp)
entryfunction main
error-specification-exists Key 'specification' not present.
producer Symbiotic
program-sha256 da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
programfile /tmp/vcloud-vcloud-master/worker/working_dir_2521e975-51b3-4977-ae84-a83805f02fd0/sv-benchmarks/c/reducercommutativity/rangesum.i
programhash da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
sourcecodelang C
witness-file fileByHash/9314463c75f400ffdd35e5930e17208031f3f3a36d6c2b10940ef5df827e8f09.zip
witness-number-of-tests 1
witness-sha256 9314463c75f400ffdd35e5930e17208031f3f3a36d6c2b10940ef5df827e8f09
witness-size 2886
witness-type test-suite

The following keys are missing in the witness XML file: specification.

This witness was created for this program (cf. table above, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819).

Available Results for the Program from Test-Suite Store Test-Comp '24

Trying to find witnesses for program (da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819, sv-benchmarks/c/reducercommutativity/rangesum.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum.i, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
from https://test-comp.sosy-lab.org/2024/results/witnessListByProgramHashJSON/da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '23

Trying to find witnesses for program (da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819, sv-benchmarks/c/reducercommutativity/rangesum.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum.i, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
from https://test-comp.sosy-lab.org/2023/results/witnessListByProgramHashJSON/da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '22

Trying to find witnesses for program (da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819, sv-benchmarks/c/reducercommutativity/rangesum.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum.i, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
from https://test-comp.sosy-lab.org/2022/results/witnessListByProgramHashJSON/da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '21

Trying to find witnesses for program (da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819, sv-benchmarks/c/reducercommutativity/rangesum.i).

Found 0 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum.i, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
from https://test-comp.sosy-lab.org/2021/results/witnessListByProgramHashJSON/da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '20

Trying to find witnesses for program (da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819, sv-benchmarks/c/reducercommutativity/rangesum.i).

Found 14 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum.i, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
from https://test-comp.sosy-lab.org/2020/results/witnessListByProgramHashJSON/da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite
Download 42b933d Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) test-suite LibKluzzer 0.6 18 19 Sun Dec 8 22:17:22 CET 2019
Download 5a2fa25 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) test-suite LibKluzzer 0.6 18 19 Mon Dec 9 04:44:48 CET 2019
Download 82c7ab0 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite Tracer-X 4 24 2019-12-09T14:44:16Z
Download f8bb7da Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite Symbiotic 2 10 2019-12-09 11:31:37
Download 90cea5f Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite KLEE 2.1-pre-test-comp 6 8 2019-12-09T10:05:07Z
Download f381717 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite CPAchecker 1.8-svn-32236 / testcomp20 11 4 2019-12-08T21:04:51+01:00
Download 0c4a62e Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite Tracer-X 4 24 2019-12-09T19:21:10Z
Download 10d9fd3 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite Symbiotic 1 10 2019-12-09 11:40:16
Download b7fb53e Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite KLEE 2.1-pre-test-comp 1 5 2019-12-09T09:08:19Z
Download 7db9fc3 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite CPAchecker 1.8-svn-32236 / testcomp20 1 1 2019-12-08T21:03:43+01:00
Download e0d4340 Inspect Inspect
Validate
COVER EDGES(@DECISIONEDGE) test-suite CPAchecker 1.8-svn-32283M / tigertestcomp20 4 2 2019-12-09T04:00:38+01:00
Download 9f28276 Inspect Inspect
Validate
COVER EDGES(@CALL(__VERIFIER_error)) test-suite CPAchecker 1.8-svn-32283M / tigertestcomp20 1 1 2019-12-09T07:46:11+01:00
Download 6ffa89d Inspect Inspect
Validate
CHECK( LTL(G ! call(__VERIFIER_error())) ) test-suite Legion 36 16 2019-12-09 03:18:48.406010
Download 02f4580 Inspect Inspect
Validate
CHECK( LTL(G ! call(__VERIFIER_error())) ) test-suite Legion 18 8 2019-12-09 01:54:08.796845

Available Results for the Program from Test-Suite Store Test-Comp '19

Trying to find witnesses for program (da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819, sv-benchmarks/c/reducercommutativity/rangesum.i).

Found 9 witnesses for program sv-benchmarks/c/reducercommutativity/rangesum.i, da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819
from https://test-comp.sosy-lab.org/2019/results/witnessListByProgramHashJSON/da8eb32bb387bb34a853577e4446dfbcae53531005ae16875f4fbb22b092b819.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite
Download abdf856 Inspect Inspect
Validate
test-suite Symbiotic 1 3 2019-02-06T14:55 CET (comp)
Download 2f63b11 Inspect Inspect
Validate
test-suite Symbiotic 5 2 2019-02-06T14:00 CET (comp)
Download 19895ba Inspect Inspect
Validate
test-suite Symbiotic 1 1 2019-02-06T11:32 CET (comp)
Download 8ca8393 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite KLEE 2.0.0-pre-test-comp 11 10 2019-02-05T23:19:05Z
Download 7179649 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite CPAchecker 1.8-svn 30375 11 4 2019-02-06T01:51:46+01:00
Download ccabe3c Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite KLEE 2.0.0-pre-test-comp 1 5 2019-02-06T05:36:57Z
Download 433e79a Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite CPAchecker 1.8-svn 30375 1 1 2019-02-06T03:03:29+01:00
Download eb1dec4 Inspect Inspect
Validate
COVER EDGES(@DECISIONEDGE) test-suite CPAchecker 1.8-svn 30541M / tigertestcomp19 9 4 2019-02-06T00:17:59+01:00
Download f52b5a3 Inspect Inspect
Validate
COVER EDGES(@CALL(__VERIFIER_error)) test-suite CPAchecker 1.8-svn 30541M / tigertestcomp19 1 1 2019-02-05T23:39:46+01:00