Test-Suite Inspection

View and Validate the Test-Suite

Input Given to this Service about the Test-Suite (URL Query)

Key Value
programName sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c
programSHA 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
witnessName results-validated/tbf-testsuite-validator-cpa-tiger.2019-02-06_0615.logfiles/test-comp19_prop-coverage-error-call.pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml.files/test-suite.zip
witnessSHA 8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85

Information about the Test-Suite from Competition Database

from https://test-comp.sosy-lab.org/2019/results/witnessInfoByHash/8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85.json

Key Value
creationtime 2019-02-06T00:21 CET (comp)
error-programhash Key 'programhash' not present.
error-specification-exists Key 'specification' not present.
witness-file fileByHash/8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85.zip
witness-number-of-tests 0
witness-sha256 8739c76e681f900923b900c9df0ef75cf421d39cabb54650c4b9ad19b6a76d85
witness-size 22
witness-type test-suite

The following keys are missing in the witness XML file: sourcecodelang, producer, specification, programfile, programhash, architecture.

Available Results for the Program from Test-Suite Store Test-Comp '24

Trying to find witnesses for program (368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393, sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c).

Found 0 witnesses for program sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c, 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
from https://test-comp.sosy-lab.org/2024/results/witnessListByProgramHashJSON/368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '23

Trying to find witnesses for program (368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393, sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c).

Found 0 witnesses for program sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c, 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
from https://test-comp.sosy-lab.org/2023/results/witnessListByProgramHashJSON/368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '22

Trying to find witnesses for program (368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393, sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c).

Found 0 witnesses for program sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c, 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
from https://test-comp.sosy-lab.org/2022/results/witnessListByProgramHashJSON/368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '21

Trying to find witnesses for program (368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393, sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c).

Found 0 witnesses for program sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c, 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
from https://test-comp.sosy-lab.org/2021/results/witnessListByProgramHashJSON/368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite

Available Results for the Program from Test-Suite Store Test-Comp '20

Trying to find witnesses for program (368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393, sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c).

Found 13 witnesses for program sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c, 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
from https://test-comp.sosy-lab.org/2020/results/witnessListByProgramHashJSON/368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite
Download 8523ce2 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) test-suite LibKluzzer 0.6 54 53 Sun Dec 8 21:49:59 CET 2019
Download 5f0f003 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) test-suite LibKluzzer 0.6 54 53 Mon Dec 9 00:47:25 CET 2019
Download 37aa032 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite Tracer-X 4 34 2019-12-09T19:39:45Z
Download 603f55c Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite Symbiotic 2 25 2019-12-09 10:49:53
Download 192c01f Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite KLEE 2.1-pre-test-comp 25 19 2019-12-09T08:36:29Z
Download 1216e43 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite CPAchecker 1.8-svn-32236 / testcomp20 69 26 2019-12-09T07:53:12+01:00
Download 3db0e38 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite Tracer-X 4 34 2019-12-09T15:29:44Z
Download 2055d48 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite Symbiotic 1 26 2019-12-09 11:48:51
Download e76cfe4 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite KLEE 2.1-pre-test-comp 1 8 2019-12-09T05:53:43Z
Download 9a7e20c Inspect Inspect
Validate
COVER EDGES(@DECISIONEDGE) test-suite CPAchecker 1.8-svn-32283M / tigertestcomp20 8 4 2019-12-09T03:17:49+01:00
Download af9332b Inspect Inspect
Validate
COVER EDGES(@CALL(__VERIFIER_error)) test-suite CPAchecker 1.8-svn-32283M / tigertestcomp20 0 1 2019-12-09T02:00:50+01:00
Download 3d36912 Inspect Inspect
Validate
CHECK( LTL(G ! call(__VERIFIER_error())) ) test-suite Legion 692 335 2019-12-09 02:55:45.844960
Download a36282c Inspect Inspect
Validate
CHECK( LTL(G ! call(__VERIFIER_error())) ) test-suite Legion 669 323 2019-12-09 00:07:13.950698

Available Results for the Program from Test-Suite Store Test-Comp '19

Trying to find witnesses for program (368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393, sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c).

Found 8 witnesses for program sv-benchmarks/c/seq-mthreaded/pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.c, 368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393
from https://test-comp.sosy-lab.org/2019/results/witnessListByProgramHashJSON/368b30914db801f721182b6d44b2813d7f659bb6342f297154d6b3969a4fb393.json

Show Test-Suite Inspect Validate Specification Result Type Producer Number Tests Size (kB) Time stamp Input Test-Suite
Download 969f995 Inspect Inspect
Validate
test-suite Symbiotic 1 5 2019-02-06T14:55 CET (comp)
Download 00d0787 Inspect Inspect
Validate
test-suite Symbiotic 15 6 2019-02-06T08:56 CET (comp)
Download 423ae8a Inspect Inspect
Validate
test-suite Symbiotic 1 1 2019-02-06T08:08 CET (comp)
Download 6e51872 Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite KLEE 2.0.0-pre-test-comp 1 5 2019-02-05T22:52:31Z
Download bdb919c Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@DECISIONEDGE)) ) test-suite CPAchecker 1.8-svn 30375 69 27 2019-02-06T00:52:26+01:00
Download 55b086d Inspect Inspect
Validate
COVER( init(main()), FQL(COVER EDGES(@CALL(__VERIFIER_error))) ) test-suite KLEE 2.0.0-pre-test-comp 1 5 2019-02-06T03:06:46Z
Download 7462aa0 Inspect Inspect
Validate
COVER EDGES(@DECISIONEDGE) test-suite CPAchecker 1.8-svn 30541M / tigertestcomp19 1 5 2019-02-05T22:42:12+01:00
Download 11f8328 Inspect Inspect
Validate
COVER EDGES(@CALL(__VERIFIER_error)) test-suite CPAchecker 1.8-svn 30541M / tigertestcomp19 0 1 2019-02-06T01:57:27+01:00