Termination competition 2005 - SRS category

Short legend (help page for more):

Tool id
Problem id NO, it is NOT terminating Category unsupported

Problem id I don't know

Problem id YES, it is terminating

Times for giving answers are in seconds

sub-category: Standard Rewriting
	AProVE 1.2pre	CiME 2.02	Jambox	Matchbox	TEPARLA	TORPA 1.4	TPA	TTT
SRS/HofWald - 1	(timeout)	2.23	0.17	2.69	21.64	1.95	(timeout)	0.19
SRS/HofWald - 2	(timeout)	24.59	57.21	3.52	10.29	0.31	(timeout)	0.03
SRS/HofWald - 3	0.79	13.22	0.18	7.69	0.09	0.02	0.12	0.06
SRS/HofWald - 4	(timeout)	55.91	0.22	(timeout)	46.37	0.01	(timeout)	0.27
SRS/Marche - s6	5.37	0.01	2.78	6.49	0.01	0.02	0.04	0.75
SRS/Marche - turing_add	0.96	0.03	2.47	5.74	0.01	0.01	0.11	0.01
SRS/Marche - turing_copy	(timeout)	(timeout)	0.22	0.02	0.00	0.05	(timeout)	0.07
SRS/Marche - turing_mult	(timeout)	(timeout)	0.17	0.94	(timeout)	(timeout)	(timeout)	35.03
SRS/Zantema - syracuse	(timeout)	45.51	56.92	10.08	52.83	24.06	(timeout)	6.43
SRS/Zantema - z001	0.84	24.25	0.17	0.07	1.60	0.00	(timeout)	0.06
SRS/Zantema - z002	0.65	0.31	0.20	0.10	0.20	0.01	10.68	0.99
SRS/Zantema - z003	0.78	1.11	0.19	0.19	0.12	0.02	10.93	0.02
SRS/Zantema - z004	0.67	3.67	0.18	0.08	2.28	0.01	14.19	0.31
SRS/Zantema - z005	1.17	0.62	0.15	0.16	3.29	0.02	(timeout)	1.21
SRS/Zantema - z006	0.70	0.02	0.14	0.04	0.01	0.04	0.03	0.02
SRS/Zantema - z007	0.67	0.04	0.16	0.06	0.01	0.06	0.00	0.01
SRS/Zantema - z008	29.20	(timeout)	29.27	25.33	0.01	0.02	0.19	1.87
SRS/Zantema - z009	1.20	0.03	52.46	6.61	1.84	0.08	0.18	0.02
SRS/Zantema - z010	1.08	0.04	2.61	3.84	0.01	0.01	0.04	0.01
SRS/Zantema - z011	1.47	6.37	(timeout)	0.89	0.07	0.03	0.12	0.01
SRS/Zantema - z012	1.45	0.01	25.99	9.09	0.01	0.02	0.09	0.01
SRS/Zantema - z013	0.80	(timeout)	0.14	2.00	0.28	0.06	0.85	0.04
SRS/Zantema - z014	0.98	6.04	0.44	2.00	0.01	0.02	0.03	0.02
SRS/Zantema - z015	5.85	43.13	0.55	9.52	0.18	0.06	(timeout)	0.02
SRS/Zantema - z016	1.84	6.44	(timeout)	0.90	0.03	0.02	0.09	0.03
SRS/Zantema - z017	1.10	6.08	0.44	0.13	0.01	0.01	0.12	0.02
SRS/Zantema - z018	1.32	2.88	(timeout)	7.12	0.14	0.25	0.17	0.24
SRS/Zantema - z019	3.67	8.80	34.59	0.69	0.10	0.07	31.18	0.16
SRS/Zantema - z020	0.62	18.22	50.66	19.22	4.87	0.29	(timeout)	0.02
SRS/Zantema - z021	0.65	0.03	0.15	0.10	0.01	0.04	0.05	0.07
SRS/Zantema - z022	2.26	34.38	(timeout)	5.56	0.02	0.04	0.05	0.03
SRS/Zantema - z023	6.47	(timeout)	55.36	11.49	0.04	0.03	0.18	1.54
SRS/Zantema - z024	1.15	0.89	0.20	17.11	0.02	0.02	0.03	0.02
SRS/Zantema - z025	0.90	0.10	2.38	18.53	0.02	0.00	0.08	0.01
SRS/Zantema - z026	0.75	0.03	56.81	17.42	0.01	0.01	0.04	0.02
SRS/Zantema - z027	0.59	24.36	0.17	0.14	50.92	0.01	(timeout)	0.06
SRS/Zantema - z028	1.82	31.11	(timeout)	7.47	(timeout)	0.04	(timeout)	0.09
SRS/Zantema - z029	0.80	6.19	0.15	0.12	0.87	0.02	(timeout)	0.08
SRS/Zantema - z030	0.85	24.82	0.17	0.15	(timeout)	0.01	(timeout)	0.09
SRS/Zantema - z031	0.82	25.92	0.14	0.16	(timeout)	0.01	(timeout)	0.53
SRS/Zantema - z032	0.73	14.44	0.20	0.06	9.69	0.00	(timeout)	0.08
SRS/Zantema - z033	0.40	32.21	0.15	0.05	7.43	0.01	0.19	0.10
SRS/Zantema - z034	1.09	24.22	0.45	0.07	56.28	0.01	(timeout)	0.06
SRS/Zantema - z035	1.77	17.35	0.55	0.06	56.46	0.03	44.86	0.05
SRS/Zantema - z036	0.79	24.62	0.17	0.09	26.36	0.01	11.54	0.08
SRS/Zantema - z037	0.86	31.55	0.15	0.08	3.90	0.01	(timeout)	0.12
SRS/Zantema - z038	0.83	25.26	0.18	0.09	(timeout)	0.01	(timeout)	0.09
SRS/Zantema - z039	0.73	25.30	0.20	0.08	27.39	0.00	(timeout)	0.34
SRS/Zantema - z040	0.81	25.20	0.15	0.17	59.78	0.00	(timeout)	0.07
SRS/Zantema - z041	0.86	9.13	0.49	0.09	(timeout)	0.00	(timeout)	0.10
SRS/Zantema - z042	1.27	18.72	0.19	0.03	(timeout)	0.02	(timeout)	0.59
SRS/Zantema - z043	0.67	18.39	0.19	0.07	58.79	0.00	(timeout)	0.44
SRS/Zantema - z044	1.28	18.72	0.17	0.03	(timeout)	0.03	(timeout)	0.28
SRS/Zantema - z045	0.64	18.50	0.17	0.09	50.35	0.02	(timeout)	0.38
SRS/Zantema - z046	1.15	24.45	0.15	0.06	(timeout)	0.04	(timeout)	0.33
SRS/Zantema - z047	0.63	14.49	0.17	0.09	(timeout)	0.02	(timeout)	0.30
SRS/Zantema - z048	0.76	25.03	0.15	0.09	53.76	0.01	(timeout)	0.30
SRS/Zantema - z049	0.69	32.76	0.19	0.03	0.20	0.02	0.13	0.06
SRS/Zantema - z050	0.69	38.83	0.17	0.03	0.18	0.00	0.02	0.06
SRS/Zantema - z051	0.62	25.24	0.18	0.04	0.07	0.00	0.15	0.05
SRS/Zantema - z052	0.68	25.31	0.17	0.02	0.74	0.01	0.07	0.06
SRS/Zantema - z053	0.67	25.14	0.14	0.03	9.88	0.01	1.72	0.06
SRS/Zantema - z054	0.76	25.17	0.17	0.08	16.86	0.02	(timeout)	0.06
SRS/Zantema - z055	0.60	26.41	0.13	0.02	9.73	0.02	13.36	0.06
SRS/Zantema - z056	0.74	26.94	0.15	0.03	0.04	0.02	0.06	0.04
SRS/Zantema - z057	0.66	27.75	0.19	0.04	9.97	0.00	11.23	0.05
SRS/Zantema - z058	0.72	26.34	0.16	0.02	0.03	0.02	0.10	0.05
SRS/Zantema - z059	0.81	26.75	0.17	0.04	0.03	0.01	0.11	0.06
SRS/Zantema - z060	0.66	26.92	0.18	0.04	0.00	0.02	0.12	0.03
SRS/Zantema - z061	0.61	24.07	0.16	0.02	0.07	0.01	0.08	0.13
SRS/Zantema - z062	0.63	(timeout)	0.19	0.03	0.33	0.02	0.43	0.05
SRS/Zantema - z063	0.75	12.50	0.18	0.05	0.19	0.01	0.12	0.01
SRS/Zantema - z064	0.73	46.12	0.17	0.05	0.68	0.01	0.27	0.24
SRS/Zantema - z065	0.73	0.13	5.76	6.89	0.01	0.00	0.05	0.03
SRS/Zantema - z066	1.47	(timeout)	2.23	5.75	0.01	0.00	0.47	0.15
SRS/Zantema - z067	0.91	(timeout)	1.29	9.27	0.02	0.03	0.07	0.05
SRS/Zantema - z068	(timeout)	28.21	6.32	6.52	0.43	0.04	(timeout)	0.04
SRS/Zantema - z069	4.20	(timeout)	6.26	21.17	0.06	0.02	3.35	1.22
SRS/Zantema - z070	(timeout)	1.94	6.05	22.19	0.51	(timeout)	3.71	9.24
SRS/Zantema - z071	1.06	0.02	0.20	6.17	0.00	0.00	0.02	0.02
SRS/Zantema - z072	0.64	48.12	0.18	0.28	0.05	0.05	2.16	2.71
SRS/Zantema - z073	37.89	48.09	54.70	14.24	47.25	8.07	(timeout)	2.69
SRS/Zantema - z074	(timeout)	(timeout)	53.18	5.68	1.17	0.09	4.34	8.86
SRS/Zantema - z075	31.06	24.07	54.29	7.86	0.45	0.14	1.98	6.29
SRS/Zantema - z076	1.03	0.37	0.18	0.06	0.22	0.04	0.02	0.01
SRS/Zantema - z077	1.10	13.62	6.48	4.37	0.02	0.00	0.01	0.01
SRS/Zantema - z078	1.21	0.39	6.79	4.98	22.30	0.04	0.17	0.03
SRS/Zantema - z079	(timeout)	31.31	(timeout)	18.42	56.21	10.48	(timeout)	2.29
SRS/Zantema - z080	33.12	31.82	0.17	0.21	9.66	0.03	(timeout)	0.12
SRS/Zantema - z081	1.07	0.13	30.48	2.90	2.16	0.01	(timeout)	0.02
SRS/Zantema - z082	1.39	(timeout)	0.59	9.98	0.03	0.07	0.05	1.82
SRS/Zantema - z083	32.20	47.47	56.97	9.20	9.77	0.20	(timeout)	0.35
SRS/Zantema - z084	1.39	0.02	6.35	6.39	0.02	0.00	0.17	0.00
SRS/Zantema - z085	0.68	0.02	3.31	1.78	0.01	0.01	0.08	0.03
SRS/Zantema - z086	(timeout)	(timeout)	57.24	7.06	1.21	4.54	(timeout)	0.74
SRS/Zantema - z087	0.63	(timeout)	0.16	0.04	0.95	0.02	(timeout)	1.78
SRS/Zantema - z088	0.87	6.61	0.17	17.99	1.44	3.14	(timeout)	0.19
SRS/Zantema - z089	(timeout)	31.08	(timeout)	1.62	2.83	3.85	(timeout)	0.16
SRS/Zantema - z090	(timeout)	47.32	56.33	5.46	23.28	9.08	(timeout)	0.86
SRS/Zantema - z091	17.24	48.12	48.39	11.56	(timeout)	0.21	4.52	0.52
SRS/Zantema - z092	1.71	(timeout)	0.77	0.01	0.00	0.00	0.02	0.36
SRS/Zantema - z093	0.72	0.02	1.54	3.23	0.31	0.02	(timeout)	0.01
SRS/Zantema - z094	5.74	(timeout)	33.22	4.43	0.04	0.07	0.05	2.48
SRS/Zantema - z095	0.88	(timeout)	0.21	0.17	1.36	0.01	(timeout)	0.06
SRS/Zantema - z096	1.35	13.03	0.18	0.02	(timeout)	0.03	(timeout)	0.09
SRS/Zantema - z097	0.90	31.04	0.23	0.24	(timeout)	0.00	(timeout)	0.10
SRS/Zantema - z098	0.80	30.89	0.16	0.06	40.75	0.01	(timeout)	0.07
SRS/Zantema - z099	0.90	29.86	0.16	2.10	0.26	0.06	0.86	0.02
SRS/Zantema - z100	17.07	43.83	57.12	6.86	21.32	0.10	8.93	6.77
SRS/Zantema - z101	1.99	0.06	2.41	7.99	0.19	0.01	0.02	0.01
SRS/Zantema - z102	1.53	0.19	2.68	3.87	0.32	0.01	5.59	0.02
SRS/Zantema - z103	(timeout)	0.18	2.72	11.90	6.70	0.00	(timeout)	0.97
SRS/Zantema - z104	(timeout)	44.88	0.45	9.34	0.08	0.01	0.53	0.02
SRS/Zantema - z105	(timeout)	3.08	51.59	7.33	0.26	0.00	0.41	0.02
SRS/Zantema - z106	(timeout)	24.97	2.55	9.83	1.89	0.00	(timeout)	0.03
SRS/Zantema - z107	(timeout)	53.04	57.64	15.10	0.19	0.01	1.18	0.03
SRS/Zantema - z108	2.59	0.13	2.26	9.83	11.57	0.01	(timeout)	0.01
SRS/Zantema - z109	1.46	0.12	2.76	8.26	0.03	0.00	0.72	0.01
SRS/Zantema - z110	(timeout)	0.21	57.71	3.72	0.15	0.01	(timeout)	1.40
SRS/Zantema - z111	1.76	6.27	57.54	11.63	1.48	0.01	0.76	0.03
SRS/Zantema - z112	(timeout)	(timeout)	0.22	52.18	41.42	0.02	2.43	8.93
SRS/Zantema - z113	(timeout)	(timeout)	57.63	3.69	48.33	0.00	5.86	0.08
SRS/Zantema - z114	(timeout)	0.20	2.61	6.80	10.87	0.01	(timeout)	0.45
SRS/Zantema - z115	2.78	0.07	6.32	5.90	1.87	0.01	(timeout)	0.03
SRS/Zantema - z116	1.79	0.03	2.66	4.00	0.05	0.01	1.41	0.02
SRS/Zantema - z117	(timeout)	(timeout)	(timeout)	19.54	16.05	0.01	(timeout)	6.23
SRS/Zantema - z118	2.43	2.54	6.20	7.51	44.88	0.00	1.32	4.24
SRS/Zantema - z119	45.84	38.75	57.83	12.34	9.15	0.00	(timeout)	7.18
SRS/Zantema - z120	12.27	37.19	55.75	8.55	4.51	0.74	(timeout)	3.64
SRS/Zantema - z121	49.94	(timeout)	56.99	6.27	20.49	0.02	1.49	8.64
SRS/Zantema - z122	4.30	(timeout)	6.14	11.79	26.69	0.01	2.99	0.03
SRS/Zantema - z123	4.93	(timeout)	0.21	22.84	17.19	0.01	(timeout)	7.97
SRS/Zantema - z124	1.24	0.03	0.66	3.33	0.00	0.01	0.02	0.29
SRS/Zantema - z125	17.89	(timeout)	57.41	6.50	0.13	0.42	1.04	4.35
SRS/Zantema - z126	1.26	18.66	46.92	31.68	1.99	0.28	33.58	0.04
SRS/Zantema - z127	(timeout)	25.35	0.11	0.05	10.32	3.99	(timeout)	0.02
SRS/Zantema - z128	(timeout)	(timeout)	0.12	0.07	2.52	5.00	(timeout)	0.46
secret2005 - aprove1	2.60	18.32	52.10	7.86	45.11	(timeout)	(timeout)	3.54
secret2005 - aprove2	10.30	25.97	6.71	7.57	30.42	11.83	(timeout)	0.26
secret2005 - aprove3	3.10	36.08	57.27	44.15	52.51	38.80	(timeout)	7.21
secret2005 - aprove4	4.57	(timeout)	57.10	(timeout)	44.84	12.82	(timeout)	0.08
secret2005 - aprove5	4.26	16.30	(timeout)	5.72	8.93	(timeout)	(timeout)	1.35
secret2005 - jambox1	(timeout)	50.03	0.47	11.46	7.54	3.95	15.12	2.25
secret2005 - jambox2	(timeout)	(timeout)	0.91	2.93	3.53	5.08	(timeout)	2.88
secret2005 - jambox3	(timeout)	57.15	0.44	10.44	6.49	11.15	(timeout)	2.10
secret2005 - jambox4	2.13	33.58	0.18	9.77	3.45	9.09	(timeout)	3.61
secret2005 - jambox5	(timeout)	(timeout)	0.65	12.42	0.53	(timeout)	(timeout)	0.84
secret2005 - matchbox1	38.49	(timeout)	57.34	5.92	24.87	0.02	(timeout)	18.11
secret2005 - matchbox2	0.94	(timeout)	0.21	53.20	(timeout)	0.02	(timeout)	14.64
secret2005 - torpa1	1.47	0.32	0.21	14.39	54.24	0.02	2.13	5.52
secret2005 - torpa2	(timeout)	24.99	56.56	4.72	16.57	0.26	(timeout)	0.04
secret2005 - torpa3	(timeout)	0.44	57.68	8.30	31.23	0.02	1.57	7.54
secret2005 - torpa4	(timeout)	(timeout)	30.86	10.44	11.99	0.03	(timeout)	8.67
number of problems: 153 (139 YES, 9 NO, 5 UNKNOWN)
	AProVE 1.2pre	CiME 2.02	Jambox	Matchbox	TEPARLA	TORPA 1.4	TPA	TTT
YES score	114 (82.0 %)	37 (26.6 %)	102 (73.4 %)	66 (47.5 %)	74 (53.2 %)	126 (90.6 %)	65 (46.8 %)	60 (43.2 %)
YES average time	3.42	2.39	2.13	1.42	3.74	0.04	3.54	0.44
NO score	4 (44.4 %)	0 (0.0 %)	9 (100.0 %)	9 (100.0 %)	1 (11.1 %)	5 (55.6 %)	0 (0.0 %)	1 (11.1 %)
NO average time	1.26	-	0.16	0.43	0.00	0.03	-	0.07
sub-category: Relative Termination
	AProVE 1.2pre	CiME 2.02	Jambox	Matchbox	TEPARLA	TORPA 1.4	TPA	TTT
SRS/relative - zr01					0.68	0.03	0.91
SRS/relative - zr02					0.14	0.48	12.38
SRS/relative - zr03					0.01	0.01	0.02
SRS/relative - zr04					5.64	2.81	(timeout)
SRS/relative - zr05					11.39	0.04	19.12
SRS/relative - zr06					0.00	0.01	0.14
SRS/relative - zr07					0.13	0.01	0.29
SRS/relative - zr08					2.67	0.00	0.42
SRS/relative - zr09					0.14	0.03	0.08
SRS/relative - zr10					0.01	0.01	0.07
SRS/relative - zr11					0.15	0.02	0.37
SRS/relative - zr12					2.28	0.05	0.27
SRS/relative - zr13					(timeout)	0.28	(timeout)
number of problems: 13 (12 YES, 0 NO, 1 UNKNOWN)
	AProVE 1.2pre	CiME 2.02	Jambox	Matchbox	TEPARLA	TORPA 1.4	TPA	TTT
YES score					11 (91.7 %)	12 (100.0 %)	10 (83.3 %)
YES average time					1.87	0.29	3.36
NO score					0	0	0
NO average time					-	-	-

This script has been written in the Objective CAML language using the CGI Library

	Tool id
Problem id	NO, it is NOT terminating	Category unsupported
Problem id	I don't know
Problem id	YES, it is terminating