Ranking by Category (with Score-Based Quantile Plots)

ReachSafety 1. CPAchecker 2. ESBMC-kind 3. Symbiotic	MemSafety 1. CPAchecker 2. Symbiotic 3. UAutomizer	ConcurrencySafety 1. Deagle 2. Dartagnan 3. UGemCutter
NoOverflows 1. UAutomizer 2. UTaipan 3. UKojak	Termination 1. PROTON 2. UAutomizer 3. 2LS	SoftwareSystems 1. CPAchecker 2. Bubaak-SpLit 3. Symbiotic
FalsificationOverall 1. CPAchecker 2. Symbiotic 3. Bubaak-SpLit	Overall 1. UAutomizer 2. CPAchecker 3. UTaipan
JavaOverall 1. JBMC 2. GDart 3. SWAT

Table of All Results

In every table cell for competition results, we list the points in the first row and the CPU time (rounded to two significant digits) for successful runs in the second row.

The entry 'Hors Concours' in the row for 'Representing Jury Member' means that the tool was added at the organizer's disposition and does not participate in the rankings or prize allocation.
The entry '–' means that the competition candidate opted-out in the category.
The definition of the scoring schema and the categories is given on the respective SV-COMP web pages.

Hide base categories

Participants	Plots	2LS	aise	AProVE (KoAT + LoAT)	BRICK	Bubaak	Bubaak-SpLit	CBMC	CoOpeRace	CoVeriTeam-Verifier-AlgoSelection	CoVeriTeam-Verifier-ParallelPortfolio	CPA-BAM-BnB	CPA-BAM-SMG	CPALockator	CPAchecker	CPV	Crux	CSeq	Dartagnan	Deagle	DIVINE	EBF	EmergenTheta	ESBMC-incr	ESBMC-kind	Frama-C-SV	Gazer-Theta	GDart-LLVM	Goblint	Graves-CPA	Graves-Par	Hornix	Infer	Korn	Lazy-CSeq	LF-checker	Locksmith	Mopsa	nacpa	PeSCo-CPA	PIChecker	Pinaka	PredatorHP	PROTON	RacerF	sv-sanitizers	SVF-SVC	Symbiotic	Theta	Thorn	UAutomizer	UGemCutter	UKojak	UTaipan	VeriAbs	VeriAbsL	VeriOover	WitnessMap	COASTAL	GDart	Java-Ranger	JayHorn	JBMC	JDart	MLB	SPF	SWAT
Representing Jury Member		Viktor Malík	Zhenbang Chen	Nils Lommen	Lei Bu	Marek Chalupa	Marek Chalupa	Hors Concours	Vesal Vojdani	Hors Concours	Hors Concours	Hors Concours	Hors Concours	Hors Concours	Marian Lingsch-Rosenfeld	Po-Chun Chien	Hors Concours	Hors Concours	Hernán Ponce de León	Fei He	Hors Concours	Hors Concours	Levente Bajczi	Tong Wu	Tong Wu	Hors Concours	Hors Concours	Hors Concours	Simmo Saan	Hors Concours	Hors Concours	Martin Blicha	Hors Concours	Gidon Ernst	Hors Concours	Hors Concours	Hors Concours	Raphaël Monat	Henrik Wachowitz	Hors Concours	Hors Concours	Hors Concours	Hors Concours	Ravindra Metta	Tomáš Dacík	Simmo Saan	Matthew Richards	Martin Jonáš	Levente Bajczi	Levente Bajczi	Matthias Heizmann	Dominik Klumpp	Manuel Bentele	Daniel Dietsch	Priyanka Darke	Priyanka Darke	Hors Concours	Marian Lingsch-Rosenfeld	Hors Concours	Falk Howar	Soha Hussein	Hors Concours	Peter Schrammel	Hors Concours	Lei Bu	Hors Concours	Nils Loose
Affiliation		Brno University of Technology, Czechia	National University of Defense Technology, China	RWTH Aachen, Germany	Nanjing University, China	ISTA, Austria	ISTA, Austria	--, --	University of Tartu, Estonia	--, --	--, --	--, --	--, --	--, --	LMU Munich, Germany	LMU Munich, Germany	--, --	--, --	Huawei Dresden Research Center, Germany	Tsinghua University, China	--, --	--, --	Budapest University of Technology and Economics, Hungary	the University of Manchester, UK	University of Manchester, UK	--, --	--, --	--, --	University of Tartu, Estonia	--, --	--, --	University of Lugano, Switzerland	--, --	LMU Munich, Germany	--, --	--, --	--, --	Inria and University of Lille, France	LMU Munich, Germany	--, --	--, --	--, --	--, --	TCS, India	Brno University of Technology, Czech Republic	University of Tartu, Estonia	University of New South Wales, Australia	Masaryk University, Brno, Czechia	Budapest University of Technology and Economics, Hungary	Budapest University of Technology and Economics, Hungary	University of Freiburg, Germany	University of Freiburg, Germany	University of Freiburg, Germany	University of Freiburg, Germany	Tata Consultancy Services, India	Tata Consultancy Services, India	--, --	LMU Munich, Germany	--, --	TU Dortmund, Germany	Ain Shams University, Egypt	--, --	Diffblue Ltd., UK	--, --	Nanjing University, China	--, --	University of Luebeck, Germany
ReachSafety 11301 valid tasks (8372 true, 2929 false, 2 void), max. score: 17906		6050					5970								10485	0							1926		8481				2388									0									-69455	7094	2841	-2669	6534		5162	6269
CPU time		100000 s					150000 s								390000 s	0 s							160000 s		160000 s				370 s									0 s									11000 s	110000 s	64000 s	37000 s	240000 s		190000 s	210000 s
ReachSafety-Arrays 433 valid tasks (320 true, 113 false, 0 void), max. score: 753		0			71		200								78	0							2		142				48					159				0									-2572	222	67	2	93		83	94
CPU time		1500 s			5.4 s		10000 s								2100 s	0 s							2.3 s		11000 s				6.0 s					830 s				0 s									61 s	2300 s	1900 s	2.3 s	1800 s		1800 s	3100 s
ReachSafety-BitVectors 49 valid tasks (34 true, 15 false, 0 void), max. score: 83		45			18		49								75	0							21		55				24									0									-389	49	28	22	59		40	54
CPU time		150 s			2.3 s		560 s								1400 s	0 s							1800 s		390 s				1.3 s									0 s									9.2 s	940 s	600 s	520 s	1800 s		630 s	2100 s
ReachSafety-ControlFlow 66 valid tasks (37 true, 29 false, 0 void), max. score: 103		28					16								48	0							24		-34				28					25				0									-429	34	16	-344	44		43	44
CPU time		4.3 s					980 s								270 s	0 s							1500 s		16 s				1.4 s					150 s				0 s									3.1 s	3000 s	350 s	210 s	720 s		1500 s	1100 s
ReachSafety-ECA 1263 valid tasks (783 true, 480 false, 0 void), max. score: 2046		589					273								1035	0							2		1100				12					3				0									-2010	274	258	468	980		425	360
CPU time		70000 s					25000 s								82000 s	0 s							400 s		61000 s				18 s					17 s				0 s									4800 s	4400 s	9400 s	15000 s	56000 s		50000 s	22000 s
ReachSafety-Floats 1095 valid tasks (809 true, 286 false, 0 void), max. score: 1904		634			470		664								782	0							-34		648				42									0									-2171	692	57	-14	663		542	671
CPU time		3800 s			28 s		3900 s								8500 s	0 s							5100 s		11000 s				1.9 s									0 s									94 s	2300 s	2900 s	4.7 s	42000 s		39000 s	33000 s
ReachSafety-Heap 240 valid tasks (167 true, 73 false, 0 void), max. score: 407		217					274								285	0							11		271				134									0									-400	309	70	-20	241		229	227
CPU time		680 s					380 s								1700 s	0 s							240 s		180 s				12 s									0 s									8.6 s	280 s	260 s	32 s	3800 s		4300 s	4600 s
ReachSafety-Loops 774 valid tasks (565 true, 209 false, 0 void), max. score: 1339		485	1046				889								800	0							540		727				244			296		852				0									-5419	873	422	386	892		646	863
CPU time		8600 s	26000 s				18000 s								12000 s	0 s							29000 s		11000 s				110 s			630 s		21000 s				0 s									88 s	32000 s	18000 s	10000 s	22000 s		24000 s	26000 s
ReachSafety-ProductLines 597 valid tasks (332 true, 265 false, 0 void), max. score: 929		704					227								911	0							0		783				400									0									0	509	0	0	578		366	601
CPU time		1100 s					650 s								13000 s	0 s							0 s		450 s				84 s									0 s									0 s	14000 s	0 s	0 s	8800 s		4200 s	35000 s
ReachSafety-Recursive 160 valid tasks (105 true, 55 false, 0 void), max. score: 265		0					102								115	0							0		127				82			140		146				0									-1680	150	89	0	132		95	152
CPU time		0 s					2100 s								610 s	0 s							0 s		2400 s				34 s			160 s		1200 s				0 s									10 s	2700 s	5000 s	0 s	5400 s		2700 s	4700 s
ReachSafety-Sequentialized 585 valid tasks (185 true, 400 false, 0 void), max. score: 770		13					277								581	0							2		161				4					38				0									-9472	349	56	30	66		50	28
CPU time		1400 s					27000 s								35000 s	0 s							890 s		720 s				0.86 s					450 s				0 s									86 s	9000 s	6500 s	5400 s	18000 s		12000 s	8800 s
ReachSafety-XCSP 119 valid tasks (60 true, 59 false, 0 void), max. score: 179		148					144								157	0							93		159				0					129				0									-715	141	96	40	13		42	43
CPU time		1500 s					15000 s								4100 s	0 s							2000 s		2500 s				0 s					190 s				0 s									500 s	4500 s	950 s	3000 s	930 s		5700 s	6200 s
ReachSafety-Combinations 671 valid tasks (241 true, 430 false, 0 void), max. score: 912		59					160								323	0							0		272				0									0									-4446	228	42	10	135		30	125
CPU time		610 s					12000 s								57000 s	0 s							0 s		14000 s				0 s									0 s									9.6 s	12000 s	5400 s	720 s	26000 s		510 s	18000 s
ReachSafety-Hardware 1224 valid tasks (727 true, 497 false, 0 void), max. score: 1951		95					137								268	0							42		231				40									0									-3158	109	114	0	123		145	112
CPU time		1600 s					10000 s								45000 s	0 s							4500 s		1200 s				99 s									0 s									82 s	14000 s	710 s	0 s	7500 s		6300 s	5400 s
ReachSafety-Hardness 4010 valid tasks (4007 true, 3 false, 2 void), max. score: 8017		6016					-49								6144	0							908		5928				4									0									6238	221	378	166	526		916	794
CPU time		12000 s					20000 s								130000 s	0 s							110000 s		47000 s				0.38 s									0 s									5300 s	13000 s	12000 s	1400 s	42000 s		39000 s	35000 s
ReachSafety-Fuzzle 15 valid tasks (0 true, 15 false, 0 void), max. score: 15		0					1								14	0							0		15				0					-64				0									-288	1	0	0	9		8	8
CPU time		0 s					35 s								2300 s	0 s							0 s		230 s				0 s					0 s				0 s									0 s	15 s	0 s	0 s	630 s		440 s	380 s
MemSafety 4042 valid tasks (1958 true, 2084 false, 0 void), max. score: 6409		479					3261								4869										2283				2198									0								794	-11141	4362	568		3847		3017	3639
CPU time		1600 s					3900 s								37000 s										6000 s				200 s									0 s								2100 s	28 s	5600 s	1000 s		83000 s		89000 s	77000 s
MemSafety-Arrays 220 valid tasks (184 true, 36 false, 0 void), max. score: 404		0					48								128										30				104									0								20	-296	163	-11		343		150	268
CPU time		0 s					76 s								380 s										19 s				6.6 s									0 s								4.8 s	1.5 s	67 s	29 s		9000 s		6100 s	5800 s
MemSafety-Heap 247 valid tasks (138 true, 109 false, 0 void), max. score: 385		28					282								330										237				116									0								85	-582	320	-83		153		149	185
CPU time		780 s					560 s								3200 s										1100 s				5.7 s									0 s								730 s	6.1 s	820 s	190 s		5100 s		7200 s	4400 s
MemSafety-LinkedLists 134 valid tasks (106 true, 28 false, 0 void), max. score: 240		89					114								207										72				2									0								16	0	130	0		21		22	17
CPU time		720 s					150 s								1100 s										220 s				0.089 s									0 s								43 s	0 s	110 s	0 s		2400 s		5600 s	4500 s
MemSafety-Other 105 valid tasks (90 true, 15 false, 0 void), max. score: 195		35					48								144										49				154									0								2	-230	122	129		169		156	169
CPU time		24 s					150 s								400 s										64 s				17 s									0 s								0.96 s	4.2 s	580 s	830 s		1000 s		2100 s	1200 s
MemSafety-Juliet 3271 valid tasks (1438 true, 1833 false, 0 void), max. score: 4709		0					4090								4709										4015				2746									0								1779	-20328	4527	0		3208		2330	3087
CPU time		0 s					2900 s								32000 s										4500 s				170 s									0 s								1300 s	16 s	3900 s	0 s		64000 s		65000 s	60000 s
MemSafety-MemCleanup 65 valid tasks (2 true, 63 false, 0 void), max. score: 67		-26					60								62										4				0									0								4	-288	60	0		51		54	49
CPU time		110 s					95 s								300 s										0.36 s				0 s									0 s								1.6 s	0 s	62 s	0 s		1400 s		2400 s	1500 s
ConcurrencySafety 3179 valid tasks (2546 true, 633 false, 0 void), max. score: 5741		0					-189								1772				3346	4279				2131	2128				2429									0										60	2282	300	3019	3158	0	2534
CPU time		0 s					10 s								35000 s				43000 s	9600 s				100000 s	100000 s				660 s									0 s										14 s	29000 s	1100 s	56000 s	120000 s	0 s	47000 s
ConcurrencySafety-Main 725 valid tasks (374 true, 351 false, 0 void), max. score: 1099		0					-96								452				546	554				345	347				114									0										12	520	0	574	634	0	488
CPU time		0 s					0 s								16000 s				12000 s	2200 s				8500 s	8600 s				12 s									0 s										1.6 s	16000 s	0 s	12000 s	27000 s	0 s	11000 s
ConcurrencySafety-MemSafety 752 valid tasks (717 true, 35 false, 0 void), max. score: 1469		0					-90								0				813	1220				697	697				876									0								2		0	716		298	342	0	309
CPU time		0 s					1.5 s								0 s				8700 s	2200 s				820 s	860 s				230 s									0 s								2.5 s		0 s	6100 s		3900 s	6700 s	0 s	4800 s
ConcurrencySafety-NoOverflows 673 valid tasks (661 true, 12 false, 0 void), max. score: 1334		0					10								792				826	1140				541	537				236									0								38		40	268		887	916	0	895
CPU time		0 s					8.6 s								6000 s				8000 s	1700 s				39000 s	38000 s				72 s									0 s								3.6 s		12 s	1600 s		12000 s	21000 s	0 s	12000 s
NoDataRace-Main 1029 valid tasks (794 true, 235 false, 0 void), max. score: 1823							0								442				1182	1342					488				1424									0							0	97			827		1330	1320	0	797
CPU time							0 s								13000 s				14000 s	3500 s					56000 s				350 s									0 s							0 s	63 s			5500 s		27000 s	69000 s	0 s	19000 s
NoOverflows 8221 valid tasks (4555 true, 3666 false, 0 void), max. score: 13304		6649					6489								8756								-554		8407				8261									0								1548	-19949	7635	-401	-306	10895		8918	10347
CPU time		9300 s					35000 s								43000 s								27000 s		37000 s				740 s									0 s								2300 s	100 s	37000 s	3800 s	6800 s	140000 s		120000 s	150000 s
NoOverflows-Main 1989 valid tasks (1477 true, 512 false, 0 void), max. score: 3466		1543					1341								2123								-268		1453				2082									0								514	-9653	1779	-194	-148	2680		1922	2559
CPU time		7600 s					21000 s								18000 s								27000 s		5500 s				270 s									0 s								490 s	100 s	8700 s	3800 s	6800 s	38000 s		43000 s	49000 s
NoOverflows-Juliet 6232 valid tasks (3078 true, 3154 false, 0 void), max. score: 9310		5246					5637								6624								0		8194				6002									0								736	0	6002	0	0	8121		7499	7669
CPU time		1700 s					14000 s								25000 s								0 s		32000 s				470 s									0 s								1800 s	0 s	28000 s	0 s	0 s	100000 s		73000 s	100000 s
Termination 2339 valid tasks (1538 true, 801 false, 0 void), max. score: 4094		1695		383			1207								1294								530		1127				965									0						3677				1421	553	516	3334		0	0
CPU time		9200 s		20000 s			14000 s								38000 s								44000 s		6600 s				15000 s									0 s						79000 s				20000 s	21000 s	3500 s	38000 s		0 s	0 s
Termination-BitVectors 34 valid tasks (23 true, 11 false, 0 void), max. score: 57		36		0			29								17								10		26				4									0						55				33	6	0	52		0	0
CPU time		7.9 s		0 s			110 s								52 s								1400 s		6.1 s				0.19 s									0 s						2600 s				21 s	40 s	0 s	310 s		0 s	0 s
Termination-MainControlFlow 281 valid tasks (220 true, 61 false, 0 void), max. score: 501		275		87			79								221								256		68				126									0						436				93	300	332	406		0	0
CPU time		160 s		350 s			920 s								1300 s								42000 s		1700 s				8.2 s									0 s						25000 s				340 s	20000 s	2900 s	3300 s		0 s	0 s
Termination-MainHeap 202 valid tasks (189 true, 13 false, 0 void), max. score: 391		0		42			26								0								0		24				94									0						350				24	0	0	334		0	0
CPU time		0 s		750 s			70 s								0 s								0 s		740 s				6.2 s									0 s						22000 s				4.6 s	0 s	0 s	3000 s		0 s	0 s
Termination-Other 1822 valid tasks (1106 true, 716 false, 0 void), max. score: 2928		1568		250			1461								1687								-544		1460				1128									0						2526				1841	-544	-544	1958		0	0
CPU time		9100 s		19000 s			13000 s								37000 s								590 s		4200 s				15000 s									0 s						29000 s				19000 s	600 s	600 s	32000 s		0 s	0 s
SoftwareSystems 4508 valid tasks (3387 true, 1121 false, 0 void), max. score: 7445		1					1220								2027										-2543				549									0									0	1090			537		290	305
CPU time		44 s					18000 s								78000 s										19000 s				67000 s									0 s									0 s	17000 s			120000 s		86000 s	110000 s
SoftwareSystems-AWS-C-Common-ReachSafety 341 valid tasks (177 true, 164 false, 0 void), max. score: 518		-28					285								182										179				60									0									0	258			89		-1	-62
CPU time		7.1 s					640 s								4400 s										920 s				6.9 s									0 s									0 s	870 s			14000 s		1300 s	6200 s
SoftwareSystems-coreutils-MemSafety 141 valid tasks (30 true, 111 false, 0 void), max. score: 171		0					0								0										-80				0									0								0	0	0			0		0	0
CPU time		0 s					0 s								0 s										0 s				0 s									0 s								0 s	0 s	0 s			0 s		0 s	0 s
SoftwareSystems-coreutils-NoOverflows 30 valid tasks (30 true, 0 false, 0 void), max. score: 60		0					0								40										-16				0									0								0	0	0			0		0	0
CPU time		0 s					0 s								450 s										0 s				0 s									0 s								0 s	0 s	0 s			0 s		0 s	0 s
SoftwareSystems-BusyBox-NoOverflows 67 valid tasks (35 true, 32 false, 0 void), max. score: 102		0					0								4										-16				4									0								0	0	0			0		0	0
CPU time		0 s					0 s								700 s										0 s				6.2 s									0 s								0 s	0 s	0 s			0 s		0 s	0 s
SoftwareSystems-DeviceDriversLinux64-ReachSafety 2420 valid tasks (2200 true, 220 false, 0 void), max. score: 4620		306					537								3095										1990				3036									0									0	1412			2641		2172	2643
CPU time		36 s					13000 s								68000 s										18000 s				67000 s									0 s									0 s	7900 s			100000 s		84000 s	110000 s
SoftwareSystems-DeviceDriversLinux64Large-ReachSafety 8 valid tasks (8 true, 0 false, 0 void), max. score: 16		0					0								4										0				0									0									0	0			0		0	0
CPU time		0 s					0 s								130 s										0 s				0 s									0 s									0 s	0 s			0 s		0 s	0 s
SoftwareSystems-DeviceDriversLinux64-MemSafety 141 valid tasks (4 true, 137 false, 0 void), max. score: 145		2					91								77										5				8									0								1	0	66			2		1	2
CPU time		0.34 s					3300 s								2400 s										26 s				1.6 s									0 s								0.35 s	0 s	7400 s			76 s		29 s	69 s
SoftwareSystems-Intel-TDX-Module-ReachSafety 290 valid tasks (206 true, 84 false, 0 void), max. score: 496		0					0								0										-1428				0									0									0	0			0		0	0
CPU time		0 s					0 s								0 s										48 s				0 s									0 s									0 s	0 s			0 s		0 s	0 s
SoftwareSystems-Other-ReachSafety 31 valid tasks (26 true, 5 false, 0 void), max. score: 57		0					2								42										-94				8									0									0	0			2		2	2
CPU time		0 s					15 s								580 s										3.2 s				360 s									0 s									0 s	0 s			14 s		17 s	59 s
SoftwareSystems-Other-MemSafety 49 valid tasks (31 true, 18 false, 0 void), max. score: 80		0					-13								0										-32				0									0								0	0	4			0		0	0
CPU time		0 s					8.7 s								0 s										0 s				0 s									0 s								0 s	0 s	4.6 s			0 s		0 s	0 s
SoftwareSystems-uthash-ReachSafety 192 valid tasks (192 true, 0 false, 0 void), max. score: 384		0					236								0										20				0									0									0	228			0		0	0
CPU time		0 s					180 s								0 s										580 s				0 s									0 s									0 s	57 s			0 s		0 s	0 s
SoftwareSystems-uthash-MemSafety 192 valid tasks (90 true, 102 false, 0 void), max. score: 282		0					198								156										0				0									0								36	0	198			0		0	0
CPU time		0 s					260 s								1300 s										0 s				0 s									0 s								9.1 s	0 s	500 s			0 s		0 s	0 s
SoftwareSystems-uthash-NoOverflows 162 valid tasks (162 true, 0 false, 0 void), max. score: 324		0					0								0										0				0									0								0	0	0			4		0	4
CPU time		0 s					0 s								0 s										0 s				0 s									0 s								0 s	0 s	0 s			740 s		0 s	1200 s
SoftwareSystems-uthash-MemCleanup 162 valid tasks (90 true, 72 false, 0 void), max. score: 252		0					48								42										0				0									0								30	0	48			0		0	0
CPU time		0 s					55 s								290 s										0 s				0 s									0 s								6.8 s	0 s	49 s			0 s		0 s	0 s
SoftwareSystems-DeviceDriversLinux64-Termination 282 valid tasks (106 true, 176 false, 0 void), max. score: 388		-16					0								19										0				6									0						0			0	-219			93		0	0
CPU time		0 s					0 s								130 s										0 s				1.1 s									0 s						0 s			0 s	38 s			2100 s		0 s	0 s
CorrectnessWitnesses-Loops 0 valid tasks (0 true, 0 false, 6 void)																																																										0
CPU time																																																										0 s
ViolationWitnesses-ControlFlow 0 valid tasks (0 true, 0 false, 100 void)																																																										0
CPU time																																																										0 s
ValidationCrafted 0 valid tasks (0 true, 0 false, 106 void)																																																										0
CPU time																																																										0 s
FalsificationOverall 31251 valid tasks (20818 true, 10433 false, 2 void), max. score: 10967		1640					5132								7071										1969																							5646			5042		3958	4519
CPU time		27000 s					110000 s								250000 s										74000 s																							72000 s			150000 s		90000 s	130000 s
Overall 33590 valid tasks (22356 true, 11234 false, 2 void), max. score: 55964		12245					15967								26637										16375				17124									0										19619			29949		13169	20032
CPU time		120000 s					220000 s								630000 s										340000 s				84000 s									0 s										190000 s			670000 s		480000 s	600000 s
JavaOverall 1347 valid tasks (908 true, 439 false, 0 void), max. score: 2255																																																												1402	955		1581		-5229		-2433
CPU time																																																												31000 s	37000 s		2400 s		7300 s		1100 s
ReachSafety-Java 674 valid tasks (254 true, 420 false, 0 void), max. score: 928																																																												589	568		598		493		-1166
CPU time																																																												5900 s	18000 s		710 s		4100 s		500 s
RuntimeException-Java 673 valid tasks (654 true, 19 false, 0 void), max. score: 1327																																																												813	387		983		-5717		-1267
CPU time																																																												25000 s	19000 s		1700 s		3200 s		590 s
Participants	Plots	2LS	aise	AProVE (KoAT + LoAT)	BRICK	Bubaak	Bubaak-SpLit	CBMC	CoOpeRace	CoVeriTeam-Verifier-AlgoSelection	CoVeriTeam-Verifier-ParallelPortfolio	CPA-BAM-BnB	CPA-BAM-SMG	CPALockator	CPAchecker	CPV	Crux	CSeq	Dartagnan	Deagle	DIVINE	EBF	EmergenTheta	ESBMC-incr	ESBMC-kind	Frama-C-SV	Gazer-Theta	GDart-LLVM	Goblint	Graves-CPA	Graves-Par	Hornix	Infer	Korn	Lazy-CSeq	LF-checker	Locksmith	Mopsa	nacpa	PeSCo-CPA	PIChecker	Pinaka	PredatorHP	PROTON	RacerF	sv-sanitizers	SVF-SVC	Symbiotic	Theta	Thorn	UAutomizer	UGemCutter	UKojak	UTaipan	VeriAbs	VeriAbsL	VeriOover	WitnessMap	COASTAL	GDart	Java-Ranger	JayHorn	JBMC	JDart	MLB	SPF	SWAT