CAMEO-3D: Server Pairwise Comparison 1-week Performance (2022-04-16)

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

AIRFold - Pairwise Comparison on common targets - dataset: 1-week [2022-04-16]

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
AIRFold - Reference
Naive AlphaFoldDB 100	13	1	0	0	--27:13:29	26:46:51	3.03	90.29	3.14	84.12	-	-	-	-	-	-	server100	True
PaFold	15	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-	server101	True
HeliXonAI	0	6	0	0	-49:27:42	27:10:25	-0.84	86.32	-0.84	81.17	0.19	78.91	-	-	-	-	server104	False
RocketX	0	6	0	0	-14:16:48	27:10:25	32.91	86.32	25.94	81.17	52.83	78.91	-	-	-	-	server106	False
OpenComplex	0	6	0	0	-21:44:47	27:10:25	0.51	86.32	-0.11	81.17	1.31	78.91	-	-	-	-	server111	False
SADA	0	6	0	0	-51:14:25	27:10:25	1.65	86.32	-0.11	81.17	0.62	78.91	-	-	-	-	server112	False
IntFOLD7	4	5	0	0	-11:15:52	26:50:27	20.50	86.27	15.76	80.98	0.74	95.54	-	-	-	-	server113	False
Robetta	15	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-	server11	True
ZJUT-DeepAssembly	0	6	0	0	-45:51:19	27:10:25	1.04	86.32	0.05	81.17	0.59	78.91	-	-	-	-	server120	False
MultiDFold	0	6	0	0	-52:38:12	27:10:25	9.55	86.32	8.83	81.17	14.70	78.91	-	-	-	-	server121	False
MEGA-EvoGen	0	6	0	0	-20:48:29	27:10:25	-0.23	86.32	-0.10	81.17	1.48	78.91	-	-	-	-	server122	False
ManiFold	0	6	0	0	-31:43:31	27:10:25	1.34	86.32	0.67	81.17	0.81	78.91	-	-	-	-	server129	False
PAthreader	0	6	0	0	--3:51:11	27:10:25	0.47	86.32	0.22	81.17	1.57	78.91	-	-	-	-	server130	False
Phyre2	1	5	0	0	--27:44:49	27:17:52	47.55	86.34	35.70	81.37	38.71	78.91	-	-	-	-	server17	False
RoseTTAFold	4	5	0	0	-28:17:48	27:38:07	11.56	85.53	8.63	80.57	15.94	78.91	-	-	-	-	server19	False
SWISS-MODEL	1	6	0	0	--28:19:02	27:46:07	40.85	86.32	32.84	81.17	32.85	78.91	-	-	-	-	server20	False
RaptorX	15	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-	server22	True
SPARKS-X	15	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-	server30	True
IntFOLD3-TS	0	6	0	0	-15:41:39	27:10:25	33.67	86.32	26.50	81.17	7.29	78.91	-	-	-	-	server33	False
NaiveBLAST	3	4	0	0	--28:56:14	27:04:06	62.89	86.42	55.18	81.44	41.11	78.91	-	-	-	-	server36	False
IntFOLD4-TS	0	6	0	0	-35:40:17	27:10:25	32.13	86.32	24.73	81.17	3.22	78.91	-	-	-	-	server58	False
PRIMO	2	5	0	0	--25:53:01	27:30:23	54.30	85.48	41.67	80.53	6.04	62.28	-	-	-	-	server61	False
PRIMO_BST_3D	4	5	0	0	--25:52:17	27:27:05	55.01	85.48	40.64	80.53	8.59	62.28	-	-	-	-	server62	False
PRIMO_HHS_3D	13	0	0	0	--21:04:44	25:20:07	-	-	-	-	-	-	-	-	-	-	server63	True
PRIMO_HHS_CL	13	1	0	0	--22:02:22	25:17:48	69.29	90.29	51.98	84.12	-	-	-	-	-	-	server64	True
PRIMO_BST_CL	1	6	0	0	--25:54:26	27:20:38	54.96	86.32	41.81	81.17	36.84	78.91	-	-	-	-	server65	False
IntFOLD5-TS	0	6	0	0	-02:44:57	27:10:25	29.78	86.32	24.01	81.17	2.03	78.91	-	-	-	-	server75	False
IntFOLD6-TS	2	6	0	0	--1:16:47	27:12:29	27.74	86.32	23.61	81.17	1.27	78.91	-	-	-	-	server90	False
pureAF2_orig	0	6	0	0	--13:14:40	27:10:25	0.31	86.32	-0.22	81.17	-0.12	78.91	-	-	-	-	server96	False
pureAF2_notemp	0	6	0	0	--13:18:51	27:10:25	0.36	86.32	-0.34	81.17	-0.30	78.91	-	-	-	-	server97	False
ZlxFold	15	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-	server98	True
BestSingleStructuralTemplate	1	6	0	0	--23:17:23	27:20:38	25.24	86.32	20.15	81.17	24.45	78.91	-	-	-	-	server999	False
Naive AlphaFoldDB 90	8	1	0	0	--28:50:22	27:09:59	3.01	90.29	3.19	84.12	-	-	-	-	-	-	server99	False

AIRFold - model_1 per target comparison with the best: 1-week - [2022-04-16]

Target	ref. PDB	lDDT			CAD-score			lDDT-BS			QS-score			MM-align			Difficulty
Target	ref. PDB	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Difficulty