CAMEO-3D: Server Pairwise Comparison 6-months Performance (2024-09-13 - 2025-03-08)

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

AIRFold - Pairwise Comparison on common targets - dataset: 6-months [2024-09-13 - 2025-03-08]

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
AIRFold - Reference

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
AIRFold - Reference
NaiveBLAST	-153	35	0	0	--31:47:38	30:13:00	45.37	84.72	40.25	80.88	38.78	84.79	-	-	-	-
Phyre2	-190	45	0	0	--30:11:46	30:31:50	43.26	84.10	33.10	80.59	39.69	85.09	-	-	-	-
IntFOLD6-TS	-197	45	0	0	--1:07:56	30:28:14	27.35	84.10	21.48	80.59	23.47	85.09	-	-	-	-
IntFOLD5-TS	-191	45	0	0	-06:53:46	30:28:14	27.16	84.10	21.33	80.59	21.92	85.09	-	-	-	-
BestSingleStructuralTemplate	-178	42	0	0	--24:26:29	29:22:24	20.88	84.30	17.48	80.81	20.99	85.09	-	-	-	-
RoseTTAFold	-158	43	0	0	--28:28:48	29:43:38	13.61	84.19	10.88	80.68	19.10	84.24	-	-	-	-
IntFOLD7	-167	43	0	0	-16:57:25	29:30:55	8.53	84.20	6.80	80.60	10.65	85.09	-	-	-	-
SWISS-MODEL	-196	45	0	0	--32:23:32	31:44:23	8.29	84.10	7.54	80.59	6.93	85.09	-	-	-	-
Naive AlphaFoldDB 90	-117	35	0	0	--32:54:06	31:59:32	2.92	84.17	3.11	80.55	6.22	87.29	-	-	-	-
Naive AlphaFoldDB 100	-53	24	0	0	--33:53:18	33:01:57	1.77	84.08	2.22	80.47	-0.76	83.23	-	-	-	-


NaiveBLAST
Phyre2
IntFOLD6-TS
IntFOLD5-TS
BestSingleStructuralTemplate
RoseTTAFold
IntFOLD7
SWISS-MODEL
Naive AlphaFoldDB 90
Naive AlphaFoldDB 100

AIRFold - model_1 per target comparison with the best: 6-months - [2024-09-13 - 2025-03-08]

Target	ref. PDB	lDDT			CAD-score			lDDT-BS			QS-score			MM-align			Difficulty
Target	ref. PDB	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Difficulty
2025-03-08_00000256_1	9gpi[D]	-	86.12	OpenComplex	-	80.34	OpenComplex	-	-	-	-	0.00	SWISS-MODEL	-	0.46	SWISS-MODEL	Medium
2025-03-08_00000244_1	9fiz[A]	-	84.01	IntFOLD7	-	79.35	IntFOLD7	-	-	-	-	0.52	SWISS-MODEL	-	0.82	SWISS-MODEL	Medium
2025-03-08_00000242_1	9fhk[B]	-	84.78	IntFOLD7	-	80.01	IntFOLD7	-	-	-	-	0.56	SWISS-MODEL	-	0.80	SWISS-MODEL	Medium
2025-03-08_00000217_1	9ehu[A]	-	77.36	OpenComplex	-	74.27	OpenComplex	-	-	-	-	-	-	-	-	-	Medium
2025-03-08_00000189_1	9ckx[A]	-	76.42	IntFOLD7	-	76.10	IntFOLD7	-	-	-	-	-	-	-	-	-	Medium
2025-03-08_00000098_1	8zwz[A]	-	77.97	OpenComplex	-	73.55	OpenComplex	-	-	-	-	-	-	-	-	-	Medium
2025-03-08_00000049_3	8xuf[C]	-	81.88	OpenComplex	-	79.84	OpenComplex	-	98.99	IntFOLD7	-	-	-	-	-	-	Medium
2025-03-08_00000027_1	8s7a[A]	-	77.66	IntFOLD7	-	75.38	IntFOLD7	-	-	-	-	0.47	SWISS-MODEL	-	0.69	SWISS-MODEL	Medium
2025-03-08_00000005_1	8qce[B]	-	91.06	IntFOLD7	-	84.66	OpenComplex	-	95.28	Naive AlphaFoldDB 90	-	-	-	-	-	-	Medium
2025-03-03_00000296_2	9ilr[B]	-	84.34	OpenComplex	-	82.19	OpenComplex	-	-	-	-	-	-	-	-	-	Medium



2025-03-08_00000256_1
2025-03-08_00000244_1
2025-03-08_00000242_1
2025-03-08_00000217_1
2025-03-08_00000189_1
2025-03-08_00000098_1
2025-03-08_00000049_3
2025-03-08_00000027_1
2025-03-08_00000005_1
2025-03-03_00000296_2