CAMEO - Continuous Automated Model EvaluatiOn - Protein Structure Prediction - Pairwise Comparison

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
AIRFold - Reference

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
AIRFold - Reference
NaiveBLAST	-153	35	0	0	--31:47:38	30:13:00	45.37	84.72	40.25	80.88	38.78	84.79	-	-	-	-
Phyre2	-190	45	0	0	--30:11:46	30:31:50	43.26	84.10	33.10	80.59	39.69	85.09	-	-	-	-
IntFOLD6-TS	-197	45	0	0	--1:07:56	30:28:14	27.35	84.10	21.48	80.59	23.47	85.09	-	-	-	-
IntFOLD5-TS	-191	45	0	0	-06:53:46	30:28:14	27.16	84.10	21.33	80.59	21.92	85.09	-	-	-	-
BestSingleStructuralTemplate	-178	42	0	0	--24:26:29	29:22:24	20.88	84.30	17.48	80.81	20.99	85.09	-	-	-	-
RoseTTAFold	-158	43	0	0	--28:28:48	29:43:38	13.61	84.19	10.88	80.68	19.10	84.24	-	-	-	-
IntFOLD7	-167	43	0	0	-16:57:25	29:30:55	8.53	84.20	6.80	80.60	10.65	85.09	-	-	-	-
SWISS-MODEL	-196	45	0	0	--32:23:32	31:44:23	8.29	84.10	7.54	80.59	6.93	85.09	-	-	-	-
Naive AlphaFoldDB 90	-117	35	0	0	--32:54:06	31:59:32	2.92	84.17	3.11	80.55	6.22	87.29	-	-	-	-
Naive AlphaFoldDB 100	-53	24	0	0	--33:53:18	33:01:57	1.77	84.08	2.22	80.47	-0.76	83.23	-	-	-	-

CAMEOContinuous Automated Model EvaluatiOn

CAMEO-3D: Server Pairwise Comparison 6-months Performance (2024-09-13 - 2025-03-08)