CAMEO - Continuous Automated Model EvaluatiOn - Protein Structure Prediction - Pairwise Comparison

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
IntFOLD6-TS - Reference

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
IntFOLD6-TS - Reference
PRIMO_BST_3D	88	91	0	0	--22:04:24	24:56:10	16.79	68.48	13.90	67.22	21.97	66.99	-	-	-	-
PRIMO	54	124	0	0	--22:33:20	24:27:07	14.16	68.88	11.93	67.92	15.66	66.86	-	-	-	-
PRIMO_BST_CL	59	118	0	0	--22:22:40	24:33:42	13.62	68.82	11.53	67.86	18.88	71.03	-	-	-	-
PRIMO_HHS_3D	152	29	0	0	--17:23:04	19:47:09	12.73	68.05	11.38	67.60	3.10	66.49	-	-	-	-
NaiveBLAST	15	161	0	0	--27:36:25	26:23:57	12.52	70.82	12.75	68.94	12.77	72.35	-	-	-	-
Phyre2	-2	178	0	0	--25:30:58	26:01:58	11.46	69.17	9.81	67.98	9.66	69.62	-	-	-	-
RocketX	-5	181	0	0	-06:46:01	25:54:16	9.22	69.07	5.13	67.95	11.74	70.40	-	-	-	-
PRIMO_HHS_CL	140	42	0	0	--18:53:30	20:25:29	8.36	65.01	7.34	66.11	6.32	66.07	-	-	-	-
SWISS-MODEL	-4	180	0	0	--27:51:14	26:13:54	2.46	69.17	3.02	67.94	4.29	70.04	-	-	-	-
IntFOLD3-TS	3	176	0	0	-15:40:17	25:55:05	2.17	68.91	2.41	67.84	2.43	70.23	-	-	-	-

CAMEOContinuous Automated Model EvaluatiOn

CAMEO-3D: Server Pairwise Comparison 3-months Performance (2022-01-21 - 2022-04-16)