CAMEO - Continuous Automated Model EvaluatiOn - Protein Structure Prediction - Pairwise Comparison

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
Naive AlphaFoldDB 100 - Reference

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
Naive AlphaFoldDB 100 - Reference
PRIMO_HHS_3D	11	17	0	0	-03:32:19	00:00:30	35.98	76.98	29.73	75.15	21.07	75.27	-	-	-	-
PRIMO_BST_3D	-114	45	0	0	-02:56:04	00:00:32	34.67	82.23	29.04	78.23	33.17	77.46	-	-	-	-
PRIMO_HHS_CL	-1	21	0	0	-03:08:46	00:00:28	33.01	81.79	25.09	78.82	33.42	84.25	-	-	-	-
PRIMO	-163	55	0	0	-02:31:53	00:00:33	31.62	82.75	25.97	78.86	32.51	78.62	-	-	-	-
PRIMO_BST_CL	-149	53	0	0	-02:33:39	00:00:29	31.43	82.51	25.75	78.76	29.60	78.50	-	-	-	-
Phyre2	-296	77	0	0	-01:20:17	00:00:37	28.53	82.73	22.82	78.77	24.03	82.18	-	-	-	-
NaiveBLAST	-242	60	0	0	-00:00:59	00:00:42	27.11	82.20	24.44	78.35	26.58	80.97	-	-	-	-
SWISS-MODEL	-298	76	0	0	-00:06:06	00:00:32	20.42	82.82	17.43	78.80	20.11	82.18	-	-	-	-
IntFOLD3-TS	-256	71	0	0	-38:40:05	00:00:39	19.88	84.09	15.69	79.71	18.90	84.70	-	-	-	-
IntFOLD5-TS	-229	64	0	0	-32:01:45	00:00:42	18.62	83.80	13.50	79.58	13.81	84.72	-	-	-	-

CAMEOContinuous Automated Model EvaluatiOn

CAMEO-3D: Server Pairwise Comparison 6-months Performance (2021-10-22 - 2022-04-16)