CAMEO - Continuous Automated Model EvaluatiOn - Protein Structure Prediction - Pairwise Comparison

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
SPARKS-X - Reference

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
SPARKS-X - Reference
Phyre2	-463	278	0	0	--14:53:31	14:37:30	4.97	56.98	3.61	60.03	1.52	66.40	-	-	-	-
NaiveBLAST	-369	249	0	0	--15:17:53	14:42:32	3.31	58.54	7.30	61.05	5.80	66.27	-	-	-	-
PRIMO_BST_3D	3	50	0	0	--10:12:20	12:36:15	1.63	49.76	4.44	55.39	12.62	60.30	-	-	-	-
PRIMO	-60	57	0	0	--10:42:04	12:09:21	1.48	52.15	4.08	56.97	8.18	59.06	-	-	-	-
PRIMO_BST_CL	-42	57	0	0	--10:12:46	12:30:17	0.88	50.13	3.73	55.51	8.71	58.01	-	-	-	-
PRIMO_HHS_CL	170	17	0	0	--8:08:07	11:04:16	-5.02	46.35	0.51	53.35	1.90	61.11	-	-	-	-
PRIMO_HHS_3D	189	11	0	0	--12:53:53	14:36:37	-6.21	45.16	-1.82	51.72	16.14	45.67	-	-	-	-
SWISS-MODEL	-465	278	0	0	--15:08:07	15:36:55	-6.33	57.08	-2.04	60.15	0.95	66.16	-	-	-	-
IntFOLD3-TS	-426	281	0	0	-24:33:20	14:59:16	-7.28	56.76	-3.85	59.91	-1.76	65.40	-	-	-	-
RaptorX	-216	245	0	0	-03:04:37	15:30:14	-8.66	57.52	-5.83	60.37	0.43	65.25	-	-	-	-

CAMEOContinuous Automated Model EvaluatiOn

CAMEO-3D: Server Pairwise Comparison 1-year Performance (2021-04-23 - 2022-04-16)