CAMEO-3D: Server Pairwise Comparison 1-week Performance (2022-04-16)

The pairwise comparison is showing the average differences of the reference with all the other servers, each on a common data subset. It is misleading to compare further servers among each other, without selecting a new reference as for each server pair the common subset may differ. Numbers in green denote scores where the reference server is better, numbers in red where another server was outperforming the reference server.

Phyre2 - Pairwise Comparison on common targets - dataset: 1-week [2022-04-16]

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
Phyre2 - Reference

Server Name	Targets modeled		Oligo-Targets modeled		Avg. Response Time (hh:mm:ss)		Avg. lDDT		Avg. CAD-score		Avg. lDDT-BS		Avg. QS-score		Avg. MM-align
Server Name	Dif.	Com.	Dif.	Com.	Dif.	Ref	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.	Dif.	Ref.
Phyre2 - Reference
PRIMO_HHS_CL	12	2	0	0	-02:57:45	00:22:25	7.95	37.34	7.86	49.07	-	-	-	-	-	-
PRIMO_BST_CL	0	13	0	0	-02:25:59	01:02:13	5.81	51.19	6.77	55.27	13.56	43.22	-	-	-	-
PRIMO	1	12	0	0	-02:38:44	00:59:39	5.74	52.20	6.93	55.98	-5.92	24.63	-	-	-	-
PRIMO_BST_3D	3	10	0	0	-02:39:22	00:57:49	5.28	45.58	6.38	51.16	-16.96	24.63	-	-	-	-
NaiveBLAST	2	11	0	0	--2:51:19	01:09:02	0.59	54.16	4.27	57.54	16.77	43.22	-	-	-	-
PRIMO_HHS_3D	12	2	0	0	-03:46:44	00:38:07	0.46	62.49	2.33	67.63	-	-	-	-	-	-
Naive AlphaFoldDB 90	7	7	0	0	--2:53:01	01:07:20	-3.85	71.22	0.36	70.12	-	-	-	-	-	-
RocketX	-1	14	0	0	-40:23:41	01:02:41	-5.88	53.55	-4.72	57.02	17.12	43.22	-	-	-	-
SWISS-MODEL	0	13	0	0	--2:52:55	01:12:24	-8.92	55.62	-5.33	59.05	12.01	43.22	-	-	-	-
IntFOLD3-TS	-1	14	0	0	-43:01:34	01:02:41	-9.02	53.55	-6.11	57.02	-4.53	43.22	-	-	-	-
IntFOLD4-TS	-1	14	0	0	-63:38:20	01:02:41	-12.44	53.55	-8.60	57.02	-9.48	43.22	-	-	-	-
IntFOLD5-TS	-1	14	0	0	-30:00:45	01:02:41	-13.10	53.55	-8.97	57.02	-12.51	43.22	-	-	-	-
MultiDFold	-1	14	0	0	-78:45:03	01:02:41	-16.42	53.55	-12.40	57.02	-10.04	43.22	-	-	-	-
IntFOLD6-TS	1	12	0	0	-26:27:09	01:01:28	-16.99	48.21	-10.56	53.19	-20.74	43.22	-	-	-	-
IntFOLD7	3	10	0	0	-38:55:42	00:49:37	-17.73	54.49	-11.53	58.32	-14.40	80.40	-	-	-	-
BestSingleStructuralTemplate	0	13	0	0	-03:54:05	01:02:13	-18.97	51.19	-13.22	55.27	-10.63	43.22	-	-	-	-
RoseTTAFold	3	10	0	0	-52:45:32	01:05:01	-22.14	52.29	-16.81	56.04	-22.77	40.20	-	-	-	-
Naive AlphaFoldDB 100	12	2	0	0	--2:54:30	01:05:50	-26.97	43.40	-17.81	50.41	-	-	-	-	-	-
pureAF2_notemp	-1	14	0	0	-12:42:47	01:02:41	-27.58	53.55	-22.10	57.02	-9.59	43.22	-	-	-	-
AIRFold	-1	14	0	0	-26:15:11	01:02:41	-27.99	53.55	-22.07	57.02	-9.39	43.22	-	-	-	-
ManiFold	-1	14	0	0	-57:55:33	01:02:41	-28.09	53.55	-22.03	57.02	-11.64	43.22	-	-	-	-
OpenComplex	-1	14	0	0	-47:51:35	01:02:41	-28.90	53.55	-22.75	57.02	-16.11	43.22	-	-	-	-
SADA	-1	14	0	0	-77:21:34	01:02:41	-28.92	53.55	-23.42	57.02	-24.65	43.22	-	-	-	-
ZJUT-DeepAssembly	-1	14	0	0	-71:59:33	01:02:41	-29.39	53.55	-23.29	57.02	-24.30	43.22	-	-	-	-
PAthreader	-1	14	0	0	-23:58:57	01:02:41	-29.63	53.55	-22.92	57.02	-21.28	43.22	-	-	-	-
pureAF2_orig	-1	14	0	0	-14:18:45	01:02:41	-30.07	53.55	-23.59	57.02	-26.89	43.22	-	-	-	-
HeliXonAI	-1	14	0	0	-75:34:30	01:02:41	-30.34	53.55	-23.40	57.02	-31.40	43.22	-	-	-	-
MEGA-EvoGen	-1	14	0	0	-46:55:24	01:02:41	-30.83	53.55	-24.08	57.02	-8.78	43.22	-	-	-	-
PaFold	14	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-
Robetta	14	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-
RaptorX	14	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-
SPARKS-X	14	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-
ZlxFold	14	0	0	0	-	-	-	-	-	-	-	-	-	-	-	-



PRIMO_HHS_CL
PRIMO_BST_CL
PRIMO
PRIMO_BST_3D
NaiveBLAST
PRIMO_HHS_3D
Naive AlphaFoldDB 90
RocketX
SWISS-MODEL
IntFOLD3-TS
IntFOLD4-TS
IntFOLD5-TS
MultiDFold
IntFOLD6-TS
IntFOLD7
BestSingleStructuralTemplate
RoseTTAFold
Naive AlphaFoldDB 100
pureAF2_notemp
AIRFold
ManiFold
OpenComplex
SADA
ZJUT-DeepAssembly
PAthreader
pureAF2_orig
HeliXonAI
MEGA-EvoGen
PaFold
Robetta
RaptorX
SPARKS-X
ZlxFold

Phyre2 - model_1 per target comparison with the best: 1-week - [2022-04-16]

Target	ref. PDB	lDDT			CAD-score			lDDT-BS			QS-score			MM-align			Difficulty
Target	ref. PDB	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Diff	Ref	Best	Difficulty