GW6 Held-Out Pair Radar: Equal Steps, Min-Max Raw Metrics

Held-out direct singleton translation sweep, using raw metric values min-max normalized within each directed eval before averaging.

Held-Out Equal-Steps Radar, Min-Max Raw Metrics

summary.json raw_metrics.csv minmax_metrics.csv radar_by_spoke_and_k.csv eval_by_k.csv

Completeness

Complete

item	value
Runs	210
Raw eval rows	510
Expected rows	510
Missing rows	0
Failed rows	0

Radar Values

spoke	run_size	mean_minmax_score	n_rows
reptok:lpips	3	0.4371107342	8
reptok:lpips	4	0.5500092072	12
reptok:lpips	5	0.6815018836	8
reptok:lpips	6	0.7530149883	2
reptok:semantic	3	0.5170101279	12
reptok:semantic	4	0.5949445797	18
reptok:semantic	5	0.7082244369	12
reptok:semantic	6	0.6864634541	3
reptok:det_class	3	0.4206842818	20
reptok:det_class	4	0.5620392954	30
reptok:det_class	5	0.5348543361	20
reptok:det_class	6	0.6077642276	5
reptok:det_bbox_iou	3	0.5553211179	4
reptok:det_bbox_iou	4	0.4689158902	6
reptok:det_bbox_iou	5	0.3306397396	4
reptok:det_bbox_iou	6	0.1276962822	1
biggan:lpips	3	0.4553089663	8
biggan:lpips	4	0.4977348987	12
biggan:lpips	5	0.5238191006	8
biggan:lpips	6	0.3606226441	2
biggan:semantic	3	0.5560418279	8
biggan:semantic	4	0.6582816981	12
biggan:semantic	5	0.8066285617	8
biggan:semantic	6	0.9524264252	2
biggan:det_class	3	0.6364316339	20
biggan:det_class	4	0.690337242	30
biggan:det_class	5	0.7140327907	20
biggan:det_class	6	0.7054902389	5
biggan:det_bbox_iou	3	0.3437943653	4
biggan:det_bbox_iou	4	0.6404673482	6
biggan:det_bbox_iou	5	0.6324564613	4
biggan:det_bbox_iou	6	0.5303388807	1
sonar:bleu	3	0.4716179725	16
sonar:bleu	4	0.6061988771	24
sonar:bleu	5	0.4996625176	16
sonar:bleu	6	0.4867106723	4
symbolic:top1	3	0.5596478175	16
symbolic:top1	4	0.6475281085	24
symbolic:top1	5	0.5636780754	16
symbolic:top1	6	0.484375	4
symbolic:bbox_iou	3	0.5979811996	20
symbolic:bbox_iou	4	0.5765811735	30
symbolic:bbox_iou	5	0.6256675913	20
symbolic:bbox_iou	6	0.4458250279	5

Directed Eval Values

eval_id	source	target	metric	run_size	mean_minmax_score	n_rows
1	biggan	reptok	lpips	3	0.3944664569	4
1	biggan	reptok	lpips	4	0.5146094267	6
1	biggan	reptok	lpips	5	0.757484441	4
1	biggan	reptok	lpips	6	0.783942531	1
2	dinov2	reptok	lpips	3	0.4797550115	4
2	dinov2	reptok	lpips	4	0.5854089876	6
2	dinov2	reptok	lpips	5	0.6055193261	4
2	dinov2	reptok	lpips	6	0.7220874456	1
5	bge	reptok	semantic	3	0.5899125577	4
5	bge	reptok	semantic	4	0.5261792204	6
5	bge	reptok	semantic	5	0.5149131652	4
5	bge	reptok	semantic	6	0.43507138	1
6	sonar	reptok	semantic	3	0.6800276819	4
6	sonar	reptok	semantic	4	0.7788075808	6
6	sonar	reptok	semantic	5	0.7476338618	4
6	sonar	reptok	semantic	6	0.6980984861	1
7	symbolic	reptok	semantic	3	0.281090144	4
7	symbolic	reptok	semantic	4	0.4798469378	6
7	symbolic	reptok	semantic	5	0.8621262837	4
7	symbolic	reptok	semantic	6	0.9262204962	1
8	biggan	reptok	det_class	3	0.3472222222	4
8	biggan	reptok	det_class	4	0.6111111111	6
8	biggan	reptok	det_class	5	0.5277777778	4
8	biggan	reptok	det_class	6	0.5	1
9	dinov2	reptok	det_class	3	0.4270833334	4
9	dinov2	reptok	det_class	4	0.6458333333	6
9	dinov2	reptok	det_class	5	0.53125	4
9	dinov2	reptok	det_class	6	0.7083333333	1
10	bge	reptok	det_class	3	0.30625	4
10	bge	reptok	det_class	4	0.3416666667	6
10	bge	reptok	det_class	5	0.3375	4
10	bge	reptok	det_class	6	0.4	1
11	sonar	reptok	det_class	3	0.5853658537	4
11	sonar	reptok	det_class	4	0.7032520325	6
11	sonar	reptok	det_class	5	0.6402439025	4
11	sonar	reptok	det_class	6	0.7804878049	1
12	symbolic	reptok	det_class	3	0.4375	4
12	symbolic	reptok	det_class	4	0.5083333333	6
12	symbolic	reptok	det_class	5	0.6375	4
12	symbolic	reptok	det_class	6	0.65	1
13	symbolic	reptok	det_bbox_iou	3	0.5553211179	4
13	symbolic	reptok	det_bbox_iou	4	0.4689158902	6
13	symbolic	reptok	det_bbox_iou	5	0.3306397396	4
13	symbolic	reptok	det_bbox_iou	6	0.1276962822	1
14	dinov2	biggan	lpips	3	0.4981378153	4
14	dinov2	biggan	lpips	4	0.4812818489	6
14	dinov2	biggan	lpips	5	0.5860294832	4
14	dinov2	biggan	lpips	6	0.4442481025	1
15	reptok	biggan	lpips	3	0.4124801173	4
15	reptok	biggan	lpips	4	0.5141879485	6
15	reptok	biggan	lpips	5	0.461608718	4
15	reptok	biggan	lpips	6	0.2769971857	1
18	bge	biggan	semantic	3	0.555759187	4
18	bge	biggan	semantic	4	0.6371742897	6
18	bge	biggan	semantic	5	0.7952450263	4
18	bge	biggan	semantic	6	0.9288992488	1
19	sonar	biggan	semantic	3	0.5563244688	4
19	sonar	biggan	semantic	4	0.6793891065	6
19	sonar	biggan	semantic	5	0.818012097	4
19	sonar	biggan	semantic	6	0.9759536017	1
21	dinov2	biggan	det_class	3	0.6676136364	4
21	dinov2	biggan	det_class	4	0.8011363636	6
21	dinov2	biggan	det_class	5	0.8721590909	4
21	dinov2	biggan	det_class	6	0.7727272727	1
22	reptok	biggan	det_class	3	0.6020408163	4
22	reptok	biggan	det_class	4	0.7380952381	6
22	reptok	biggan	det_class	5	0.6530612245	4
22	reptok	biggan	det_class	6	0.4489795918	1
23	bge	biggan	det_class	3	0.6186440678	4
23	bge	biggan	det_class	4	0.6723163842	6
23	bge	biggan	det_class	5	0.7372881356	4
23	bge	biggan	det_class	6	0.813559322	1
24	sonar	biggan	det_class	3	0.5438596492	4
24	sonar	biggan	det_class	4	0.6461988304	6
24	sonar	biggan	det_class	5	0.7894736842	4
24	sonar	biggan	det_class	6	0.9649122807	1
25	symbolic	biggan	det_class	3	0.75	4
25	symbolic	biggan	det_class	4	0.5939393939	6
25	symbolic	biggan	det_class	5	0.5181818182	4
25	symbolic	biggan	det_class	6	0.5272727273	1
26	symbolic	biggan	det_bbox_iou	3	0.3437943653	4
26	symbolic	biggan	det_bbox_iou	4	0.6404673482	6
26	symbolic	biggan	det_bbox_iou	5	0.6324564613	4
26	symbolic	biggan	det_bbox_iou	6	0.5303388807	1
27	biggan	sonar	bleu	3	0.5915772557	4
27	biggan	sonar	bleu	4	0.6568505811	6
27	biggan	sonar	bleu	5	0.3341135955	4
27	biggan	sonar	bleu	6	0	1
28	dinov2	sonar	bleu	3	0.3264002975	4
28	dinov2	sonar	bleu	4	0.5520099341	6
28	dinov2	sonar	bleu	5	0.6128773925	4
28	dinov2	sonar	bleu	6	0.887229884	1
29	reptok	sonar	bleu	3	0.4952158013	4
29	reptok	sonar	bleu	4	0.6971962218	6
29	reptok	sonar	bleu	5	0.5998810094	4
29	reptok	sonar	bleu	6	0.6425875759	1
30	bge	sonar	bleu	3	0.4732785352	4
30	bge	sonar	bleu	4	0.5187387715	6
30	bge	sonar	bleu	5	0.4517780729	4
30	bge	sonar	bleu	6	0.4170252295	1
32	dinov2	symbolic	top1	3	0.5555555556	4
32	dinov2	symbolic	top1	4	0.7037037037	6
32	dinov2	symbolic	top1	5	0.6527777778	4
32	dinov2	symbolic	top1	6	0.3333333333	1
33	reptok	symbolic	top1	3	0.5	4
33	reptok	symbolic	top1	4	0.6111111111	6
33	reptok	symbolic	top1	5	0.3541666667	4
33	reptok	symbolic	top1	6	0.4166666667	1
34	bge	symbolic	top1	3	0.5892857143	4
34	bge	symbolic	top1	4	0.7023809524	6
34	bge	symbolic	top1	5	0.4821428571	4
34	bge	symbolic	top1	6	0.5	1
35	sonar	symbolic	top1	3	0.59375	4
35	sonar	symbolic	top1	4	0.5729166667	6
35	sonar	symbolic	top1	5	0.765625	4
35	sonar	symbolic	top1	6	0.6875	1
41	biggan	symbolic	bbox_iou	3	0.6701455209	4
41	biggan	symbolic	bbox_iou	4	0.5670780302	6
41	biggan	symbolic	bbox_iou	5	0.3370235768	4
41	biggan	symbolic	bbox_iou	6	0.4191900056	1
42	dinov2	symbolic	bbox_iou	3	0.6257202256	4
42	dinov2	symbolic	bbox_iou	4	0.7154706732	6
42	dinov2	symbolic	bbox_iou	5	0.7549858501	4
42	dinov2	symbolic	bbox_iou	6	0.7931501464	1
43	reptok	symbolic	bbox_iou	3	0.575388306	4
43	reptok	symbolic	bbox_iou	4	0.4428016097	6
43	reptok	symbolic	bbox_iou	5	0.6909156518	4
43	reptok	symbolic	bbox_iou	6	0.6743083184	1
44	bge	symbolic	bbox_iou	3	0.56195621	4
44	bge	symbolic	bbox_iou	4	0.5944827644	6
44	bge	symbolic	bbox_iou	5	0.6136706257	4
44	bge	symbolic	bbox_iou	6	0	1
45	sonar	symbolic	bbox_iou	3	0.5566957358	4
45	sonar	symbolic	bbox_iou	4	0.5630727902	6
45	sonar	symbolic	bbox_iou	5	0.7317422521	4
45	sonar	symbolic	bbox_iou	6	0.3424766691	1

Held-Out Equal-Steps Radar, No BigGAN Training Sets, Min-Max Raw Metrics

summary.json raw_metrics.csv minmax_metrics.csv radar_by_spoke_and_k.csv eval_by_k.csv

Completeness

Complete

item	value
Runs	63
Raw eval rows	140
Expected rows	None
Missing rows	0
Failed rows	0

Radar Values

spoke	run_size	mean_minmax_score	n_rows
reptok:lpips	3	0.6328915176	3
reptok:lpips	4	0.6974515214	3
reptok:lpips	5	0.7224025749	1
reptok:semantic	3	0.5051501258	9
reptok:semantic	4	0.6437239001	9
reptok:semantic	5	0.8733726319	3
reptok:det_class	3	0.3798374613	12
reptok:det_class	4	0.5591976264	12
reptok:det_class	5	0.4097910217	4
reptok:det_bbox_iou	3	0.5223774112	3
reptok:det_bbox_iou	4	0.407396596	3
reptok:det_bbox_iou	5	0.1166805859	1
sonar:bleu	3	0.385873324	9
sonar:bleu	4	0.5662321009	9
sonar:bleu	5	0.4476641368	3
symbolic:top1	3	0.4618055556	12
symbolic:top1	4	0.5138888889	12
symbolic:top1	5	0.4270833333	4
symbolic:bbox_iou	3	0.5258384421	12
symbolic:bbox_iou	4	0.3454816694	12
symbolic:bbox_iou	5	0.6851840366	4

Directed Eval Values

eval_id	source	target	metric	run_size	mean_minmax_score	n_rows
2	dinov2	reptok	lpips	3	0.6328915176	3
2	dinov2	reptok	lpips	4	0.6974515214	3
2	dinov2	reptok	lpips	5	0.7224025749	1
5	bge	reptok	semantic	3	0.5354785123	3
5	bge	reptok	semantic	4	0.5587015315	3
5	bge	reptok	semantic	5	0.8355756216	1
6	sonar	reptok	semantic	3	0.5553960337	3
6	sonar	reptok	semantic	4	0.9213416541	3
6	sonar	reptok	semantic	5	0.7845422741	1
7	symbolic	reptok	semantic	3	0.4245758314	3
7	symbolic	reptok	semantic	4	0.4511285146	3
7	symbolic	reptok	semantic	5	1	1
9	dinov2	reptok	det_class	3	0.3921568627	3
9	dinov2	reptok	det_class	4	0.6078431373	3
9	dinov2	reptok	det_class	5	0.6470588235	1
10	bge	reptok	det_class	3	0.3771929825	3
10	bge	reptok	det_class	4	0.4122807018	3
10	bge	reptok	det_class	5	0.3421052632	1
11	sonar	reptok	det_class	3	0.25	3
11	sonar	reptok	det_class	4	0.75	3
11	sonar	reptok	det_class	5	0	1
12	symbolic	reptok	det_class	3	0.5	3
12	symbolic	reptok	det_class	4	0.4666666667	3
12	symbolic	reptok	det_class	5	0.65	1
13	symbolic	reptok	det_bbox_iou	3	0.5223774112	3
13	symbolic	reptok	det_bbox_iou	4	0.407396596	3
13	symbolic	reptok	det_bbox_iou	5	0.1166805859	1
28	dinov2	sonar	bleu	3	0.3695783131	3
28	dinov2	sonar	bleu	4	0.664701269	3
28	dinov2	sonar	bleu	5	0.6418767986	1
29	reptok	sonar	bleu	3	0.3792086092	3
29	reptok	sonar	bleu	4	0.6621529901	3
29	reptok	sonar	bleu	5	0.7011156118	1
30	bge	sonar	bleu	3	0.4088330499	3
30	bge	sonar	bleu	4	0.3718420436	3
30	bge	sonar	bleu	5	0	1
32	dinov2	symbolic	top1	3	0.2222222222	3
32	dinov2	symbolic	top1	4	0.5555555556	3
32	dinov2	symbolic	top1	5	0.3333333333	1
33	reptok	symbolic	top1	3	0.4166666667	3
33	reptok	symbolic	top1	4	0.6666666667	3
33	reptok	symbolic	top1	5	0.5	1
34	bge	symbolic	top1	3	0.625	3
34	bge	symbolic	top1	4	0.6666666667	3
34	bge	symbolic	top1	5	0	1
35	sonar	symbolic	top1	3	0.5833333333	3
35	sonar	symbolic	top1	4	0.1666666667	3
35	sonar	symbolic	top1	5	0.875	1
42	dinov2	symbolic	bbox_iou	3	0.4485265108	3
42	dinov2	symbolic	bbox_iou	4	0.3899069385	3
42	dinov2	symbolic	bbox_iou	5	0.4231408163	1
43	reptok	symbolic	bbox_iou	3	0.4638867199	3
43	reptok	symbolic	bbox_iou	4	0.1239602239	3
43	reptok	symbolic	bbox_iou	5	1	1
44	bge	symbolic	bbox_iou	3	0.5117062393	3
44	bge	symbolic	bbox_iou	4	0.5326731915	3
44	bge	symbolic	bbox_iou	5	0.570495952	1
45	sonar	symbolic	bbox_iou	3	0.6792342984	3
45	sonar	symbolic	bbox_iou	4	0.3353863234	3
45	sonar	symbolic	bbox_iou	5	0.7470993779	1

Held-Out Equal-Steps Radar, No BigGAN or Symbolic Training Sets, Min-Max Raw Metrics

summary.json raw_metrics.csv minmax_metrics.csv radar_by_spoke_and_k.csv eval_by_k.csv

Completeness

Complete

item	value
Runs	15
Raw eval rows	27
Expected rows	None
Missing rows	0
Failed rows	0

Radar Values

spoke	run_size	mean_minmax_score	n_rows
reptok:lpips	3	0.8495720444	2
reptok:lpips	4	0	1
reptok:semantic	3	0.5	4
reptok:semantic	4	0.7505912617	2
reptok:det_class	3	0.5	6
reptok:det_class	4	0.3220551378	3
sonar:bleu	3	0.466073855	6
sonar:bleu	4	0.7482698116	3

Directed Eval Values

eval_id	source	target	metric	run_size	mean_minmax_score	n_rows
2	dinov2	reptok	lpips	3	0.8495720444	2
2	dinov2	reptok	lpips	4	0	1
5	bge	reptok	semantic	3	0.5	2
5	bge	reptok	semantic	4	0.6513938144	1
6	sonar	reptok	semantic	3	0.5	2
6	sonar	reptok	semantic	4	0.8497887089	1
9	dinov2	reptok	det_class	3	0.5	2
9	dinov2	reptok	det_class	4	0.07142857143	1
10	bge	reptok	det_class	3	0.5	2
10	bge	reptok	det_class	4	0.3947368421	1
11	sonar	reptok	det_class	3	0.5	2
11	sonar	reptok	det_class	4	0.5	1
28	dinov2	sonar	bleu	3	0.3982215648	2
28	dinov2	sonar	bleu	4	1	1
29	reptok	sonar	bleu	3	0.5	2
29	reptok	sonar	bleu	4	0.8915573	1
30	bge	sonar	bleu	3	0.5	2
30	bge	sonar	bleu	4	0.3532521347	1