GW6 Held-Out Pair Radar: Equal Steps
Held-out direct singleton translation sweep, rank-normalized within each directed eval and averaged by target metric.
Held-Out Equal-Steps Radar
Completeness
Complete
| item | value |
|---|---|
| Runs | 210 |
| Raw eval rows | 510 |
| Expected rows | 510 |
| Missing rows | 0 |
| Failed rows | 0 |
Radar Values
| spoke | run_size | mean_rank_normalized | n_rows |
|---|---|---|---|
| reptok:lpips | 3 | 0.3928571429 | 8 |
| reptok:lpips | 4 | 0.4642857143 | 12 |
| reptok:lpips | 5 | 0.6160714286 | 8 |
| reptok:lpips | 6 | 0.6785714285 | 2 |
| reptok:semantic | 3 | 0.4583333333 | 12 |
| reptok:semantic | 4 | 0.4761904762 | 18 |
| reptok:semantic | 5 | 0.5773809524 | 12 |
| reptok:semantic | 6 | 0.5 | 3 |
| reptok:det_class | 3 | 0.3839285714 | 20 |
| reptok:det_class | 4 | 0.5559523809 | 30 |
| reptok:det_class | 5 | 0.5035714286 | 20 |
| reptok:det_class | 6 | 0.6142857143 | 5 |
| reptok:det_bbox_iou | 3 | 0.625 | 4 |
| reptok:det_bbox_iou | 4 | 0.5595238095 | 6 |
| reptok:det_bbox_iou | 5 | 0.3928571429 | 4 |
| reptok:det_bbox_iou | 6 | 0.07142857143 | 1 |
| biggan:lpips | 3 | 0.4732142857 | 8 |
| biggan:lpips | 4 | 0.5357142857 | 12 |
| biggan:lpips | 5 | 0.5 | 8 |
| biggan:lpips | 6 | 0.3928571429 | 2 |
| biggan:semantic | 3 | 0.4017857143 | 8 |
| biggan:semantic | 4 | 0.4226190476 | 12 |
| biggan:semantic | 5 | 0.6160714286 | 8 |
| biggan:semantic | 6 | 0.8928571429 | 2 |
| biggan:det_class | 3 | 0.4964285714 | 20 |
| biggan:det_class | 4 | 0.4928571429 | 30 |
| biggan:det_class | 5 | 0.525 | 20 |
| biggan:det_class | 6 | 0.4571428571 | 5 |
| biggan:det_bbox_iou | 3 | 0.3571428571 | 4 |
| biggan:det_bbox_iou | 4 | 0.5952380953 | 6 |
| biggan:det_bbox_iou | 5 | 0.5714285714 | 4 |
| biggan:det_bbox_iou | 6 | 0.2142857143 | 1 |
| sonar:bleu | 3 | 0.4375 | 16 |
| sonar:bleu | 4 | 0.5803571429 | 24 |
| sonar:bleu | 5 | 0.4508928571 | 16 |
| sonar:bleu | 6 | 0.4642857143 | 4 |
| symbolic:top1 | 3 | 0.5044642857 | 16 |
| symbolic:top1 | 4 | 0.5550595238 | 24 |
| symbolic:top1 | 5 | 0.4575892857 | 16 |
| symbolic:top1 | 6 | 0.3214285714 | 4 |
| symbolic:bbox_iou | 3 | 0.5392857143 | 20 |
| symbolic:bbox_iou | 4 | 0.4619047619 | 30 |
| symbolic:bbox_iou | 5 | 0.5535714286 | 20 |
| symbolic:bbox_iou | 6 | 0.3571428572 | 5 |
Directed Eval Values
| eval_id | source | target | metric | run_size | mean_rank_normalized | n_rows |
|---|---|---|---|---|---|---|
| 1 | biggan | reptok | lpips | 3 | 0.2857142857 | 4 |
| 1 | biggan | reptok | lpips | 4 | 0.4523809524 | 6 |
| 1 | biggan | reptok | lpips | 5 | 0.7142857143 | 4 |
| 1 | biggan | reptok | lpips | 6 | 0.7857142857 | 1 |
| 2 | dinov2 | reptok | lpips | 3 | 0.5 | 4 |
| 2 | dinov2 | reptok | lpips | 4 | 0.4761904762 | 6 |
| 2 | dinov2 | reptok | lpips | 5 | 0.5178571429 | 4 |
| 2 | dinov2 | reptok | lpips | 6 | 0.5714285714 | 1 |
| 5 | bge | reptok | semantic | 3 | 0.5714285714 | 4 |
| 5 | bge | reptok | semantic | 4 | 0.4880952381 | 6 |
| 5 | bge | reptok | semantic | 5 | 0.4821428571 | 4 |
| 5 | bge | reptok | semantic | 6 | 0.3571428571 | 1 |
| 6 | sonar | reptok | semantic | 3 | 0.5357142857 | 4 |
| 6 | sonar | reptok | semantic | 4 | 0.5476190476 | 6 |
| 6 | sonar | reptok | semantic | 5 | 0.4285714286 | 4 |
| 6 | sonar | reptok | semantic | 6 | 0.3571428571 | 1 |
| 7 | symbolic | reptok | semantic | 3 | 0.2678571429 | 4 |
| 7 | symbolic | reptok | semantic | 4 | 0.3928571429 | 6 |
| 7 | symbolic | reptok | semantic | 5 | 0.8214285714 | 4 |
| 7 | symbolic | reptok | semantic | 6 | 0.7857142857 | 1 |
| 8 | biggan | reptok | det_class | 3 | 0.3303571429 | 4 |
| 8 | biggan | reptok | det_class | 4 | 0.619047619 | 6 |
| 8 | biggan | reptok | det_class | 5 | 0.5267857143 | 4 |
| 8 | biggan | reptok | det_class | 6 | 0.3571428571 | 1 |
| 9 | dinov2 | reptok | det_class | 3 | 0.3392857143 | 4 |
| 9 | dinov2 | reptok | det_class | 4 | 0.5714285714 | 6 |
| 9 | dinov2 | reptok | det_class | 5 | 0.5 | 4 |
| 9 | dinov2 | reptok | det_class | 6 | 0.7142857143 | 1 |
| 10 | bge | reptok | det_class | 3 | 0.3660714286 | 4 |
| 10 | bge | reptok | det_class | 4 | 0.5654761905 | 6 |
| 10 | bge | reptok | det_class | 5 | 0.5089285715 | 4 |
| 10 | bge | reptok | det_class | 6 | 0.6071428571 | 1 |
| 11 | sonar | reptok | det_class | 3 | 0.5 | 4 |
| 11 | sonar | reptok | det_class | 4 | 0.5595238095 | 6 |
| 11 | sonar | reptok | det_class | 5 | 0.375 | 4 |
| 11 | sonar | reptok | det_class | 6 | 0.6428571429 | 1 |
| 12 | symbolic | reptok | det_class | 3 | 0.3839285714 | 4 |
| 12 | symbolic | reptok | det_class | 4 | 0.4642857143 | 6 |
| 12 | symbolic | reptok | det_class | 5 | 0.6071428571 | 4 |
| 12 | symbolic | reptok | det_class | 6 | 0.75 | 1 |
| 13 | symbolic | reptok | det_bbox_iou | 3 | 0.625 | 4 |
| 13 | symbolic | reptok | det_bbox_iou | 4 | 0.5595238095 | 6 |
| 13 | symbolic | reptok | det_bbox_iou | 5 | 0.3928571429 | 4 |
| 13 | symbolic | reptok | det_bbox_iou | 6 | 0.07142857143 | 1 |
| 14 | dinov2 | biggan | lpips | 3 | 0.5 | 4 |
| 14 | dinov2 | biggan | lpips | 4 | 0.5238095238 | 6 |
| 14 | dinov2 | biggan | lpips | 5 | 0.4821428571 | 4 |
| 14 | dinov2 | biggan | lpips | 6 | 0.4285714286 | 1 |
| 15 | reptok | biggan | lpips | 3 | 0.4464285714 | 4 |
| 15 | reptok | biggan | lpips | 4 | 0.5476190476 | 6 |
| 15 | reptok | biggan | lpips | 5 | 0.5178571429 | 4 |
| 15 | reptok | biggan | lpips | 6 | 0.3571428571 | 1 |
| 18 | bge | biggan | semantic | 3 | 0.4107142857 | 4 |
| 18 | bge | biggan | semantic | 4 | 0.4166666667 | 6 |
| 18 | bge | biggan | semantic | 5 | 0.625 | 4 |
| 18 | bge | biggan | semantic | 6 | 0.8571428571 | 1 |
| 19 | sonar | biggan | semantic | 3 | 0.3928571429 | 4 |
| 19 | sonar | biggan | semantic | 4 | 0.4285714286 | 6 |
| 19 | sonar | biggan | semantic | 5 | 0.6071428572 | 4 |
| 19 | sonar | biggan | semantic | 6 | 0.9285714286 | 1 |
| 21 | dinov2 | biggan | det_class | 3 | 0.4821428572 | 4 |
| 21 | dinov2 | biggan | det_class | 4 | 0.4583333333 | 6 |
| 21 | dinov2 | biggan | det_class | 5 | 0.625 | 4 |
| 21 | dinov2 | biggan | det_class | 6 | 0.3214285714 | 1 |
| 22 | reptok | biggan | det_class | 3 | 0.5267857143 | 4 |
| 22 | reptok | biggan | det_class | 4 | 0.5773809524 | 6 |
| 22 | reptok | biggan | det_class | 5 | 0.4642857143 | 4 |
| 22 | reptok | biggan | det_class | 6 | 0.07142857143 | 1 |
| 23 | bge | biggan | det_class | 3 | 0.5 | 4 |
| 23 | bge | biggan | det_class | 4 | 0.4821428571 | 6 |
| 23 | bge | biggan | det_class | 5 | 0.5 | 4 |
| 23 | bge | biggan | det_class | 6 | 0.6071428571 | 1 |
| 24 | sonar | biggan | det_class | 3 | 0.3303571428 | 4 |
| 24 | sonar | biggan | det_class | 4 | 0.4464285714 | 6 |
| 24 | sonar | biggan | det_class | 5 | 0.6428571429 | 4 |
| 24 | sonar | biggan | det_class | 6 | 0.9285714286 | 1 |
| 25 | symbolic | biggan | det_class | 3 | 0.6428571429 | 4 |
| 25 | symbolic | biggan | det_class | 4 | 0.5 | 6 |
| 25 | symbolic | biggan | det_class | 5 | 0.3928571429 | 4 |
| 25 | symbolic | biggan | det_class | 6 | 0.3571428571 | 1 |
| 26 | symbolic | biggan | det_bbox_iou | 3 | 0.3571428571 | 4 |
| 26 | symbolic | biggan | det_bbox_iou | 4 | 0.5952380953 | 6 |
| 26 | symbolic | biggan | det_bbox_iou | 5 | 0.5714285714 | 4 |
| 26 | symbolic | biggan | det_bbox_iou | 6 | 0.2142857143 | 1 |
| 27 | biggan | sonar | bleu | 3 | 0.625 | 4 |
| 27 | biggan | sonar | bleu | 4 | 0.6428571428 | 6 |
| 27 | biggan | sonar | bleu | 5 | 0.2857142857 | 4 |
| 27 | biggan | sonar | bleu | 6 | 0 | 1 |
| 28 | dinov2 | sonar | bleu | 3 | 0.2857142857 | 4 |
| 28 | dinov2 | sonar | bleu | 4 | 0.5476190476 | 6 |
| 28 | dinov2 | sonar | bleu | 5 | 0.5357142857 | 4 |
| 28 | dinov2 | sonar | bleu | 6 | 0.9285714286 | 1 |
| 29 | reptok | sonar | bleu | 3 | 0.3571428572 | 4 |
| 29 | reptok | sonar | bleu | 4 | 0.5714285714 | 6 |
| 29 | reptok | sonar | bleu | 5 | 0.5357142857 | 4 |
| 29 | reptok | sonar | bleu | 6 | 0.5 | 1 |
| 30 | bge | sonar | bleu | 3 | 0.4821428572 | 4 |
| 30 | bge | sonar | bleu | 4 | 0.5595238095 | 6 |
| 30 | bge | sonar | bleu | 5 | 0.4464285714 | 4 |
| 30 | bge | sonar | bleu | 6 | 0.4285714286 | 1 |
| 32 | dinov2 | symbolic | top1 | 3 | 0.4732142857 | 4 |
| 32 | dinov2 | symbolic | top1 | 4 | 0.5773809524 | 6 |
| 32 | dinov2 | symbolic | top1 | 5 | 0.5178571429 | 4 |
| 32 | dinov2 | symbolic | top1 | 6 | 0.07142857143 | 1 |
| 33 | reptok | symbolic | top1 | 3 | 0.4642857143 | 4 |
| 33 | reptok | symbolic | top1 | 4 | 0.6369047619 | 6 |
| 33 | reptok | symbolic | top1 | 5 | 0.3660714286 | 4 |
| 33 | reptok | symbolic | top1 | 6 | 0.3571428571 | 1 |
| 34 | bge | symbolic | top1 | 3 | 0.5714285715 | 4 |
| 34 | bge | symbolic | top1 | 4 | 0.6369047619 | 6 |
| 34 | bge | symbolic | top1 | 5 | 0.2678571428 | 4 |
| 34 | bge | symbolic | top1 | 6 | 0.3214285714 | 1 |
| 35 | sonar | symbolic | top1 | 3 | 0.5089285714 | 4 |
| 35 | sonar | symbolic | top1 | 4 | 0.3690476191 | 6 |
| 35 | sonar | symbolic | top1 | 5 | 0.6785714286 | 4 |
| 35 | sonar | symbolic | top1 | 6 | 0.5357142857 | 1 |
| 41 | biggan | symbolic | bbox_iou | 3 | 0.625 | 4 |
| 41 | biggan | symbolic | bbox_iou | 4 | 0.5476190476 | 6 |
| 41 | biggan | symbolic | bbox_iou | 5 | 0.3392857143 | 4 |
| 41 | biggan | symbolic | bbox_iou | 6 | 0.3571428571 | 1 |
| 42 | dinov2 | symbolic | bbox_iou | 3 | 0.5 | 4 |
| 42 | dinov2 | symbolic | bbox_iou | 4 | 0.4166666667 | 6 |
| 42 | dinov2 | symbolic | bbox_iou | 5 | 0.5892857143 | 4 |
| 42 | dinov2 | symbolic | bbox_iou | 6 | 0.6428571429 | 1 |
| 43 | reptok | symbolic | bbox_iou | 3 | 0.5535714286 | 4 |
| 43 | reptok | symbolic | bbox_iou | 4 | 0.3571428572 | 6 |
| 43 | reptok | symbolic | bbox_iou | 5 | 0.625 | 4 |
| 43 | reptok | symbolic | bbox_iou | 6 | 0.6428571429 | 1 |
| 44 | bge | symbolic | bbox_iou | 3 | 0.5178571429 | 4 |
| 44 | bge | symbolic | bbox_iou | 4 | 0.5357142857 | 6 |
| 44 | bge | symbolic | bbox_iou | 5 | 0.5535714285 | 4 |
| 44 | bge | symbolic | bbox_iou | 6 | 0 | 1 |
| 45 | sonar | symbolic | bbox_iou | 3 | 0.5 | 4 |
| 45 | sonar | symbolic | bbox_iou | 4 | 0.4523809524 | 6 |
| 45 | sonar | symbolic | bbox_iou | 5 | 0.6607142857 | 4 |
| 45 | sonar | symbolic | bbox_iou | 6 | 0.1428571429 | 1 |
Held-Out Equal-Steps Radar, No BigGAN Training Sets
Completeness
Complete
| item | value |
|---|---|
| Runs | 63 |
| Raw eval rows | 140 |
| Expected rows | None |
| Missing rows | 0 |
| Failed rows | 0 |
Radar Values
| spoke | run_size | mean_rank_normalized | n_rows |
|---|---|---|---|
| reptok:lpips | 3 | 0.6111111111 | 3 |
| reptok:lpips | 4 | 0.3888888889 | 3 |
| reptok:lpips | 5 | 0.5 | 1 |
| reptok:semantic | 3 | 0.4444444444 | 9 |
| reptok:semantic | 4 | 0.5 | 9 |
| reptok:semantic | 5 | 0.6666666667 | 3 |
| reptok:det_class | 3 | 0.4166666667 | 12 |
| reptok:det_class | 4 | 0.625 | 12 |
| reptok:det_class | 5 | 0.375 | 4 |
| reptok:det_bbox_iou | 3 | 0.6111111111 | 3 |
| reptok:det_bbox_iou | 4 | 0.5 | 3 |
| reptok:det_bbox_iou | 5 | 0.1666666667 | 1 |
| sonar:bleu | 3 | 0.4074074074 | 9 |
| sonar:bleu | 4 | 0.6296296296 | 9 |
| sonar:bleu | 5 | 0.3888888889 | 3 |
| symbolic:top1 | 3 | 0.4652777778 | 12 |
| symbolic:top1 | 4 | 0.5555555556 | 12 |
| symbolic:top1 | 5 | 0.4375 | 4 |
| symbolic:bbox_iou | 3 | 0.5138888889 | 12 |
| symbolic:bbox_iou | 4 | 0.4027777778 | 12 |
| symbolic:bbox_iou | 5 | 0.75 | 4 |
Directed Eval Values
| eval_id | source | target | metric | run_size | mean_rank_normalized | n_rows |
|---|---|---|---|---|---|---|
| 2 | dinov2 | reptok | lpips | 3 | 0.6111111111 | 3 |
| 2 | dinov2 | reptok | lpips | 4 | 0.3888888889 | 3 |
| 2 | dinov2 | reptok | lpips | 5 | 0.5 | 1 |
| 5 | bge | reptok | semantic | 3 | 0.5 | 3 |
| 5 | bge | reptok | semantic | 4 | 0.4444444444 | 3 |
| 5 | bge | reptok | semantic | 5 | 0.6666666667 | 1 |
| 6 | sonar | reptok | semantic | 3 | 0.3333333333 | 3 |
| 6 | sonar | reptok | semantic | 4 | 0.7222222222 | 3 |
| 6 | sonar | reptok | semantic | 5 | 0.3333333333 | 1 |
| 7 | symbolic | reptok | semantic | 3 | 0.5 | 3 |
| 7 | symbolic | reptok | semantic | 4 | 0.3333333333 | 3 |
| 7 | symbolic | reptok | semantic | 5 | 1 | 1 |
| 9 | dinov2 | reptok | det_class | 3 | 0.3888888889 | 3 |
| 9 | dinov2 | reptok | det_class | 4 | 0.6111111111 | 3 |
| 9 | dinov2 | reptok | det_class | 5 | 0.5 | 1 |
| 10 | bge | reptok | det_class | 3 | 0.3888888889 | 3 |
| 10 | bge | reptok | det_class | 4 | 0.6666666666 | 3 |
| 10 | bge | reptok | det_class | 5 | 0.3333333333 | 1 |
| 11 | sonar | reptok | det_class | 3 | 0.3888888889 | 3 |
| 11 | sonar | reptok | det_class | 4 | 0.7777777778 | 3 |
| 11 | sonar | reptok | det_class | 5 | 0 | 1 |
| 12 | symbolic | reptok | det_class | 3 | 0.5 | 3 |
| 12 | symbolic | reptok | det_class | 4 | 0.4444444444 | 3 |
| 12 | symbolic | reptok | det_class | 5 | 0.6666666667 | 1 |
| 13 | symbolic | reptok | det_bbox_iou | 3 | 0.6111111111 | 3 |
| 13 | symbolic | reptok | det_bbox_iou | 4 | 0.5 | 3 |
| 13 | symbolic | reptok | det_bbox_iou | 5 | 0.1666666667 | 1 |
| 28 | dinov2 | sonar | bleu | 3 | 0.3333333333 | 3 |
| 28 | dinov2 | sonar | bleu | 4 | 0.6111111111 | 3 |
| 28 | dinov2 | sonar | bleu | 5 | 0.6666666667 | 1 |
| 29 | reptok | sonar | bleu | 3 | 0.3888888889 | 3 |
| 29 | reptok | sonar | bleu | 4 | 0.6111111111 | 3 |
| 29 | reptok | sonar | bleu | 5 | 0.5 | 1 |
| 30 | bge | sonar | bleu | 3 | 0.5 | 3 |
| 30 | bge | sonar | bleu | 4 | 0.6666666667 | 3 |
| 30 | bge | sonar | bleu | 5 | 0 | 1 |
| 32 | dinov2 | symbolic | top1 | 3 | 0.3333333333 | 3 |
| 32 | dinov2 | symbolic | top1 | 4 | 0.6666666667 | 3 |
| 32 | dinov2 | symbolic | top1 | 5 | 0.5 | 1 |
| 33 | reptok | symbolic | top1 | 3 | 0.3888888889 | 3 |
| 33 | reptok | symbolic | top1 | 4 | 0.6388888889 | 3 |
| 33 | reptok | symbolic | top1 | 5 | 0.4166666667 | 1 |
| 34 | bge | symbolic | top1 | 3 | 0.5555555556 | 3 |
| 34 | bge | symbolic | top1 | 4 | 0.6111111111 | 3 |
| 34 | bge | symbolic | top1 | 5 | 0 | 1 |
| 35 | sonar | symbolic | top1 | 3 | 0.5833333333 | 3 |
| 35 | sonar | symbolic | top1 | 4 | 0.3055555555 | 3 |
| 35 | sonar | symbolic | top1 | 5 | 0.8333333333 | 1 |
| 42 | dinov2 | symbolic | bbox_iou | 3 | 0.4444444444 | 3 |
| 42 | dinov2 | symbolic | bbox_iou | 4 | 0.5 | 3 |
| 42 | dinov2 | symbolic | bbox_iou | 5 | 0.6666666667 | 1 |
| 43 | reptok | symbolic | bbox_iou | 3 | 0.5555555556 | 3 |
| 43 | reptok | symbolic | bbox_iou | 4 | 0.2777777778 | 3 |
| 43 | reptok | symbolic | bbox_iou | 5 | 1 | 1 |
| 44 | bge | symbolic | bbox_iou | 3 | 0.4444444444 | 3 |
| 44 | bge | symbolic | bbox_iou | 4 | 0.5555555556 | 3 |
| 44 | bge | symbolic | bbox_iou | 5 | 0.5 | 1 |
| 45 | sonar | symbolic | bbox_iou | 3 | 0.6111111111 | 3 |
| 45 | sonar | symbolic | bbox_iou | 4 | 0.2777777778 | 3 |
| 45 | sonar | symbolic | bbox_iou | 5 | 0.8333333333 | 1 |
Held-Out Equal-Steps Radar, No BigGAN or Symbolic Training Sets
Completeness
Complete
| item | value |
|---|---|
| Runs | 15 |
| Raw eval rows | 27 |
| Expected rows | None |
| Missing rows | 0 |
| Failed rows | 0 |
Radar Values
| spoke | run_size | mean_rank_normalized | n_rows |
|---|---|---|---|
| reptok:lpips | 3 | 0.75 | 2 |
| reptok:lpips | 4 | 0 | 1 |
| reptok:semantic | 3 | 0.5 | 4 |
| reptok:semantic | 4 | 0.5 | 2 |
| reptok:det_class | 3 | 0.5 | 6 |
| reptok:det_class | 4 | 0.5 | 3 |
| sonar:bleu | 3 | 0.4166666667 | 6 |
| sonar:bleu | 4 | 0.6666666667 | 3 |
Directed Eval Values
| eval_id | source | target | metric | run_size | mean_rank_normalized | n_rows |
|---|---|---|---|---|---|---|
| 2 | dinov2 | reptok | lpips | 3 | 0.75 | 2 |
| 2 | dinov2 | reptok | lpips | 4 | 0 | 1 |
| 5 | bge | reptok | semantic | 3 | 0.5 | 2 |
| 5 | bge | reptok | semantic | 4 | 0.5 | 1 |
| 6 | sonar | reptok | semantic | 3 | 0.5 | 2 |
| 6 | sonar | reptok | semantic | 4 | 0.5 | 1 |
| 9 | dinov2 | reptok | det_class | 3 | 0.5 | 2 |
| 9 | dinov2 | reptok | det_class | 4 | 0.5 | 1 |
| 10 | bge | reptok | det_class | 3 | 0.5 | 2 |
| 10 | bge | reptok | det_class | 4 | 0.5 | 1 |
| 11 | sonar | reptok | det_class | 3 | 0.5 | 2 |
| 11 | sonar | reptok | det_class | 4 | 0.5 | 1 |
| 28 | dinov2 | sonar | bleu | 3 | 0.25 | 2 |
| 28 | dinov2 | sonar | bleu | 4 | 1 | 1 |
| 29 | reptok | sonar | bleu | 3 | 0.5 | 2 |
| 29 | reptok | sonar | bleu | 4 | 0.5 | 1 |
| 30 | bge | sonar | bleu | 3 | 0.5 | 2 |
| 30 | bge | sonar | bleu | 4 | 0.5 | 1 |
Eval Type Proportions
| spoke | n_rows | proportion | evals |
|---|---|---|---|
| reptok:lpips | 30 | 0.05882352941 | 1:biggan->reptok:lpips; 2:dinov2->reptok:lpips |
| reptok:semantic | 45 | 0.08823529412 | 5:bge->reptok:semantic; 6:sonar->reptok:semantic; 7:symbolic->reptok:semantic |
| reptok:det_class | 75 | 0.1470588235 | 10:bge->reptok:det_class; 11:sonar->reptok:det_class; 12:symbolic->reptok:det_class; 8:biggan->reptok:det_class; 9:dinov2->reptok:det_class |
| reptok:det_bbox_iou | 15 | 0.02941176471 | 13:symbolic->reptok:det_bbox_iou |
| biggan:lpips | 30 | 0.05882352941 | 14:dinov2->biggan:lpips; 15:reptok->biggan:lpips |
| biggan:semantic | 30 | 0.05882352941 | 18:bge->biggan:semantic; 19:sonar->biggan:semantic |
| biggan:det_class | 75 | 0.1470588235 | 21:dinov2->biggan:det_class; 22:reptok->biggan:det_class; 23:bge->biggan:det_class; 24:sonar->biggan:det_class; 25:symbolic->biggan:det_class |
| biggan:det_bbox_iou | 15 | 0.02941176471 | 26:symbolic->biggan:det_bbox_iou |
| sonar:bleu | 60 | 0.1176470588 | 27:biggan->sonar:bleu; 28:dinov2->sonar:bleu; 29:reptok->sonar:bleu; 30:bge->sonar:bleu |
| symbolic:top1 | 60 | 0.1176470588 | 32:dinov2->symbolic:top1; 33:reptok->symbolic:top1; 34:bge->symbolic:top1; 35:sonar->symbolic:top1 |
| symbolic:bbox_iou | 75 | 0.1470588235 | 41:biggan->symbolic:bbox_iou; 42:dinov2->symbolic:bbox_iou; 43:reptok->symbolic:bbox_iou; 44:bge->symbolic:bbox_iou; 45:sonar->symbolic:bbox_iou |
Nested Bridge Addition
nested_bridge_addition_summary.csv
nested_bridge_addition_pairs.csv
nested_bridge_addition_by_transition.csv
nested_bridge_addition_by_transition_spoke.csv
nested_bridge_addition_transition_radars.png
| added_bridge_modality | without_mean_rank_normalized | with_mean_rank_normalized | delta_added_minus_without | matched_nested_pairs |
|---|---|---|---|---|
| biggan | 0.6237244898 | 0.4367346939 | -0.1869897959 | 140 |
| dinov2 | 0.447845805 | 0.5255102041 | 0.07766439909 | 189 |
| reptok | 0.4314058957 | 0.5439342404 | 0.1125283447 | 126 |
| bge | 0.5122826909 | 0.49281935 | -0.0194633409 | 189 |
| sonar | 0.5085034014 | 0.5017006803 | -0.006802721093 | 168 |
| symbolic | 0.4403061225 | 0.5737244898 | 0.1334183673 | 140 |
Nested Bridge Addition by Transition
| added_bridge_modality | transition | mean_delta_added_minus_without | matched_nested_pairs |
|---|---|---|---|
| biggan | 3->4 | -0.2077380952 | 60 |
| biggan | 4->5 | -0.1666666667 | 60 |
| biggan | 5->6 | -0.1857142857 | 20 |
| dinov2 | 3->4 | 0.1525573192 | 81 |
| dinov2 | 4->5 | 0.0405643739 | 81 |
| dinov2 | 5->6 | -0.03571428572 | 27 |
| reptok | 3->4 | 0.1527777778 | 54 |
| reptok | 4->5 | 0.1044973545 | 54 |
| reptok | 5->6 | 0.01587301588 | 18 |
| bge | 3->4 | 0.01895943562 | 81 |
| bge | 4->5 | -0.03350970018 | 81 |
| bge | 5->6 | -0.0925925926 | 27 |
| sonar | 3->4 | 0.03621031746 | 72 |
| sonar | 4->5 | -0.009920634926 | 72 |
| sonar | 5->6 | -0.1264880952 | 24 |
| symbolic | 3->4 | 0.1482142857 | 60 |
| symbolic | 4->5 | 0.1113095238 | 60 |
| symbolic | 5->6 | 0.1553571428 | 20 |
Nested Bridge Addition by Transition and Radar Spoke
| added_bridge_modality | transition | spoke | mean_delta_added_minus_without | matched_nested_pairs |
|---|---|---|---|---|
| biggan | 3->4 | reptok:lpips | -0.2857142857 | 3 |
| biggan | 3->4 | reptok:semantic | -0.2142857143 | 9 |
| biggan | 3->4 | reptok:det_class | -0.1428571429 | 12 |
| biggan | 3->4 | reptok:det_bbox_iou | -0.5 | 3 |
| biggan | 3->4 | sonar:bleu | 0.126984127 | 9 |
| biggan | 3->4 | symbolic:top1 | -0.2589285714 | 12 |
| biggan | 3->4 | symbolic:bbox_iou | -0.375 | 12 |
| dinov2 | 3->4 | reptok:lpips | 0.1904761905 | 3 |
| dinov2 | 3->4 | reptok:semantic | 0.1190476191 | 9 |
| dinov2 | 3->4 | reptok:det_class | 0.4375 | 12 |
| dinov2 | 3->4 | reptok:det_bbox_iou | 0.0476190476 | 3 |
| dinov2 | 3->4 | biggan:lpips | -0.0238095238 | 3 |
| dinov2 | 3->4 | biggan:semantic | 0.1785714286 | 6 |
| dinov2 | 3->4 | biggan:det_class | 0.1458333334 | 12 |
| dinov2 | 3->4 | biggan:det_bbox_iou | 0.02380952383 | 3 |
| dinov2 | 3->4 | sonar:bleu | 0.1111111111 | 9 |
| dinov2 | 3->4 | symbolic:top1 | 0.126984127 | 9 |
| dinov2 | 3->4 | symbolic:bbox_iou | 0.02976190477 | 12 |
| reptok | 3->4 | biggan:lpips | 3.333333609e-11 | 3 |
| reptok | 3->4 | biggan:semantic | 0.2380952381 | 6 |
| reptok | 3->4 | biggan:det_class | 0.1547619048 | 12 |
| reptok | 3->4 | biggan:det_bbox_iou | 0.1428571429 | 3 |
| reptok | 3->4 | sonar:bleu | 0.3809523809 | 9 |
| reptok | 3->4 | symbolic:top1 | 0.1309523809 | 9 |
| reptok | 3->4 | symbolic:bbox_iou | -0.005952380933 | 12 |
| bge | 3->4 | reptok:lpips | -0.02380952383 | 6 |
| bge | 3->4 | reptok:semantic | 0.2142857143 | 6 |
| bge | 3->4 | reptok:det_class | 0.2023809524 | 12 |
| bge | 3->4 | reptok:det_bbox_iou | -0.07142857143 | 3 |
| bge | 3->4 | biggan:lpips | -0.1071428572 | 6 |
| bge | 3->4 | biggan:semantic | -0.2619047619 | 3 |
| bge | 3->4 | biggan:det_class | -0.3482142857 | 12 |
| bge | 3->4 | biggan:det_bbox_iou | 0.3571428572 | 3 |
| bge | 3->4 | sonar:bleu | 0.1746031746 | 9 |
| bge | 3->4 | symbolic:top1 | 0.2222222222 | 9 |
| bge | 3->4 | symbolic:bbox_iou | -0.07142857143 | 12 |
| sonar | 3->4 | reptok:lpips | 0.4047619048 | 6 |
| sonar | 3->4 | reptok:semantic | 0.04761904763 | 6 |
| sonar | 3->4 | reptok:det_class | 0.08333333332 | 12 |
| sonar | 3->4 | reptok:det_bbox_iou | 0.2619047619 | 3 |
| sonar | 3->4 | biggan:lpips | -0.1666666667 | 6 |
| sonar | 3->4 | biggan:semantic | -0.3571428572 | 3 |
| sonar | 3->4 | biggan:det_class | -0.2291666667 | 12 |
| sonar | 3->4 | biggan:det_bbox_iou | 0.4285714286 | 3 |
| sonar | 3->4 | symbolic:top1 | 0.1349206349 | 9 |
| sonar | 3->4 | symbolic:bbox_iou | 0.03571428572 | 12 |
| symbolic | 3->4 | reptok:lpips | -0.04761904764 | 6 |
| symbolic | 3->4 | reptok:semantic | -0.01190476191 | 6 |
| symbolic | 3->4 | reptok:det_class | 0.2797619048 | 12 |
| symbolic | 3->4 | biggan:lpips | 0.5357142857 | 6 |
| symbolic | 3->4 | biggan:semantic | -0.02380952382 | 6 |
| symbolic | 3->4 | biggan:det_class | 0.2589285714 | 12 |
| symbolic | 3->4 | sonar:bleu | -0.02380952382 | 12 |
| biggan | 4->5 | reptok:lpips | -0.0952380952 | 3 |
| biggan | 4->5 | reptok:semantic | -0.05555555557 | 9 |
| biggan | 4->5 | reptok:det_class | -0.25 | 12 |
| biggan | 4->5 | reptok:det_bbox_iou | -0.4761904762 | 3 |
| biggan | 4->5 | sonar:bleu | -0.06349206348 | 9 |
| biggan | 4->5 | symbolic:top1 | -0.3035714286 | 12 |
| biggan | 4->5 | symbolic:bbox_iou | -0.04761904763 | 12 |
| dinov2 | 4->5 | reptok:lpips | 0.2142857143 | 3 |
| dinov2 | 4->5 | reptok:semantic | 0.1349206349 | 9 |
| dinov2 | 4->5 | reptok:det_class | 0.09523809525 | 12 |
| dinov2 | 4->5 | reptok:det_bbox_iou | -0.119047619 | 3 |
| dinov2 | 4->5 | biggan:lpips | -0.04761904757 | 3 |
| dinov2 | 4->5 | biggan:semantic | 0.25 | 6 |
| dinov2 | 4->5 | biggan:det_class | 0.0386904762 | 12 |
| dinov2 | 4->5 | biggan:det_bbox_iou | -0.1428571429 | 3 |
| dinov2 | 4->5 | sonar:bleu | -0.1904761905 | 9 |
| dinov2 | 4->5 | symbolic:top1 | -0.1071428571 | 9 |
| dinov2 | 4->5 | symbolic:bbox_iou | 0.1607142857 | 12 |
| reptok | 4->5 | biggan:lpips | -0.1190476191 | 3 |
| reptok | 4->5 | biggan:semantic | 0.2380952381 | 6 |
| reptok | 4->5 | biggan:det_class | 0.2202380952 | 12 |
| reptok | 4->5 | biggan:det_bbox_iou | 0.07142857143 | 3 |
| reptok | 4->5 | sonar:bleu | -0.01587301588 | 9 |
| reptok | 4->5 | symbolic:top1 | 0.07142857141 | 9 |
| reptok | 4->5 | symbolic:bbox_iou | 0.1011904762 | 12 |
| bge | 4->5 | reptok:lpips | -0.08333333333 | 6 |
| bge | 4->5 | reptok:semantic | 0.25 | 6 |
| bge | 4->5 | reptok:det_class | -0.1101190476 | 12 |
| bge | 4->5 | reptok:det_bbox_iou | -0.1428571428 | 3 |
| bge | 4->5 | biggan:lpips | -0.1666666667 | 6 |
| bge | 4->5 | biggan:semantic | -0.0238095238 | 3 |
| bge | 4->5 | biggan:det_class | -0.2440476191 | 12 |
| bge | 4->5 | biggan:det_bbox_iou | -0.09523809527 | 3 |
| bge | 4->5 | sonar:bleu | -0.03174603176 | 9 |
| bge | 4->5 | symbolic:top1 | 0.09920634921 | 9 |
| bge | 4->5 | symbolic:bbox_iou | 0.1428571428 | 12 |
| sonar | 4->5 | reptok:lpips | 0.5119047619 | 6 |
| sonar | 4->5 | reptok:semantic | 0.2619047619 | 6 |
| sonar | 4->5 | reptok:det_class | -0.08928571428 | 12 |
| sonar | 4->5 | reptok:det_bbox_iou | 0.07142857147 | 3 |
| sonar | 4->5 | biggan:lpips | -0.3095238095 | 6 |
| sonar | 4->5 | biggan:semantic | -0.04761904763 | 3 |
| sonar | 4->5 | biggan:det_class | -0.193452381 | 12 |
| sonar | 4->5 | biggan:det_bbox_iou | 0.0714285714 | 3 |
| sonar | 4->5 | symbolic:top1 | -0.1785714286 | 9 |
| sonar | 4->5 | symbolic:bbox_iou | 0.1011904762 | 12 |
| symbolic | 4->5 | reptok:lpips | 0.1190476191 | 6 |
| symbolic | 4->5 | reptok:semantic | -0.02380952383 | 6 |
| symbolic | 4->5 | reptok:det_class | 0.09226190478 | 12 |
| symbolic | 4->5 | biggan:lpips | 0.4166666667 | 6 |
| symbolic | 4->5 | biggan:semantic | 0.3214285714 | 6 |
| symbolic | 4->5 | biggan:det_class | 0.3392857143 | 12 |
| symbolic | 4->5 | sonar:bleu | -0.2916666667 | 12 |
| biggan | 5->6 | reptok:lpips | -0.0714285715 | 1 |
| biggan | 5->6 | reptok:semantic | -0.1904761905 | 3 |
| biggan | 5->6 | reptok:det_class | 0.0625 | 4 |
| biggan | 5->6 | reptok:det_bbox_iou | -0.5714285715 | 1 |
| biggan | 5->6 | sonar:bleu | 0.1666666667 | 3 |
| biggan | 5->6 | symbolic:top1 | -0.3125 | 4 |
| biggan | 5->6 | symbolic:bbox_iou | -0.4999999999 | 4 |
| dinov2 | 5->6 | reptok:lpips | 0.0714285714 | 1 |
| dinov2 | 5->6 | reptok:semantic | -0.04761904763 | 3 |
| dinov2 | 5->6 | reptok:det_class | 0.1160714285 | 4 |
| dinov2 | 5->6 | reptok:det_bbox_iou | -0.3571428572 | 1 |
| dinov2 | 5->6 | biggan:lpips | -0.2142857143 | 1 |
| dinov2 | 5->6 | biggan:semantic | 0.2142857143 | 2 |
| dinov2 | 5->6 | biggan:det_class | -6.938893904e-18 | 4 |
| dinov2 | 5->6 | biggan:det_bbox_iou | -0.3571428571 | 1 |
| dinov2 | 5->6 | sonar:bleu | 0 | 3 |
| dinov2 | 5->6 | symbolic:top1 | -0.1190476191 | 3 |
| dinov2 | 5->6 | symbolic:bbox_iou | -0.125 | 4 |
| reptok | 5->6 | biggan:lpips | -0.0714285714 | 1 |
| reptok | 5->6 | biggan:semantic | 0.1071428571 | 2 |
| reptok | 5->6 | biggan:det_class | 0.2142857142 | 4 |
| reptok | 5->6 | biggan:det_bbox_iou | -0.1428571428 | 1 |
| reptok | 5->6 | sonar:bleu | 0.07142857146 | 3 |
| reptok | 5->6 | symbolic:top1 | 0.0238095238 | 3 |
| reptok | 5->6 | symbolic:bbox_iou | -0.2142857143 | 4 |
| bge | 5->6 | reptok:lpips | -0.2142857143 | 2 |
| bge | 5->6 | reptok:semantic | -5.000000414e-11 | 2 |
| bge | 5->6 | reptok:det_class | 0.01785714288 | 4 |
| bge | 5->6 | reptok:det_bbox_iou | -0.1428571429 | 1 |
| bge | 5->6 | biggan:lpips | -0.2142857143 | 2 |
| bge | 5->6 | biggan:semantic | 0.2142857143 | 1 |
| bge | 5->6 | biggan:det_class | -0.3392857143 | 4 |
| bge | 5->6 | biggan:det_bbox_iou | -0.4285714286 | 1 |
| bge | 5->6 | sonar:bleu | 0.1666666667 | 3 |
| bge | 5->6 | symbolic:top1 | -0.2380952381 | 3 |
| bge | 5->6 | symbolic:bbox_iou | 0.0535714286 | 4 |
| sonar | 5->6 | reptok:lpips | 0.4285714285 | 2 |
| sonar | 5->6 | reptok:semantic | -0.03571428575 | 2 |
| sonar | 5->6 | reptok:det_class | -0.04464285715 | 4 |
| sonar | 5->6 | reptok:det_bbox_iou | -0.2142857143 | 1 |
| sonar | 5->6 | biggan:lpips | -0.3928571429 | 2 |
| sonar | 5->6 | biggan:semantic | 0.1428571428 | 1 |
| sonar | 5->6 | biggan:det_class | -0.3928571429 | 4 |
| sonar | 5->6 | biggan:det_bbox_iou | -0.5 | 1 |
| sonar | 5->6 | symbolic:top1 | 0.0238095238 | 3 |
| sonar | 5->6 | symbolic:bbox_iou | -0.1964285714 | 4 |
| symbolic | 5->6 | reptok:lpips | 0.0357142857 | 2 |
| symbolic | 5->6 | reptok:semantic | -0.07142857145 | 2 |
| symbolic | 5->6 | reptok:det_class | 0.4017857143 | 4 |
| symbolic | 5->6 | biggan:lpips | 0.3214285714 | 2 |
| symbolic | 5->6 | biggan:semantic | 0.6071428571 | 2 |
| symbolic | 5->6 | biggan:det_class | 0.1785714285 | 4 |
| symbolic | 5->6 | sonar:bleu | -0.25 | 4 |