Chapter 4 Gate-Factorial Grounding Results

This page replaces the previous grounding recap with a direct comparison of the four mechanisms used in the pin/no-pin and keep-gate checks. Bars show matched grounded - direct deltas, averaged across available seeds; error bars are sample SD across seeds and black points are individual seeds.

Source root: gw_setup/outputs/ch4_gate_factorial_activated_20260828

Coverage: all plotted cells have seeds 0, 1 and 2.

Figures

BGE -> RepTok on COCO-1000
BGE -> RepTok on COCO-1000
BGE -> RepTok on balanced ImageNet-1000
BGE -> RepTok on balanced ImageNet-1000
Symbolic -> RepTok external bbox evaluation
Symbolic -> RepTok external bbox evaluation
RepTok -> SONAR BLEU
RepTok -> SONAR BLEU
DINO -> symbolic classification
DINO -> symbolic classification
All metric deltas
All metric deltas

Downloads

per_seed_results.csv and aggregate_seed_results.csv contain the plotted values. Existing per-task bootstrap confidence intervals are carried through in the per-seed CSV when present; the bar error bars are seed variability.

Aggregate Table

DirectionDatasetMetricMechanismnDirectGrounded mean +/- SDDelta mean +/- SDDirectionality
BGE -> RepTokCOCO-1000CLIP similarityDynamic + sigmoid keep30.286470.291675 +/- 0.000239+0.00520567 +/- 0.000239higher is better
BGE -> RepTokCOCO-1000CLIP similarityDynamic + softmax keep30.286470.290629 +/- 0.000851+0.00415929 +/- 0.000851higher is better
BGE -> RepTokCOCO-1000CLIP similarityPinned + sigmoid keep30.286470.290556 +/- 0.000201+0.0040868 +/- 0.000201higher is better
BGE -> RepTokCOCO-1000CLIP similarityPinned + softmax keep30.286470.289881 +/- 9.28e-05+0.00341102 +/- 9.28e-05higher is better
BGE -> RepTokCOCO-1000FIDDynamic + sigmoid keep375.614669.2706 +/- 0.324-6.34405 +/- 0.324lower is better
BGE -> RepTokCOCO-1000FIDDynamic + softmax keep375.614669.6307 +/- 0.802-5.98393 +/- 0.802lower is better
BGE -> RepTokCOCO-1000FIDPinned + sigmoid keep375.614670.3902 +/- 0.464-5.22444 +/- 0.464lower is better
BGE -> RepTokCOCO-1000FIDPinned + softmax keep375.614670.3137 +/- 0.855-5.30097 +/- 0.855lower is better
BGE -> RepTokCOCO-1000LPIPSDynamic + sigmoid keep30.6971830.69602 +/- 0.000304-0.00116261 +/- 0.000304lower is better
BGE -> RepTokCOCO-1000LPIPSDynamic + softmax keep30.6971830.695985 +/- 0.000241-0.00119813 +/- 0.000241lower is better
BGE -> RepTokCOCO-1000LPIPSPinned + sigmoid keep30.6971830.696239 +/- 0.000229-0.000943979 +/- 0.000229lower is better
BGE -> RepTokCOCO-1000LPIPSPinned + softmax keep30.6971830.695971 +/- 0.000247-0.00121226 +/- 0.000247lower is better
BGE -> RepTokImageNet-1000CLIP similarityDynamic + sigmoid keep30.3242030.326046 +/- 0.00014+0.00184281 +/- 0.00014higher is better
BGE -> RepTokImageNet-1000CLIP similarityDynamic + softmax keep30.3242030.325806 +/- 0.000292+0.00160271 +/- 0.000292higher is better
BGE -> RepTokImageNet-1000CLIP similarityPinned + sigmoid keep30.3242030.326087 +/- 0.000423+0.00188404 +/- 0.000423higher is better
BGE -> RepTokImageNet-1000CLIP similarityPinned + softmax keep30.3242030.325258 +/- 0.00035+0.00105523 +/- 0.00035higher is better
BGE -> RepTokImageNet-1000FIDDynamic + sigmoid keep351.6450.6868 +/- 0.125-0.953152 +/- 0.125lower is better
BGE -> RepTokImageNet-1000FIDDynamic + softmax keep351.6450.7774 +/- 0.16-0.862517 +/- 0.16lower is better
BGE -> RepTokImageNet-1000FIDPinned + sigmoid keep351.6450.7923 +/- 0.177-0.847673 +/- 0.177lower is better
BGE -> RepTokImageNet-1000FIDPinned + softmax keep351.6450.9739 +/- 0.204-0.666083 +/- 0.204lower is better
BGE -> RepTokImageNet-1000LPIPSDynamic + sigmoid keep30.6475360.646692 +/- 0.000103-0.000843028 +/- 0.000103lower is better
BGE -> RepTokImageNet-1000LPIPSDynamic + softmax keep30.6475360.647548 +/- 0.000159+1.2219e-05 +/- 0.000159lower is better
BGE -> RepTokImageNet-1000LPIPSPinned + sigmoid keep30.6475360.647344 +/- 0.000104-0.00019151 +/- 0.000104lower is better
BGE -> RepTokImageNet-1000LPIPSPinned + softmax keep30.6475360.647318 +/- 0.000157-0.000217537 +/- 0.000157lower is better
DINO -> symbolicImageNet-50kTop-1 accuracyDynamic + sigmoid keep30.8360.836027 +/- 6.43e-05+2.66433e-05 +/- 6.43e-05higher is better
DINO -> symbolicImageNet-50kTop-1 accuracyDynamic + softmax keep30.8360.799627 +/- 0.0413-0.0363734 +/- 0.0413higher is better
DINO -> symbolicImageNet-50kTop-1 accuracyPinned + sigmoid keep30.8360.836053 +/- 9.24e-05+5.33263e-05 +/- 9.24e-05higher is better
DINO -> symbolicImageNet-50kTop-1 accuracyPinned + softmax keep30.8360.81902 +/- 0.017-0.01698 +/- 0.017higher is better
RepTok -> SONARImageNet-50kCorpus BLEU-4Dynamic + sigmoid keep311.811712.3648 +/- 0.423+0.553028 +/- 0.423higher is better
RepTok -> SONARImageNet-50kCorpus BLEU-4Dynamic + softmax keep311.811711.5165 +/- 1.31-0.295276 +/- 1.31higher is better
RepTok -> SONARImageNet-50kCorpus BLEU-4Pinned + sigmoid keep311.811711.2626 +/- 0.0643-0.549174 +/- 0.0643higher is better
RepTok -> SONARImageNet-50kCorpus BLEU-4Pinned + softmax keep311.811710.0338 +/- 0.623-1.77798 +/- 0.623higher is better
Symbolic -> RepTokImageNet 1000 x 10ResNet target-class accuracyDynamic + sigmoid keep30.95250.957567 +/- 0.00177+0.00506669 +/- 0.00177higher is better
Symbolic -> RepTokImageNet 1000 x 10ResNet target-class accuracyDynamic + softmax keep30.94990.9546 +/- 0.00329+0.00469995 +/- 0.00329higher is better
Symbolic -> RepTokImageNet 1000 x 10ResNet target-class accuracyPinned + sigmoid keep30.94590.953833 +/- 0.0016+0.0079333 +/- 0.0016higher is better
Symbolic -> RepTokImageNet 1000 x 10ResNet target-class accuracyPinned + softmax keep30.95170.9554 +/- 0.00151+0.00370002 +/- 0.00151higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO IoUDynamic + sigmoid keep30.4600040.458865 +/- 0.00115-0.00113982 +/- 0.00115higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO IoUDynamic + softmax keep30.4597040.448074 +/- 0.00171-0.0116296 +/- 0.00171higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO IoUPinned + sigmoid keep30.4628270.454263 +/- 0.00166-0.00856329 +/- 0.00166higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO IoUPinned + softmax keep30.4606170.456822 +/- 0.00312-0.0037945 +/- 0.00312higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO detection rateDynamic + sigmoid keep30.98470.9822 +/- 0.000889-0.00249996 +/- 0.000889higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO detection rateDynamic + softmax keep30.9860.978367 +/- 0.000379-0.00763335 +/- 0.000379higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO detection ratePinned + sigmoid keep30.98170.9781 +/- 0.000819-0.0036 +/- 0.000819higher is better
Symbolic -> RepTokImageNet 1000 x 10YOLO detection ratePinned + softmax keep30.98160.9801 +/- 0.00122-0.00150005 +/- 0.00122higher is better