GW6 5-Modality Scaling

ImageNet-only view of the three directions we care about: DINOv2 to SONAR BLEU, BGE to RepTok image metrics, and DINOv2 to symbolic classification accuracy. BigGAN rows are excluded.

Missing in current eval files: clip, fid.

BGE -> RepTok qualitative samples

Ten shared ImageNet validation examples, one per sampled class; columns are decoded images from the three scaling checkpoints.

class 895A dark grey, angular warplane, likely a Panavia Tornado, is displayed on a central pedestal in the foreground, its metallic surface reflecting the bright daylight. The aircraft is...

32M

51M

100M

class 323A monarch butterfly, with its distinctive orange wings marked by black veins and bordered with white spots, is positioned in the foreground, occupying the left and central portion...

32M

51M

100M

class 328The main subject consists of several dark, spherical sea urchins with long, black spines, clustered together and occupying the majority of the frame, particularly in the foregroun...

32M

51M

100M

class 78A brownish, oval-shaped tick with a slightly shiny, segmented body is attached to skin in the center of the frame, with its legs visible near the base. The background consists of...

32M

51M

100M

class 693A person wearing a red and yellow life vest and a hooded jacket is seated in a canoe, viewed from behind, occupying the lower-left portion of the frame. In the background, a stone...

32M

51M

100M

class 455A blue, circular bottlecap with a white and red bullseye target design lies in the center of the frame, partially embedded in gritty, dark gray sand and dirt. The cap is surrounde...

32M

51M

100M

class 886A tall, silver-colored vending machine with a glass front dominates the foreground, its interior illuminated to display rows of snacks and drinks. Inside, shelves hold various pac...

32M

51M

100M

class 470Three white, cylindrical candles with scalloped tops are lit and arranged in a row within a rectangular, light-colored ceramic tray, positioned in the center of the frame. The sce...

32M

51M

100M

class 254A black pug with a wrinkled face and short, smooth coat is in the foreground, positioned slightly left of center and facing towards the left side of the frame. The dog is standing...

32M

51M

100M

class 459A woman with long, wavy brown hair is shown from the shoulders up, wearing a nude-colored, smooth-textured underwire bra with thin straps; she is positioned slightly off-center in...

32M

51M

100M