Skip to content

P0.2

P0.2

From the positive-control sub-study — Initial investigation into the "collapse" instruments only; the forgetting mode (MAE / probe-on-past) needs its own positive control, later. In one session, predictorless / stop-gradient-off SimSiam (the anti_collapse=false toggle) is run side by side with intact SimSiam, both from-scratch on class-blocked STL-10. The PC drives its loss to the −1 constant-solution floor while RankMe craters to ~32% of its random-init value, but values for the control aren't clearly better. Loss seems more of a collapse discriminator than RankMe at this complexity - the latter doesn't cleanly read collapse. Conclusion: we can't tell whether the healthy arm's RankMe decay is (a) SimSiam's general single-pass dynamics — in which case it's a real property that won't vanish with scale and the baseline is fundamentally compromised — or (b) an artifact of the toy setup (tiny model, 30 steps, single pass, no schedule) — in which case it disappears as we scale and the baseline is fine. This motivates P0.2.1.