How deep should the network be when the data is fixed?
Very deep networks help self-supervised RL when the agent can keep collecting experience. Train the same contrastive critic at depths 4 to 64 on offline goal-conditioned datasets and find where the benefit stops.
A possible result: success rate against depth on fixed data, and the depth where it stops rising.
Vizuara Research















