Self-supervised Learning with Masked Autoencoders (MAE) is known to produce worse image representations than Joint-Embedding approaches (e.g. DINO). In our new paper, we identify new reasons for why that is and point towards solutions: arxiv.org/abs/2412.03215 🧵

I have created a starter pack for the Polish ML community. Let's grow it together! Let me know if you know somebody who should be included. go.bsky.app/TSkgFjK