Compositionality is a central desideratum for intelligent systems...but it's a fuzzy concept and difficult to quantify. In this blog post, lab member @ericelmoznino.bsky.social outlines ideas toward formalizing it & surveys recent work. A must-read for interested researchers in AI and Neuro

🧵 Everyone is chasing new diffusion models—but what about the representations they model from? We introduce Discrete Latent Codes (DLCs): - Discrete representation for diffusion models - Uncond. gen. SOTA FID (1.59 on ImageNet) - Compositional generation - Integrates with LLM 🧱

The code and model weights for Llip are finally out! I hope you will find this model useful! Paper: arxiv.org/abs/2405.00740 Code: github.com/facebookrese... Models: - ViT-G: huggingface.co/lavoies/llip... - ViT-B: huggingface.co/lavoies/llip...