As neural metrics are a pillar for #MT, being extensively used for evaluation but also improving translation, we'd want them to be fair. 🚨 Our #ACL2025 paper shows they consistently, unduly favor masculine-inflected translations, or gendered forms, over neutral ones. arxiv.org/pdf/2410.10995

New paper from Manos Zaranis, @tozefarinhas.bsky.social and other sardines!!🚀 Meet MF²: Movie Facts & Fibs: a new benchmark for long-movie understanding This benchmark focuses on narrative understanding (key events, emotional arcs, causal chains) in long movies. Paper: arxiv.org/abs/2506.06275

Applications for the 2025 Lisbon Machine Learning Summer School (LxMLS) are open, with @andre-t-martins.bsky.social as one of the organizers. LxMLS is a great opportunity to learn from top speakers and to interact with other students. You can apply for a scholarship. Apply here: lxmls.it.pt/2025/

📣 New paper alert! We released a new safety benchmark for VLMs with a core focus on test cases that become unsafe by combining text and images. TL;DR: many modern VLMs are unsafe across various types of queries and languages. arxiv.org/abs/2501.10057 huggingface.co/datasets/fel...

🎉 New paper by Saul Santos in collaboration with @tozefarinhas.bsky.social and @andre-t-martins.bsky.social!! 🎉 ∞-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidation Paper: arxiv.org/abs/2501.19098