Natively multimodal models unlock new possibilities for AI biomedical 🥼assistants, from answering questions about images to generating them for decision-making. Thrilled to release MedMax—an open state-of-the-art multimodal model designed for diverse biomedical tasks and domains🩻 (audio on 🔈) 🧵⬇️

1/Open LLM evals often face data contamination concerns. Private curators (like ScaleAI) have addressed this with private + expert evaluations. We argue that this shift poses new risks including financial incentives & eval bias. w/ @hbxnov.bsky.social 📝: pratyushmaini.github.io/blog/2024/ri... 🧵