Join us in advancing data science and AI research! The Johns Hopkins Data Science and AI Institute Postdoctoral Fellowship Program is now accepting applications for the 2026–2027 academic year. Apply now! Deadline: Jan 23, 2026. Details and apply: apply.interfolio.com/179059

It's application season, and I'm sharing some of my past application materials: - Academic job market (written in Dec 2024) - PhD fellowship (written in Apr 2023) - PhD admission (written in Dec 2019) on my website (j-min.io)

Welcome to JHU! 💙

Some personal updates: - I've completed my PhD at @unccs.bsky.social! 🎓 - Starting Fall 2026, I'll be joining the CS dept. at Johns Hopkins University @jhucompsci.bsky.social as an Assistant Professor 💙 - Currently exploring options for my gap year (Aug 2025 - Jul 2026), so feel free to reach out! 🔎

🚨 Introducing our @tmlrorg.bsky.social paper “Unlearning Sensitive Information in Multimodal LLMs: Benchmark and Attack-Defense Evaluation” We present UnLOK-VQA, a benchmark to evaluate unlearning in vision-and-language models, where both images and text may encode sensitive or private information.

🔥 BIG CONGRATS to Elias (and UT Austin)! Really proud of you -- it has been a complete pleasure to work with Elias and see him grow into a strong PI on *all* axes 🤗 Make sure to apply for your PhD with him -- he is an amazing advisor and person! 💙

Extremely excited to announce that I will be joining @utaustin.bsky.social Computer Science in August 2025 as an Assistant Professor! 🎉

I will be presenting ✨Reverse Thinking Makes LLMs Stronger Reasoners✨at #NAACL2025! In this work, we show - Improvements across 12 datasets - Outperforms SFT with 10x more data - Strong generalization to OOD datasets 📅4/30 2:00-3:30 Hall 3 Let's chat about LLM reasoning and its future directions!

✈️ Heading to #NAACL2025 to present 3 main conf. papers, covering training LLMs to balance accepting and rejecting persuasion, multi-agent refinement for more faithful generation, and adaptively addressing varying knowledge conflict. Reach out if you want to chat!

Check out 🚨CAPTURe🚨 -- a new benchmark testing spatial reasoning by making VLMs count objects under occlusion. SOTA VLMs (GPT-4o, Qwen2-VL, Intern-VL2) have high error rates on CAPTURe (but humans have low error ✅) and models struggle to reason about occluded objects. arxiv.org/abs/2504.15485 🧵👇

In Singapore for #ICLR2025 this week to present papers + keynotes 👇, and looking forward to seeing everyone -- happy to chat about research, or faculty+postdoc+phd positions, or simply hanging out (feel free to ping)! 🙂 Also meet our awesome students/postdocs/collaborators presenting their work.

What if we could transform advanced math problems into abstract programs that can generate endless, verifiable problem variants? Presenting EFAGen, which automatically transforms static advanced math problems into their corresponding executable functional abstractions (EFAs). 🧵👇

🚨Announcing TaCQ 🚨 a new mixed-precision quantization method that identifies critical weights to preserve. We integrate key ideas from circuit discovery, model editing, and input attribution to improve low-bit quant., w/ 96% 16-bit acc. at 3.1 avg bits (~6x compression) 📃 arxiv.org/abs/2504.07389

Huge congrats Archiki! 🎉 Very well-deserved 💪

Introducing VEGGIE 🥦—a unified, end-to-end, and versatile instructional video generative model. VEGGIE supports 8 skills, from object addition/removal/changing, and stylization to concept grounding/reasoning. It exceeds SoTA and shows 0-shot multimodal instructional & in-context video editing.

🚨 Introducing UPCORE, to balance deleting info from LLMs with keeping their other capabilities intact. UPCORE selects a coreset of forget data, leading to a better trade-off across 2 datasets and 3 unlearning methods. 🧵👇

SO excited to see this one released! Several works, including our TMLR’24 paper, are doubtful about measuring faithfulness purely behaviorally. @mtutek.bsky.social has formulated how to measure faithfulness by actually connecting verbalized CoT reasoning to weights. See more insights in his thread 👇🏻

New joint @jhuclsp.bsky.social seminar with @jmincho.bsky.social! Learn more here: www.cs.jhu.edu/event/cs-cls...

We release code for the M3DocRAG experiments and M3DocVQA dataset creation! Code 👉 github.com/bloomberg/m3... Thread explaining M3DocRAG/M3DocVQA 👉 x.com/jmin__cho/st...

🚨 Excited to announce UTGen and UTDebug, where we first learn to generate unit tests and then apply them to debugging generated code with LLMs, with strong gains (+12% pass@1) on LLM-based debugging across multiple models/datasets via inf.-time scaling and cross-validation+backtracking! 🧵👇

🚨 Excited to share: "Learning to Generate Unit Tests for Automated Debugging" 🚨 which introduces ✨UTGen and UTDebug✨ for teaching LLMs to generate unit tests (UTs) and debugging code from generated tests. UTGen+UTDebug yields large gains in debugging (+12% pass@1) & addresses 3 key questions: 🧵👇

🎉Very excited that our work on Persuasion-Balanced Training has been accepted to #NAACL2025! We introduce a multi-agent tree-based method for teaching models to balance: 1️⃣ Accepting persuasion when it helps 2️⃣ Resisting persuasion when it hurts (e.g. misinformation) arxiv.org/abs/2410.14596 🧵 1/4

Big congratulations to my advisor Mohit! 🎉 Glad to see his significant+sustained contributions have been recognized as a #AAAI Fellow (following the prestigious #PECASE award). Truly well-deserved; congrats! 🙂

Check out our postdoc openings at UNC-CH! In addition to the valuable research opportunities, please also note that Chapel Hill and the research triangle are great places to live, with nice weather, food, and people! I truly have enjoyed living here 😊

🚨 We have postdoc openings at UNC 🙂 Exciting+diverse NLP/CV/ML topics**, freedom to create research agenda, competitive funding, very strong students, mentorship for grant writing, collabs w/ many faculty+universities+companies, superb quality of life/weather. Please apply + help spread the word 🙏

Excited to attend #NeurIPS and give a talk on video-language models for complex video understanding in the First Workshop on Video-Language Models on Saturday at 10:10am PST. Stop by + DM/email if you want to chat about anything related to video-language modeling.

I'm now at #NeurIPS2024! 🔥 (yeah, I'm the one with the red Santa hat🧑‍🎄) On Dec 13 PM, I present SELMA, co led with Jialu Li! 👉 improving the faithfulness of T2I models with automatically generated image-text pairs, with skill-specific expert learning and merging! P.S. I'm on the faculty job market👇

Jaemin is an expert in multimodal AI, and his practical and insightful suggestions have always been incredibly helpful to me. I’m confident that he will continue to achieve great things in his career!

✈️ I've landed in Vancouver for #NeurIPS2024 11/12: LACIE, a pragmatic speaker-listener method for training LLMs to express calibrated confidence: arxiv.org/abs/2405.21028 12/12: GTBench, a benchmark for game-theoretic abilities in LLMs: arxiv.org/abs/2402.12348 P.s. I'm on the faculty market👇

Thanks @mohitbansal.bsky.social for the wonderful Distinguished Lecture on agents and multimodal generation. This got so many of us here at Stony Brook excited for the potential in these areas. Also, thanks for spending time with our students & sharing your wisdom. It was a pleasure hosting you!

I was so lucky to work with Jaemin in my 1st year and learned a lot from him. I can confidently say he's not only a top mind in multimodal AI but also an incredible mentor&collaborator. He is insightful, hands-on, and genuinely knows how to guide and inspire junior students👇👏

I first met Jaemin at the Microsoft Accelerate Foundation Models Research (AFMR) dinner during NeurIPS 2023, though I was already familiar with his papers long before that. He’s definitely a strong candidate to consider!

Look out for @jmincho.bsky.social's application! He’s absolutely one of the top multimodal minds, I’ve been a fan of his work even before joining UNC and have been lucky enough to see him in action as a top-notch researcher and mentor!

Since I stared my PhD in 2021 I've seen Jaemin's papers and always found them really cool and impactful!

🚨 I’m on the academic job market! j-min.io I work on ✨Multimodal AI✨, advancing reasoning in understanding & generation by: 1⃣ Making it scalable 2⃣ Making it faithful 3⃣ Evaluating + refining it Completing my PhD at UNC (w/ @mohitbansal.bsky.social). Happy to connect (will be at #NeurIPS2024)! 👇🧵

Dear schools -- Catch Elias! Definitely one of the best experts of AI agents. Working with him has been always a joy 🤗

Joined @cnn.com live. Key takeaways: 1️⃣ President Yoon's declaration of Martial Law is not surprising—it has been building for some time. 2️⃣ Nonetheless, it marks a critical turning point in South Korea's democratic history. 3️⃣ Democratic stakeholders continue to demonstrate remarkable resilience.

Looking forward to giving this Distinguished Lecture at StonyBrook next week & meeting the several awesome NLP + CV folks there - thanks Niranjan‬ + all for the kind invitation 🙂 PS. Excited to give a new talk on "Planning Agents for Collaborative Reasoning and Multimodal Generation" ➡️➡️ 🧵👇

I was preparing to pitch an op-ed on the nationwide protests calling for President Yoon's resignation, aiming to provide global context amid the limited international coverage. Given the urgency, I’m sharing it now. I didn’t expect events to escalate this quickly. #SouthKorea #Democracy

Hi everyone! I didn’t think my first post would be about something this intense, but here we are. South Korean President Yoon Seok Yeol has declared martial law. This is unfolding rapidly, and I’ll do my best to keep you updated. Thanks for your solidarity—it means a lot.

🚨 Reverse Thinking Makes LLMs Stronger Reasoners We can often reason from a problem to a solution and also in reverse to enhance our overall reasoning. RevThink shows that LLMs can also benefit from reverse thinking 👉 13.53% gains + sample efficiency + strong generalization (on 4 OOD datasets)!