Want to know what training data has been memorized by models like GPT-4? We propose information-guided probes, a method to uncover memorization evidence in *completely black-box* models, without requiring access to 🙅‍♀️ Model weights 🙅‍♀️ Training data 🙅‍♀️ Token probabilities 🧵 (1/5)

🤔🤖Most AI systems assume there’s just one right answer—but many tasks have reasonable disagreement. How can we better model human variation? 🌍✨ We propose modeling at the individual-level using open-ended, textual value profiles! 🗣️📝 arxiv.org/abs/2503.15484

I’ll be in Vancouver this weekend for the NeurIPS workshops (go pluralistic alignment!) DMs are open if anyone wants to chat! :)

🌟 Come to our Pluralistic Alignment Workshop at #NeurIPS2024! 🗓️ December 14 📍 West Meeting Room 116, 117 Join us to explore pluralistic perspectives in alignment with an incredible lineup of talks and speakers! 🔗 Full schedule & details: pluralistic-alignment.github.io

If you are headed to NeurIPS, please join for our Pluralistic Alignment workshop! We have a great set of speakers from a range of backgrounds. & all the papers that will be presented at the workshop are posted: pluralistic-alignment.github.io lmk if you'd like to catch up at the conference too! :)