Robin Jia
@robinjia.bsky.social
📤 2442
📥 265
📝 9
Assistant Professor in Computer Science at USC | NLP, ML
Hubble is finally out! We used 200k GPU hours from NAIRR and NVIDIA to build a comprehensive resource for the scientific study of LLM memorization. Fully open-source models & data up to 8B params + 500B tokens with controlled data insertion to study memorization risks 🔭✨
add a skeleton here at some point
3 months ago
0
6
1
reposted by
Robin Jia
Ameya Godbole
3 months ago
Announcing 🔭Hubble, a suite of open-source LLMs to advance the study of memorization! Pretrained 1B/8B param models, with controlled insertion of texts designed to emulate key memorization risks: copyright (e.g., book passages), privacy (e.g., synthetic biographies), and test set contamination
1
6
6
reposted by
Robin Jia
Yanai Elazar
5 months ago
I had a lot of fun contemplating about memorization questions at the
@l2m2workshop.bsky.social
panel yesterday together with Niloofar Mireshghallah and Reza Shokri, moderated by
@pietrolesci.bsky.social
who did a fantastic job!
#ACL2025
1
12
3
Automatic metrics for assessing factuality are easy to run and commonly used, but do they work? In < 1 hour, come find the answer at poster 349 in Hall X4, where I’ll be presenting
@ameyagodbole.bsky.social
‘s work uncovering inconsistencies, errors, and biases of factuality metrics!
5 months ago
1
2
0
I’ll be at ACL 2025 next week where my group has papers on evaluating evaluation metrics, watermarking training data, and mechanistic interpretability. I’ll also be co-organizing the first Workshop on LLM Memorization
@l2m2workshop.bsky.social
on Friday. Hope to see lots of folks there!
6 months ago
0
2
0
reposted by
Robin Jia
Jesse Thomason
8 months ago
Come by
@naaclmeeting.bsky.social
Poster 6 in Hall 3 from 4-530pm today to see
@billzhu.bsky.social
's and Ishika Singh's work with me and
@robinjia.bsky.social
on PSALM: autonomously inducing symbolic pre- and post-conditions of actions with LLMs, symbolic planning, and text environment interaction!
1
6
1
Check out
@billzhu.bsky.social
‘s excellent work on combining LLMs with symbolic planners at NAACL on Thursday! I will also be at NAACL Friday-Sunday, looking forward to chatting about LLM memorization, interpretability, evaluation, and more
add a skeleton here at some point
8 months ago
0
3
0
reposted by
Robin Jia
Wang Bill Zhu
8 months ago
At
@naaclmeeting.bsky.social
this week! I’ll be presenting our work on LLM domain induction with
@thomason.bsky.social
on Thu (5/1) at 4pm in Hall 3, Section I. Would love to connect and chat about LLM planning, reasoning, AI4Science, multimodal stuff, or anything else. Feel free to DM!
0
4
4
reposted by
Robin Jia
Deqing Fu
11 months ago
Excited to share that my intern work at Meta GenAI is accepted to
@iclr-conf.bsky.social
#ICLR2025
Introducing TLDR: Token-Level Detective Reward Model For Large Vision Language Models. TLDR provides fine-grained annotations to each text token. 🔗arXiv:
arxiv.org/abs/2410.04734
1
5
2
Our workshop on LLM Memorization is coming to ACL 2025! The call for papers is out, please submit both archival and non-archival (work in progress or already published) papers
add a skeleton here at some point
12 months ago
0
8
3
I'll be at
#NeurIPS2024
! My group has papers analyzing how LLMs use Fourier Features for arithmetic and how TFs learn higher-order optimization for ICL (led by
@deqing.bsky.social
), plus workshop papers on backdoor detection and LLMs + PDDL (led by
@billzhu.bsky.social
)
about 1 year ago
1
23
4
reposted by
Robin Jia
Maria Antoniak
about 1 year ago
A starter pack for
#NLP
#NLProc
researchers! 🎉
go.bsky.app/SngwGeS
add a skeleton here at some point
45
253
113
reposted by
Robin Jia
Matthew Finlayson
about 1 year ago
USC NLP folks are on Bluesky! Follow my amazing colleagues here
go.bsky.app/KUwSZ6W
add a skeleton here at some point
3
17
7
reposted by
Robin Jia
Sameer Singh
about 1 year ago
Started a SoCal AI/ML/NLP researchers starter pack! It's a bit sparse right now, and perhaps more NLP heavy, but hey, nominate yourself and others!
go.bsky.app/6QckPj9
add a skeleton here at some point
17
43
9
you reached the end!!
feeds!
log in