if you try to get Claude to speak Armenian it just outputs "delays"! Seems like glitch tokens are still unresolved. Interesting (kind of sad?) to see Opus thrown into a loop.

From oral arguments yesterday!

Btw, did a bit of a rebranding of the substack. Will endeavor to post more there. h/t @dbateyko.bsky.social on the Trials & Errors name. Super fitting name for a group whose focus is both in reinforcement learning and in law/governance research. www.trialserrors.ai

This is a challenging legal problem for NeurIPS (and other conference participants)! You might be wondering how this is possible given the First Amendment? I wrote a quick explainer on the current status quo of relevant First Amendment cases & law to get you up to speed. 🔗👇

I feel this urgency too. But this is all so utterly avoidable with good policymaking. No one should be left behind because they didn't accumulate capital in 2026. There are so many people who aren't plugged into these conversations or are simply not in a position to do anything about it.

I’m really excited about our new paper! I think we will ultimately need to draw on expertise from both law and AI to get alignment right, and this paper lays out that vision in more detail. arxiv.org/abs/2601.04175

The current direction of AI labs is “we’re building something that’s going to replace you and we have no plan to make sure you’re going to land in a better place, but we’ll make billions.” The logical reaction is, “shut it down.” Labs need to get serious on addressing labor impacts.

Many legal scholars talk about lock-in effects for LLMs from the conversation history/memories (akin to social media). But if an LLM can access the info & is capable, you can just ask the LLM to give it to you, making it far easier to switch providers than social media. Good example of that here.

Only a couple of days after my last post, vibe hacking in full force.

Only a couple of days after my last post, vibe hacking in full force. www.bloomberg.com/news/article...

Following by a panel on GenAI, Agentic AI, Law, and CS (1:15-2:00pm ET) with @peterhenderson.bsky.social (Princeton) and Georgios Piliouras (Google DeepMind) Spotlight Talks (2:30pm-4:00pm) by @aloni-bologna.bsky.social (UChicago), Rebecca Wexler (Columbia), and @jubaz.bsky.social (Georgia Tech)

Missing from the headline: "using Claude Code." Vibe hacking is already a thing. I've been saying this for a while, but no model-level safeguards will prevent it entirely. What they can do is slow it down enough for us to put societal-level safeguards in place. www.popsci.com/technology/r...

That was fast.

New copyright law "hypothetical" just dropped.

Warner Music and Udio settle their copyright case, agree to collaborate on "new song creation service that will allow users to remix tunes by established artists." Expect more such settlements as copyright holders look to leverage AI to boost revenue!

We’ve been pushing hard on AI for public good. One example: partnering with Courtlistener to launch accessible legal semantic search! Many more cool AI projects coming soon from my group aimed at improving access to justice, often spearheaded by @dominsta.bsky.social !

Sora2 is speedrunning my AI law class. We covered issues with copyrighted characters in week 2, and right of publicity claims in week 3. Georgia has a postmortem right of publicity claim. Some states don't (e.g., famous Marilyn Monroe estate battle).

How Gemini Compute Use Agent feels about the "Choose Chrome" popup. gemini.browserbase.com

Why might AI companies take on larger copyright litigation risks? If they estimate AGI-scale impacts are 2-3 yrs out, litigation will lag that long. By then, the bet might be: govts step in (too big to fail), rightsholders reliant on AI, fair use prevails, or have $$$ to settle.

Quick take: Are open-weight AI models getting a fair shake in evals? A few thoughts on comparing systems-to-models, sparked by Anthropic’s recent postmortem. Check it our most recent post: www.ailawpolicy.com/p/quick-take...

GPT-5-codex just ``git reset --hard'' ongoing changes in a repo, saying "I panicked!" h/t Zeyu Shen @ Princeton

☢️ Can an AI model be "born secret" when it comes to nuclear and radiological risks? What powers does the Atomic Energy Act give the federal government over frontier models? It might be more than you think! And may preempt parts of state regs. Check out our post: www.ailawpolicy.com/p/ai-born-se...

Some quick thoughts on the recent copyright litigation developments: "Anthropic Settles Its Copyright Litigation—and Why That Was the Right Move" 🔗 www.ailawpolicy.com/p/anthropic-...

Annnnnndddd Judge Alsup just rejected the settlement. Still some time to fix it. Rejection was mostly on the grounds that the class was under-specified (no final list of works, no opt-out/notification mechanism solidified). news.bloomberglaw.com/ip-law/anthr...

💡New on the CITP Blog: "Statutory Construction & Interpretation for AI" > What if an LLM concludes a user's behavior is “egregiously immoral" -- & contacts authorities? CITP researchers with Prof @peterhenderson.bsky.social's POLARIS Lab provide a possible explanation.🔗👇

The terms of Anthropic's settlement w/book authors just came out. 💰$1.5B to authors in libgen (Books3 corpus)! Interestingly, this is ~$3k per book, close to the terms that HarperCollins allegedly gave to authors for their books ($2.5k). Consensus price forming?

Wonder why Claude decided to report users to the authorities? It might be because its constitution says Claude should choose responses in the long-term interest of humanity! But what if we could leverage computational and legal tools to "debug" or "lint" AI rules/laws for ambiguity? 🧵!

Excited to offer my AI Law class again @ Princeton this year. We'll be sharing lecture notes/materials and more this year on the course webpage! Imo, we have a unique offering that emphasizes how the technical details affect legal outcomes. Check it out! www.polarislab.org/ai-law-2025/...

I'm starting to get emails about PhDs for next year. I'm always looking for great people to join! For next year, I'm looking for people with a strong reinforcement learning, game theory, or strategic decision-making background...

A California teen sought advice from OpenAI's GPT-4o on how to end his life. The chatbot gave him explicit instructions and encouragement. His parents are suing the company and its CEO, Sam Altman, alleging “it was the predictable result of deliberate design choices."

Anthropic settled with authors in its ongoing litigation! Given the increasing likelihood of a messy trial, this was probably the best move. AI companies may have to be more strategic about which cases help set precedent in this area. Curious to see the terms.. news.bloomberglaw.com/class-action...

New paper suggests that if firms aren’t seeing growth from AI, it could be because current deployments replace existing labor, instead of scaling output. AI policy and governance agenda for 2025+ needs to put labor at the forefront. digitaleconomy.stanford.edu/publications...

Glad to see Google still working on efficiency-and transparency-of the energy impacts of their models!

AI-generated errors in an Australian murder case. We'll probably see an influx of ineffective assistance of counsel petitions/appeals soon arguing AI-usage. apnews.com/article/aust...

DOGE still exists, and continues to use Google's Gemini and other AI tools for identifying government regulations to slash. "The tool will further categorize [those] submitting comments, such as whether they [are a] 'sophisticated' corporate commenter." 👀 www.wired.com/story/sweetr...

New work from Hartline, Hu & Wu: is there a truthful calibration metric in sequential settings (i.e., better than ECE)? Seems like the answer is yes! Super important research direction as we think about multi-step uncertainty estimation from agents in high stakes settings.

Another judge potentially citing hallucinated case law? mississippitoday.org/2025/07/28/a...

Tesla partly liable in Florida Autopilot trial, jury awards $200M punitive damages

Check out our new blogpost and policy brief on our recently updated lab website! ❓Are we actually capturing the bubble of risk for cybersecurity evals? Not really! Adversaries can modify agents by a small amount and get massive gains.

We're up 216 tracked cases of bogus citations in court worldwide, including this case! www.polarislab.org/ai-law-track...

First time a judge has decided a case based on hallucinated case law in the US that I've encountered. caselaw.findlaw.com/court/ga-cou...

Many brilliant AI researchers have told me that bureaucracy is slowing them down. An underrated research question is: How do we design teams & incentives that improve research speed and impact—along with team happiness? Any thoughts out there on optimal strategies?

Excited for this work to be out! 🔍Benchmarks, in my opinion, should break down performance to figure out what aggregate metrics might miss. Here, we showed the weaknesses of current frontier models for competition coding and where there's room to grow at a granular level! livecodebenchpro.com

Thanks to the new utm_source field that ChatGPT attaches to links, we see a lot of filings in court that clearly show evidence of ChatGPT usage despite not yet being called out or do not contain hallucinated citations.

Faiz Surani, one of our project team leads, built an improved interactive map for AB1466-covered Racially Restrictive Covenants in Santa Clara County—with extra granular detail on a subset of deeds from 1923–1939, including the actual discriminatory language. Check it out! 🔗👇 sccmap.reglabapp.com

I wrote up my thoughts on the Library of Congress debacle. I even got to refer to one of the earliest cases in my career--defending the giant pandas at the National Zoo. Although it originally posted before the awesome! CADC IAF decision, I added a few mentions. www.lawfaremedia.org/article/bure...

🚨Reddit sues Anthropic!🚨 This is going to be a really interesting case. Some quick thoughts... 🧵👇 1️⃣ Notice: no copyright claim. Reddit doesn't really own the copyright to user-uploaded content, so nothing to do here. Reddit also doesn't make any federal claims to keep it in state court.

Hallucinated-Citation Watch (May 27 – Jun 2 2025) 📊🧵 7️⃣ Seven separate decisions flagged fake authorities for the week, bringing the total in our tracker to 172 cases. ⚖️ 4 U.S. federal district courts, 1 U.S. state-level tax court, 1 Canadian superior court, 1 Australian tribunal

Seems like despite the change in name and mission statement, lots of the core work that AISI was focusing on (cyber and CBRN) will continue on. TBD how things change though…

FWIW we’re now at 167 cases of nonexistent law/cases being cited across the world. It’s a mix of pro se litigants, attorneys, and even adjudicators. AI is here to stay. Even if attorneys stop using it, pro se litigants won’t.