Bad sign

AI2 did a near 1:1 comparison between pure transformer and hybrid archs: allenai.org/papers/olmo-... Pretraining: hybrid gated deltanet clearly wins RL: mixed at best They also point out theoretical limitations of transformers' fixed circuit depths 1/2

no offense but if your sole metric for belief evaluation is "which of these make me feel the best" you're just epistemically completely turbofucked. maybe there's a nicer way to phrase that but that's the gist. like I'd love to believe I'm impervious to disease, and bullets. but

At long last we have built Her, from the classic Sci-Fi movie Don't Build Her. www.minimax.io/news/a-deep-...

I'm a simple man; I see Mickens, I repost.

WELL WELL WELL NOT SO EASY TO FIND A PLAN TO TERMINATE A CONFLICT THAT DOESN’T SUCK SHIT HUH?

Proud of Anthropic for holding the line, hope folks at other labs will look closely at what they're agreeing to wrt the DoD. A shame because we need a strong, rational DoD, not one looking to fight imaginary culture war enemies. www.anthropic.com/news/stateme...

I may not have gotten that Vercept job, but I did end up at the same place starting on the same day. Funny how life works! www.anthropic.com/news/acquire...

Tomorrow will be my first day at Anthropic, where I'm joining the Safeguards team to work on prompt injection! I've written an info dump on it here: alexcbecker.net/blog/prompt-...