Apropos of never ending discussions about whether ANNs are "good" models of the nervous system, here is a slide I present to masters students showing a network that is found in motor control circuits *across phyla* (that's pretty ubiquitous!) I ask them to guess what it does...

Free speech on twitter:

Excellent explanation of RoPE embedding, from scratch with all the math needed: https://fleetwood.dev/posts/you-could-have-designed-SOTA-positional-encoding And with beautiful 3blue1brown's style of animation: https://github.com/3b1b/manim. Original RoPE paper: arxiv.org/abs/2104.09864