Ian Holmes 8 months ago
This is the preprint write up of my sabbatical work with Dave Kelley’s group at Calico. We tried out several transformer replacements for multi-task learning in functional genomics (i.e. what Borzoi does). Mamba, in particular, seems to outperform a mini version of Borzoi, especially when “striped”.
add a skeleton here at some point