Jonathon Belotti
@jonathonbelotti.bsky.social
đ€ 57
đ„ 129
đ 22
Peeling back the layers @modal_labs. Previously data & ML platform @canva. dms open.
When I was at Canva I had to get a batch job to run demographics analysis vision models on over 90 million images. It took a couple weeks, but felt like with the right infra it could be done in a couple hours. The infra now exists :)
loading . . .
Introducing Modal Batch: Process 1 Million Jobs with 1 Line of Code
Modal Batch is a new interface backed by a new durable queue system built specifically to make job processing easy, scalable, and fault-tolerant.
https://modal.com/blog/batch-processing
7 months ago
0
1
1
reposted by
Jonathon Belotti
Steve Klabnik
7 months ago
Hypervisor as a Library
#rustlang
seiya.me/blog/hypervi...
loading . . .
Hypervisor as a Library
https://seiya.me/blog/hypervisor-as-a-library
1
31
6
We won't tell you where the deep and cheap GPU capacity is, but we will teach you how to fish.
loading . . .
Linear Programming for Fun and Profit
How we use an eighty-year-old algorithm to find arbitrages in the cloud market.
https://modal.com/blog/resource-solver
8 months ago
0
1
0
Is The Soul of a New Machine the best book about the computer industry because Kidder is.. - an outsider - a full-time writer - simply a first rate writer Other industries have had âhomegrownâ Pulitzersâmedicine, law, finance, bilogyâbut not computing.
9 months ago
0
0
0
LLMs have shifted my blog post drafting back to my static-site repository away from Notion. I can play with HTML and JS so easily during iteration with Cursor. Markdown+Blocks is hamstringing.
9 months ago
0
1
0
Is there a SRE book but for startups? Googleâs book is great but it doesnât contend with the tradeoffs and constraints of a young growing startup.
9 months ago
1
4
1
History-posting once again:
thundergolfer.com/blog/the-fir...
loading . . .
The First LLM
A tracing of the history of GPT-1 and its predecessors.
https://thundergolfer.com/blog/the-first-llm
9 months ago
0
1
1
My brilliant
@modal-labs.bsky.social
colleague Charles won't stop until we're all pushing our GPUs to their limits:
modal.com/blog/gpu-uti...
loading . . .
'I paid for the whole GPU, I am going to use the whole GPU': A high-level guide to GPU utilization
A guide to maximizing the utilization of GPUs, from cloud allocations to FLOP/s.
https://modal.com/blog/gpu-utilization-guide
10 months ago
0
0
0
The Tom Brady of Youtube educational content is at it again. One of those rare lectures which deserves to be called enlightening. I hope
@karpathy.bsky.social
is steering clear of helicopters, submersibles, and smoking. We need him.
loading . . .
Deep Dive into LLMs like ChatGPT
YouTube video by Andrej Karpathy
https://www.youtube.com/watch?v=7xTGNNLPyMI&t=2s
10 months ago
0
0
0
At
@modal-labs.bsky.social
your customer questions sometimes get a whole blog post :) Why does an NVIDIA H100 SXM 80GB card offer 85.52 GB?
thundergolfer.com/blog/nvidia-...
11 months ago
0
0
0
Found out you get 220MiB more H100 HBM3e VRAM on Oracle Cloud compared to GCP. GCP's instances have more `reserved` memory and I can't figure out if this is configurable from the guest.
11 months ago
0
0
0
Wrote about how a warmed up container can be saved to disk and later restored for a 2.5x cold start performance boost. Saving live container processes to disk turns out to be pretty whacky and interesting!
modal.com/blog/mem-sna...
loading . . .
Memory Snapshots: Checkpoint/Restore for Sub-second Startup
Serializing container state to disk for aggressive cold start optimization.
https://modal.com/blog/mem-snapshots
11 months ago
2
10
4
This contains the shortest and clearest explanation of S3âs $0.02/gib/month cloud economics that Iâve seen, and lots more good stuff.
tailscale.com/blog/living-...
loading . . .
Living in the future, by the numbers
Instead of making the traditional New Year predictions, letâs talk instead about the beautiful technological future we live in: the one that exists right now but we donât always notice.
https://tailscale.com/blog/living-in-the-future
11 months ago
0
2
1
Quick post about those 'latency numbers every programmer must know'. It became mostly an affirmation of
@sirupsen.bsky.social
's napkin-math repo (bookmark it).
11 months ago
2
14
3
New goal in 2025 is to write one software essay with the zany energy of an All Souls College essay prompt: Does the moral character of an orgy change when the participants wear Nazi uniforms?
thundergolfer.com/all-souls-so...
loading . . .
An âAll Souls Examinationâ of the machine
Inspiration towards a better software essay.
https://thundergolfer.com/all-souls-software-essay
12 months ago
0
0
0
GPUs can be understood:
modal.com/gpu-glossary...
loading . . .
README | GPU Glossary
https://modal.com/gpu-glossary/readme
about 1 year ago
0
2
0
you reached the end!!
feeds!
log in