Speak at Ray Summit!

DeepSeek released smallpond, a big data processing framework built on top of Ray. - Smallpond targets high performance data processing. - It provides a high-level dataframe API - Targets petabyte-level scaling The challenges around training data prep only grow when you include multimodal data.

Amazon published this only 4 months ago, but it feels like an eternity. It's one of the most impressive large-scale data processing migration efforts. Rare to see companies truly achieving order of magnitude cost improvements (while simultaneously increasing scale). aws.amazon.com/blogs/openso...

Talked with John Schulman last year about the ChatGPT backstory and scaling laws 😍 John co-founded OpenAI and created ChatGPT. www.youtube.com/watch?v=6Ctv...

A good overview of the fundamentals of how to extend context windows for LLMs (if you care about RAG, you probably care about context lengths).