A watched website never breaks. Literally had my marketing site crash twice yesterday for two different people. Loading it up to debug today? NUFING sat there for 15 min like a dummie waiting for it to break.

I just got cup-jacked at Starbucks. The barista accidentally put some one else's drink into my cup and handed it out. Instead of realizing: hey... this isn't a normal Starbucks cup... and it doesn't have a lid... they person just took it. 🤪

Why do editors, devrel, and the like feel the need to make so many asinine edits to my blogs? Like you changed "With search being" -> "Given search is" Is it more clear? Idk It just rubs me wrong when I've gone through these changes 3 times with each subsequent editor changing the voice.

I am 2 months into building my saltwater aquarium tracker tanki.dev and sent a newsletter out asking for feedback. And my users showed up! #1 bit of feedback? "Make auth sessions longer" - people who track aquariums typically do so only once per week and auth logged out after 7 days.

Me logging into outlook this morning 🥴 this is not the land of milk and honey anymore.

GitHub is going for the other four nines of availability. 9.9999% available.

WELL. That was not the result I was expecting

Not me about to take GitHub down for the second time today.

I am doing my best to resist building an operator for Elasticsearch. I dont think I can for much longer though. We need a stable way to automatically change cluster settings. Rolling upgrades? Reduce merge pressure and increase shard move speed. Low QPS times? Lets bump up merge concurrency.

The second edition of Designing Data-Intensive Applications, by myself and @chris.blue, is finished and sent off to the printers! Ebooks should be available in the next week, and print books in 3–4 weeks. Sigh of relief. 😅 (BTW, this is a good opportunity to support your favourite local bookshop!)

Dang. My Compute blade project is literally pandoras box. I initially got a bunch of the Uptime Compute blades to run an OpenSearch cluster. After months of waiting I get the blades in, go to start up OpenSearch and BOOM. Craps out because the Amazon Linux containers can't run on ARMv7. 🧵

New favorite move. Introduce drama for no reason. Example: I got my wife ice cream. Before handing it to her I assured her no blood was spilled getting her ice cream. The concern that followed was priceless.

Me ships a really cool update that makes issues and prs pages faster. GitHub:

I just realized my understanding of the Elasticsearch/OpenSearch refresh + translog operations was INCORRECT. I'd always had the mental model that refresh or translog flush would write segments. That's partially true...

Now with copilot instead of writing just a few hundred lines of bad code a week I can scale to TENS OF THOUSANDS of lines of bad code a week.

The amount of logistical things needed to build a startup is so frustrating. I don’t want to build a company I want to ship code that helps people. Today I: - created a bank account - migrated emails - mailed so compliance documents

Okay, so not only did I do a thing with Tanki I am actually starting a serious company: relevan.dev We're building the future of relevancy based search. We're pre-launch (despite me launching this technically here). But we want to talk to small e-commerce businesses about their search problems.

Got bored… made an app this weekend to help me track my aquarium tanki.dev In case anyone else with a #reeftank wants a free place to track parameters over time 👀

Not going to lie so much engineering work is getting replaced by AI. It’s shocking but l’m starting to see a world where engineers write less code and do a lot more product + architecture work. You very much still need someone with expertise at the wheel.

three things people mean when they say they’re working on a startup: - side project that you’re “working on” and “has potential” - you’ve spent all your time building the perfect c-corp, landing page, and name… - and then there’s actually building a startup

I just had ChatGPT respond to my question with an OpenSearch diagram that I was the author of.. Is this what it means to be full circle?

Finally, wrapping up a big PR. Everything's working time to refactor a few bits and bobs anddddd... broken... why broken 😞

Nothing like provisioning a whole ~100 node cluster just to realized the attached disks aren't large enough 😮‍💨 This is what I get for not checking my SKU's more closely 😭

I visited X-Mans site and immediately had to leave. 😭 Someone was trying to work out why lower income people would spend more money on lower quality food than he has 😐 It’s not like the want to but they don’t have the time to: - plan meals - shop for healthy food - cook - clean afterwards

Has anyone in my feed done tuning with vLLM caches? I’ve just used the same prompt with two very different intents and there was a lot of carry over between the two. Just wondering if there are some knobs for tuning here

My six year old to my wife: Mommy… I can’t sleep and I don’t think square breathing is going to help….. 🤣 I mean I can’t say that I haven’t taught her well

Jokes on Corey, I fetch a tarball of my passwords using a public endpoint I have running outta my house.

Hello world! I'm putting together a series of talks and team trainings on Nix and NixOS. (Two is a series, right?) There's a lot to narrow down. So I would love to know: if you're Nix-curious, what questions do you have, or frustrations have you experienced?

I'm hoping to reach the million miler club this year... that is with Lines of Code removed from GitHub. So many places where we've got just orphaned code.

Things you may not realize. It can take a literal month or more to ship a blog in a company like AWS or GitHub. It's easily weeks of editorial reviews. If you're announcing something or talking about best practices it can easily go into the several months range.

Going to make a “we’re migrating to azure” variant. Too soon?

Don't give in this Halloween, fix the root cause. It will take longer but you'll thank you later. Lol I am sending this to all those who're pressuring me to "just ship the fix" rather than fixing the root of the issue.

My wife is so cute. She asked me to “ChatGPT” something for her 😆

I am currently building a DAG to track the order I need things to release in, for my changes to get to prod. MySQL key changes to build containers -> Build container to new Elasticsearch version -> Update client libraries Ship BBQ to KNN indexes Roll out query understanding

I am about to interview for my job. Lets see if I am qualified to get hired 🤞

man every day its the same thing... User: Hey can we bump up the keyword field length for this file path field since 256 chars is not enough for most file paths? Me: Have you considered a text field with the path_analyzer 😰

Reminder that food stamps don’t refresh in November 1st. Donate to your local food bank

Today I am a blog editing engineer. 😐 Socializing work is almost as important as building it. If no one uses it then does it exist?

In order to start moving towards being an executive I've decided I am no longer wearing headphones in meetings. Everything is done using my laptop speakers and mic. No exceptions.

初めておにぎりを作った。

I heard recently that LV is using Meilisearch... I hope they can get their money back because this is not it 😆

Oh looks like Oracle made an UwU'ps (read like oops but with uwu). Turns out it's not just me but everyone because Oracle let the key expire. news.ycombinator.com/item?id=4567...

My boss: why are you updating MySQL in CI? Me: All I am trying to do is ship quantization to Elasticsearch in prod 😭 To ship quantization I needed to: 1. Update, CI 2. To update CI I had to update our base images 3. The base image wont build because of MySQL GPG keys are out of date

Nothing like putting: ¯\_(ツ)_/¯ in the risk assessment of my PR. See you all on GitHub's next public incident 🫡

I am just about to make what is likely my most valuable contribution to GitHub's search. It's still only going to be V1 but it's a super common pattern in search. Who wants to take a guess at what it is?

GitHub's reached the point where scaling out is not an option anymore probably about 3 years ago but no one noticed because it felt like they could. We're in a place were we need to start reshaping the underlying search indexes in order to have performant queries.

It has been 0 days since paginating through search data was a problem. When you are simply scrolling data MySQL is almost always going to give you better performance. Search engines just dont scroll text data well because of the orientation of the data.

Okay so on the vector math thing I am working on a sheet with Copilot to calculate the memory size needed... It produced this banger: SWITCH(B6,"Float16",2,"Int8",1,"Binary (1-bit)",0) Sure, technically a binary is 0 bytes but we need to determine how much memory is consumed with a gazillion bits

Who ever thought that my college math would help in life. I'm now working on a probabilistic formula to find the most number of items I can include in a query to ensure that some percent of queries only effects some percent of the cluster. 😭

Always fun visiting friends at the AWS booth 🤗 #AWS #OpenSource #ATO