Got bored… made an app this weekend to help me track my aquarium tanki.dev In case anyone else with a #reeftank wants a free place to track parameters over time 👀

Not going to lie so much engineering work is getting replaced by AI. It’s shocking but l’m starting to see a world where engineers write less code and do a lot more product + architecture work. You very much still need someone with expertise at the wheel.

three things people mean when they say they’re working on a startup: - side project that you’re “working on” and “has potential” - you’ve spent all your time building the perfect c-corp, landing page, and name… - and then there’s actually building a startup

I just had ChatGPT respond to my question with an OpenSearch diagram that I was the author of.. Is this what it means to be full circle?

Finally, wrapping up a big PR. Everything's working time to refactor a few bits and bobs anddddd... broken... why broken 😞

Nothing like provisioning a whole ~100 node cluster just to realized the attached disks aren't large enough 😮‍💨 This is what I get for not checking my SKU's more closely 😭

I visited X-Mans site and immediately had to leave. 😭 Someone was trying to work out why lower income people would spend more money on lower quality food than he has 😐 It’s not like the want to but they don’t have the time to: - plan meals - shop for healthy food - cook - clean afterwards

Has anyone in my feed done tuning with vLLM caches? I’ve just used the same prompt with two very different intents and there was a lot of carry over between the two. Just wondering if there are some knobs for tuning here

My six year old to my wife: Mommy… I can’t sleep and I don’t think square breathing is going to help….. 🤣 I mean I can’t say that I haven’t taught her well

Jokes on Corey, I fetch a tarball of my passwords using a public endpoint I have running outta my house.

Hello world! I'm putting together a series of talks and team trainings on Nix and NixOS. (Two is a series, right?) There's a lot to narrow down. So I would love to know: if you're Nix-curious, what questions do you have, or frustrations have you experienced?

I'm hoping to reach the million miler club this year... that is with Lines of Code removed from GitHub. So many places where we've got just orphaned code.

Things you may not realize. It can take a literal month or more to ship a blog in a company like AWS or GitHub. It's easily weeks of editorial reviews. If you're announcing something or talking about best practices it can easily go into the several months range.

Going to make a “we’re migrating to azure” variant. Too soon?

Don't give in this Halloween, fix the root cause. It will take longer but you'll thank you later. Lol I am sending this to all those who're pressuring me to "just ship the fix" rather than fixing the root of the issue.

My wife is so cute. She asked me to “ChatGPT” something for her 😆

I am currently building a DAG to track the order I need things to release in, for my changes to get to prod. MySQL key changes to build containers -> Build container to new Elasticsearch version -> Update client libraries Ship BBQ to KNN indexes Roll out query understanding

I am about to interview for my job. Lets see if I am qualified to get hired 🤞

man every day its the same thing... User: Hey can we bump up the keyword field length for this file path field since 256 chars is not enough for most file paths? Me: Have you considered a text field with the path_analyzer 😰

Reminder that food stamps don’t refresh in November 1st. Donate to your local food bank

Today I am a blog editing engineer. 😐 Socializing work is almost as important as building it. If no one uses it then does it exist?

In order to start moving towards being an executive I've decided I am no longer wearing headphones in meetings. Everything is done using my laptop speakers and mic. No exceptions.

初めておにぎりを作った。

I heard recently that LV is using Meilisearch... I hope they can get their money back because this is not it 😆

Oh looks like Oracle made an UwU'ps (read like oops but with uwu). Turns out it's not just me but everyone because Oracle let the key expire. news.ycombinator.com/item?id=4567...

My boss: why are you updating MySQL in CI? Me: All I am trying to do is ship quantization to Elasticsearch in prod 😭 To ship quantization I needed to: 1. Update, CI 2. To update CI I had to update our base images 3. The base image wont build because of MySQL GPG keys are out of date

Nothing like putting: ¯\_(ツ)_/¯ in the risk assessment of my PR. See you all on GitHub's next public incident 🫡

I am just about to make what is likely my most valuable contribution to GitHub's search. It's still only going to be V1 but it's a super common pattern in search. Who wants to take a guess at what it is?

GitHub's reached the point where scaling out is not an option anymore probably about 3 years ago but no one noticed because it felt like they could. We're in a place were we need to start reshaping the underlying search indexes in order to have performant queries.

It has been 0 days since paginating through search data was a problem. When you are simply scrolling data MySQL is almost always going to give you better performance. Search engines just dont scroll text data well because of the orientation of the data.

Okay so on the vector math thing I am working on a sheet with Copilot to calculate the memory size needed... It produced this banger: SWITCH(B6,"Float16",2,"Int8",1,"Binary (1-bit)",0) Sure, technically a binary is 0 bytes but we need to determine how much memory is consumed with a gazillion bits

Who ever thought that my college math would help in life. I'm now working on a probabilistic formula to find the most number of items I can include in a query to ensure that some percent of queries only effects some percent of the cluster. 😭

Always fun visiting friends at the AWS booth 🤗 #AWS #OpenSource #ATO

I guess you could say I Dynatrace’d my way over to the RiOT demos. Always fun seeing what unique ways vendors engage conference viewers. #dynatrace4developers

Who’s going to All Things Open this year? Any evening events to check out? 👀

Woke up today and I am once again mad about the Bitnami rug pull. They were the only one I trusted publishing an OpenSearch image that could be deployed on a Raspberry Pi (CM4). And now they want me to pay for it. Rug-pulls are not a business strategy.

Few things are certain in the universe. Taxes, death, and people will misspell "Elasticsearch" I've seen: - ElasticSearch - Elastic search - Elastic-search - Elastisearch - Elastic's search - OpenSearch 🥵

Who all is using Apache Unomi? I have a feeling that it's probably like a handful of big players but I wonder if there's more than I know. unomi.apache.org/manual/2_7_x...

Elastic: please send us trace logs from these loggers... Me: you realize that is going to be literally billions of logs if we turn those on right? Are you sure that is what you want? Elastic: yes Me: okay here you go... Elastic: so we cant process all these logs can you send less 😐

"Where is the documentation telling us not to do this" - never thought I'd see that one IRL. If you cant find any documentation how to do something that typically means you can't do it. If you wonder why it's not documented you reach out and ask about it and then you'd find its unsupported.

So funny story I used IBM about 10 years ago. I created an account and after I was done with the experiment, I closed it. I have been receiving emails for the last 10 years about infrastructure changes happening at IBM. I cannot login anymore because my account doesn’t exist.

If you are in Germany and a search expert come work with me! We're looking for someone with strong experience in Elasticsearch particularly as it relates to both search engineering and infrastructure for large scale search. www.github.careers/careers-home...

I need to write a benchmarking databases guide. Too often I see people loading like 10k docs making 500 requests can then publishing results as facts. Don’t get me wrong I started out that way too. Good database benchmarks need to have a few things: 🧵

Ruh rogh, ChatGPT is leaking 💧

I totally forgot you can set backgrounds in iTerm until recently. I cant wait till the next time I have to share my terminal session with execs 😆

Hot take 🌶️ ChatGPT isn’t a LLM… it’s a controller. Controllers provide the: - Conversation context - Tool calling (search, plugins) - Ability to iterate I’ve seen a lot of people conflate the two and while I understand it’s important to know what value each provides.

I just realized ollama can have several models loaded into memory at once. Anyone hooked OpenSearch up to Ollama for document embeddings yet?

I am nervous for the next generation of ChatGPT engineers. I've just had several different models tell me to do things that would've for sure risked the integrity of our Elasticsearch infra. Nuking active scrolls during a reindex is a bad idea and Claude should feel bad for suggesting it.

Message of the day, run your own race. Some people start companies when they’re 22. Some people when they are 60. Meanwhile others work for companies their whole life. Don’t rush it just run the race you feel happiest running rather than chasing after someone else.

Im having a really hard time prioritizing which conferences to go to... On the potential docket: - Nvidia GTC DC - All Things Open - Literally any Elastic{ON}