the joys of open source... also, poor everyone org on github 😅

wish that #reddit quotations in LLMs would stay low, so we could just have conversations and not fight all the spam and bots not sure how accurate the data is but interesting in any case: promptwatch.com/data/top-cha...

how to avoid deadlocks if you run 300 #elasticsearch clusters like palantir. and you pick the trickiest combination of configuration + client calls: * concurrent synchronous refresh * wait_for with long refresh intervals

if virtual hackathons are your thing, we might have something there (with decent 💸): ai-accelerate.devpost.com and with the new agent builder features (built-in LLM, queries as tools, native MCP,...) there are some useful new toys available for it too

new MCP registry from @github.com: github.blog/ai-and-ml/gi... looking at the current npm security disaster, we definitely need more trusted sources for dependencies 😬

failure catalog of AI apps — not sure I've seen it spelt out that way before not sure what to think of the product behind it but the list and ways to approach the problem look pretty useful: github.com/onestardao/W...

build an intelligent query layer with MCP in #elasticsearch — from search to agent here's a preview how ES|QL queries turn into tools that get aggregated into agents — all served and built right in kibana. and you can try this out today

TIL how to * subscribe to our release notes or * the @elastic integrations (which are independent of stack releases) since two people asked a very similar question today. it's actually 3 simple steps 1/3

(re)ranking — going from hundreds retrieved results down to the few actually shown / used great to see that elastic reranking is also doing well in external benchmarks ;) google post: cloud.google.com/blog/product... details on elastic reranking: www.elastic.co/docs/explore...

the enshittification of meetup.com continues (until everyone migrated to lu.ma) * besides organizers paying for groups, upselling attendees with a "flash sale". we got some confused attendees how we are making them pay for meetups 😵 * huge email ads even for events on the pro plan. how pro-fessional

awesome to see mcp-use on product hunt today! for everyone needing to build with or around MCP: www.producthunt.com/products/mcp... and yes, we'll do a small hack night with them next week to put that to the test as well 😉 lu.ma/fqdql7kh

I recently joined Time4AI for a 20min chat, discussing how @elastic.co's #elasticsearch and #kibana are transforming information retrieval for search, logs, observability, and security 1/2

#elasticsearch REST API in .md — in case you need to point your LLM to the latest version and features it's been long overdue :) www.elastic.co/docs/referen... vs www.elastic.co/docs/referen...

#elasticsearch 9.1 / 8.19 release: continuing the optimizations, also for time-series — LogsDB and TSDS (time-series datastream) storage is commonly the most painful part, especially with longer retentions. but we're getting to 2x to 4x improvements over default indices 1/6

#elasticsearch 9.1 / 8.19 release 🥳: how to improve ranking, latency & cost for dense vector search at the same time — by defaulting to better binary quantization (BBQ). even if improving all 3 is counter intuitive quick overview of what's new, focus on semantic_text but dense_vector is similar 1/8

thread + article on #elasticsearch alerting options: * kibana alerts if you need something simple * watcher for way more options watcher example for: "alert when users from the US, Germany, and India dropped below 1000 in the last hour compared to yesterday" 1/2

some cool tricks here to reduce your vector search cost by 85% while improving relevance: * quantization (and this was before our binary quantization BBQ which is also mentioned) * optimized settings for vector search * selectively using vector search — skipping very old or rarely used documents

today is one of my favorite days: release day! #elasticsearch and the entire @elastic.co stack 9.1 + 8.19 are out. lots of great stuff there — I'll pick one feature a day to dive into 🔬 but first, versions + updates: 2 majors in parallel? what about 7.x? how to upgrade? what's even maintained today?

AI agent pitfalls: * compounding errors over multiple steps * quadratic token cost over many steps (though I didn't fully get why you'd always need to keep all previous context — sometimes sure but always?) * the tool will not "just figure out" what to always do over many steps

still running into some of the most basic hallucinations / fabrications. I thought we were past this by now?

"Open Data Standards: Postgres, OTel, and Iceberg" some great points: * how "commercially unencumbered and vendor neutral" is the foundation of becoming an open standard * standards over tools (the wire protocol of postgres is kind of that standard) * s3 as the ultimate data infrastructure

more elasticsearch MCP experiments: * waterfall trace performance analysis (attached video) * root cause analysis * performance analysis by instrumented service moving observability from kibana to claude or any other MCP

when you have @sessionize.com, every community topic looks like a CfP #community #DevRel that's why we have 3 different calls running on it for @elastic.co right now — conference, meetups, and champions

the walls around the data gardens are going up: 1 slack request per minute with a maximum of 15 objects coming back 🐌 api.slack.com/changelog/20...

"Why We Chose @elastic.co Cloud — Lessons from Our Migration" easy migration, improved latency, good tooling like autoscaling and AutoOps (we should talk more about that). what's there not to like? 😀 engineering.loadsmart.com/blog/elastic...

following right after the docker hub, the #elasticsearch MCP server is also featured by AWS today in their container based agents & tools for AgentCore in a rewritten form, which is now leaning more heavily on docker and rust — but that's all under the hood and you won't even notice it :)

thoughts on "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity": 1. lots of strong reactions / opinions in either direction 2. I feel like we're drawing too many general conclusions here. besides the small group size, they had little AI experience >

we've been busy with OpenTelemetry stuff lately :) opentelemetry.devstats.cncf.io/d/5/companie...

MCP servers on @docker.com Hub — "the largest library of secure, containerized MCP servers": hub.docker.com/mcp

what's the @elastic.co color ratio? looks like our design team had too much fun with brand.elastic.co but there are some interesting pieces in there (for those interested in design)

fun topic for "how to improve my keyword search" with a little known feature called keyword_marker in #elasticsearch 1/6

things I wasn't expecting: IBM released filebeat, metricbeat, and auditbeat for AIX public.dhe.ibm.com/aix/freeSoft...

full recording of the spring AI + MCP discussion by @starbuxman.joshlong.com and @jamesward.com is now up: www.youtube.com/watch?v=mJHK...

is it the return of the logs? they make a lot of sense for both humans and LLMs and my story about the new epoch is somewhere in this "grep to grok to GenAI" take (a good part will apply everywhere but some pieces are @elastic specific) lots of reasons for looking at logs again

letting claude run a shop — and how it ultimately failed: www.anthropic.com/research/pro... interesting to see how the lack of guardrails, compounding errors, and then falling off the rails works here. though it sounds like a great opportunity with humans in the loop

"cursor for X" in the middle of a gold rush :D www.ycombinator.com/companies?ba...

pentest or hack? stay careful out there with your open source contributions, especially "minor doc" fixes that look funky 😬

continuing the MCP topic: making it work in java with #SpringAI, brought to you by @starbuxman.joshlong.com and @jamesward.com live stream: elastic.zoom.us/j/6372098304

what would a kubernetes 2.0 look like? matduggan.com/what-would-a... has an interesting list:

MCP and #mastra with a dash of #elasticsearch. quick and dirty twitter thread from our SF meetup 🧵

when some bad okta automation revokes your github, zoom, and slack apps wonder if it was a new agentic workflow 😉 extended lunch break over — I'm back again!

"Observability Inside Your IDE" looks like an area that keeps expanding. lightrun seems to be doing well there and now @jetbrains.com is also joining with blog.jetbrains.com/dotnet/2025/... for rider / .NET

instrumentation score: "a standardized, vendor-neutral metric for assessing #OpenTelemetry instrumentation quality. calculated by analyzing OTLP data streams against OTel semantic conventions and community best practices" with a score from 10 to 100

salesforce blocking AI companies from using slack data: www.reuters.com/business/sal... 1. nice competitive advantage for their own thing 2. if google, microsoft,… start doing the same it will lead to a horrible fragmentation. either you go all in on one ecosystem or get cautious with SaaS? 😬

one of our best kept secrets: @elastic.co as an anti-virus software 100% protection rate both for the real-world protection test (10 false positives) and the recent malware samples — doing great against all the well known products. also not the first time we do so well here

statements that should land you in benchmark jail #benchmarketing 1. only the 3rd point is actually against elasticsearch, the other 2 are against itself 2. absolutely no details on version, hardware, configuration, if / what client was used,... PS: though great to see who is the benchmark ;)

small SF protest on the move from where I can see it, 1 waymo damaged / disabled but no 🔥

watching this entire memvid topic blow over: so much influencing, so little technical work behind it. but it‘s been a great filter who to take seriously PS: we should do all the experiments but not the breathless announcements

unpopular opinion: the @elastic.co license v2 (ELv2) strikes a good balance between freedom and sustainable development — recent examples include mastra AI and @getdbt.com * source available * free to use (in production at any scale) 1/2

tl;dr from 2h workshop at #aiDotEngineer in 4 pics: 1. retrieval is more than vector search. find the right (combination of) tools for the job — handy little chart 2. repeat after me: BM25 is still a great baseline 3. vector search is a feature and here to stay 4. "don't do that" happens in search 😬