how to avoid deadlocks if you run 300 #elasticsearch clusters like palantir. and you pick the trickiest combination of configuration and client calls * concurrent synchronous refresh * wait_for with long refresh intervals "Defensive Databases: Optimizing […] [Original post on mastodon.social]

if virtual hackathons are your thing, we might have something there (with decent 💸): https://ai-accelerate.devpost.com/ and with the new agent builder features (built-in LLM, queries as tools, native MCP,...) there are some useful new toys available for it too

new MCP registry from #github: https://github.blog/ai-and-ml/github-copilot/meet-the-github-mcp-registry-the-fastest-way-to-discover-mcp-servers/ looking at the current npm security disaster, we definitely need more trusted sources for dependencies 😬

failure catalog of AI apps — not sure I've seen it spelt out that way before not sure what to think of the product behind it but the list and ways to approach the problem look pretty useful: https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md#failure-catalog-with-fixes

build an intelligent query layer with MCP in #elasticsearch — from search to agent here's a preview how ES|QL queries turn into tools that get aggregated into agents — all served and built right in #kibana. and you can try this out today

TIL how to * subscribe to our release notes or * the @Elastic integrations (which are independent of stack releases) since two people asked a very similar question today. it's actually 3 simple steps 1/3

(re)ranking — going from hundreds retrieved results down to the few actually shown / used great to see that elastic reranking is also doing well in external benchmarks ;) google post […] [Original post on mastodon.social]

the enshittification of meetup.com continues (until everyone has migrated to lu.ma) * besides organizers paying for every group, upselling attendees with a "flash sale". we got some very confused attendees how we are trying to make them pay for our meetups 😵 […] [Original post on mastodon.social]

awesome to see mcp-use on product hunt today! for everyone needing to build with or around MCP: https://www.producthunt.com/products/mcp-use and yes, we'll do a small hack night with them next week to put that to the test as well 😉 https://lu.ma/fqdql7kh

I recently joined Time4AI for a 20min chat, discussing how #elasticsearch and #kibana are transforming information retrieval for search, logs, observability, and security. from traditional keyword search to newer vector search (and hybrid search) to improve […] [Original post on mastodon.social]

#elasticsearch REST API in .md — in case you need to point your LLM to the latest version and features it's been long overdue :) https://www.elastic.co/docs/reference/elasticsearch/rest-apis vs https://www.elastic.co/docs/reference/elasticsearch/rest-apis.md

#elasticsearch 9.1 / 8.19 release: continuing the optimizations, also for time-series — LogsDB and TSDS (time-series datastream) storage is commonly the most painful part, especially with longer retentions. but we're getting to 2x to 4x improvements over default indices 1/6

#elasticsearch 9.1 / 8.19 release 🥳: how to improve ranking, latency & cost for dense vector search at the same time — by defaulting to better binary quantization (BBQ). even if improving all 3 is counter intuitive quick overview of what's new with a focus on […] [Original post on mastodon.social]

thread + article on #elasticsearch alerting options: * kibana alerts if you need something simple * watcher for way more options watcher example for: "alert when users from the US, Germany, and India dropped below 1000 in the last hour compared to yesterday" […] [Original post on mastodon.social]

some cool tricks here to reduce your vector search cost by 85% while improving relevance: * quantization (and this was before #elasticsearch binary quantization BBQ which is also mentioned) * optimized settings for vector search * selectively using vector […] [Original post on mastodon.social]

today is one of my favorite days: release day! #elasticsearch and the entire elastic stack 9.1 and 8.19 are out. lots of great stuff in there — I'll pick one feature a day to dive into 🔬 but first, versions and updates: 2 majors in parallel? what about 7.x? […] [Original post on mastodon.social]

AI agent pitfalls: * compounding errors over multiple steps * quadratic token cost over many steps (though I didn't fully get why you'd always need to keep all previous context — sometimes sure but always?) * the tool will not "just figure out" what to always […] [Original post on mastodon.social]

still running into some of the most basic hallucinations / fabrications. I thought we were past this by now?

"Open Data Standards: Postgres, OTel, and Iceberg" some great points in this one: * how "commercially unencumbered and vendor neutral" is the foundation of becoming an open standard * standards over tools (the wire protocol of postgres is kind of that […] [Original post on mastodon.social]

more elasticsearch MCP experiments: * waterfall trace performance analysis (attached video) * root cause analysis * performance analysis by instrumented service moving observability from kibana to claude or any other MCP PS: still not sure where the right […] [Original post on mastodon.social]

when you have sessionize , every community topic looks like a CfP #community #devrel that's why we have 3 different calls running on it for elastic right now — conference, meetups, and champions

the walls around the data gardens are going up: 1 slack request per minute with a maximum of 15 objects coming back 🐌 https://api.slack.com/changelog/2025-05-terms-rate-limit-update-and-faq

"Why We Chose Elastic Cloud — Lessons from Our Migration" easy migration, improved latency, good tooling like autoscaling and AutoOps (we should talk more about that). what's there not to like? 😀 https://engineering.loadsmart.com/blog/elastic-cloud-migration

following right after the #docker hub listing, the #elasticsearch MCP server is also featured by #AWS today in their container based agents & tools for AgentCore in a rewritten form, which is now leaning more heavily on docker and rust — but that's all under […] [Original post on mastodon.social]

thoughts on "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity": 1. lots of strong reactions / opinions in either direction 2. I feel like we're drawing too many general conclusions here. besides the small group size […] [Original post on mastodon.social]

we've been busy with OpenTelemetry stuff lately :) https://opentelemetry.devstats.cncf.io/d/5/companies-table?orgId=1&var-period_name=Last+month&var-metric=contributions

MCP servers on @Docker Hub — "the largest library of secure, containerized MCP servers": https://hub.docker.com/mcp

what's the #elastic color ratio? looks like our design team had too much fun with https://brand.elastic.co but there are some interesting pieces in there (for those interested in design)

fun topic for "how to improve my keyword search" with a little known feature called keyword_marker in #elasticsearch 1/6

things I wasn't expecting: IBM released filebeat, metricbeat, and auditbeat for AIX https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc-7.2/beats/

full recording for building AI agents with spring & MCP is up now: https://www.youtube.com/watch?v=mJHKmYpfGU0 full thread https://mastodon.social/@xeraa/114746919511558619

is it the return of the logs? they make a lot of sense for both humans and LLMs and my story about the new epoch is somewhere in this "grep to grok to GenAI" take (a good part will apply everywhere but some pieces are elastic specific) lots of reasons for looking at logs again

letting claude run a shop — and how it ultimately failed: https://www.anthropic.com/research/project-vend-1 interesting to see how the lack of guardrails, compounding errors, and then falling off the rails works here. though it sounds like a great opportunity with humans in the loop

"cursor for X" in the middle of a gold rush :D https://www.ycombinator.com/companies?batch=Spring+2025&batch=Winter+2025&batch=Fall+2024&query=cursor

pentest or hack? stay careful out there with your open source contributions, especially "minor doc" fixes that look funky 😬

The guys and gals at #elastic are having fun at work. All this little easter eggs and puns (like "ES|QL"). My most recent discovery is the `_cat` API endpoint (CAT = compact and aligned text - "human readable" API endpoints). When you query the endpoint without anything else you get a list of […]

continuing the MCP topic: making it work in java with #springai, brought to you by @starbuxman and @jamesward live stream: https://elastic.zoom.us/j/6372098304

what would a kubernetes 2.0 look like? https://matduggan.com/what-would-a-kubernetes-2-0-look-like/ has an interesting list: things that went right: containers at scale, low maintenance (I like the pets, 01, UUID era comparison), running jobs, service discovery, load balancing things to change […]

MCP and #mastra with a dash of #elasticsearch. quick and dirty twitter thread from our SF meetup 🧵

when some bad okta automation revokes your github, zoom, and slack apps wonder if it was a new agentic workflow 😉 extended lunch break over — I'm back again!

"Observability Inside Your IDE" looks like an area that keeps expanding. lightrun seems to be doing well there and now jetbrains is also joining with https://blog.jetbrains.com/dotnet/2025/06/16/opentelemetry-plugin-for-jetbrains-rider/ for rider / .NET

website: https://instrumentation-score.com current specification (seems pretty early): https://github.com/instrumentation-score/spec/blob/main/specification.md

instrumentation score: "a standardized, vendor-neutral metric for assessing #opentelemetry instrumentation quality. calculated by analyzing OTLP data streams against OTel semantic conventions and community best practices" with a score from 10 to 100 fingers crossed that working against a spec […]

salesforce blocking AI companies from using slack data: https://www.reuters.com/business/salesforce-blocks-ai-rivals-using-slack-data-information-reports-2025-06-11/ 1. nice competitive advantage for their own thing 2. if google, microsoft,… start doing the same it will lead to a horrible […]

one of our best kept secrets: #elastic as an anti-virus software 100% protection rate both for the real-world protection test (10 false positives) and the recent malware samples — doing great against all the well known products. also not the first time we do […] [Original post on mastodon.social]

statements that should land you in benchmark jail #benchmarketing 1. only the 3rd point is actually against elasticsearch, the other 2 are against itself 2. absolutely no details on version, hardware, configuration, if / what client was used,... PS: though great to see who is the benchmark ;)

small SF protest on the move from where I can see it, 1 waymo damaged / disabled but no 🔥

watching this entire memvid topic blow over: so much influencing, so little technical work behind it. but it‘s been a great filter who to take seriously PS: we should do all the experiments but not the breathless announcements […] [Original post on mastodon.social]

unpopular opinion: the elastic license v2 (ELv2) strikes a good balance between freedom and sustainable development — recent examples include mastra AI and DBT * source available * free to use (in production at any scale) * option of having paid features (and you're not allowed to hack the […]

tl;dr from a 2h workshop at #aiDotEngineer in 4 pictures: 1. retrieval is more than vector search. find the right (combination of) tools for the job — my mental model looks like this handy little chart 2. repeat after me: BM25 is still a great baseline 3 […] [Original post on mastodon.social]