🚀 Gemma4 Java runner: • Single file, no deps • E2B→31B + MoE • GGUF + quant (F16→Q8) • Vector API ⚡ • CLI + thinking modes • GraalVM native + instant TTFT Pure Java 😏 by @mukel.bsky.social github.com/mukel/gemma4...

Strong with the JVM, Gemma 4 is 😌 jbang gemma4@mukel \ --model %{https://hf.co/unsloth/gemma-4-E2B-it-GGUF/resolve/main/gemma-4-E2B-it-Q8_0.gguf} \ --system-prompt "like Master Yoda, reply you must" \ --chat ~5GB once, download you must. Python or CUDA, you need not. Local AI, this is.

Over the Easter weekend, I got Gemma 4 running in pure Java. No Python. No JNI. No native code. Just the JVM. github.com/mukel/gemma4...

My @graalvm.org Native Image deep dive recording is already up: youtube.com/watch?v=1J6m... 🐰🚀 It includes the very public first demo of Project Crema, Open World for Native Image, at 2:19:54 😅 Thank you, @devoxx.com! All demos and notes are here: github.com/alina-yur/gr...

run an LLM with a supercharged engine powered by Java and GraalVM (ht @alina-yurenko.bsky.social ) www.youtube.com/shorts/7zSEa...

✅ @graalvm.org Native Image ✅ Llama3.java ✅ Vector API, FFM API ✅ Apple Silicon ❤️ — `git clone github.com/mukel/llama3... ` — `sdk install java 25.ea.17-graal` — `make native` (optionally preload a model for zero overhead) — Profit!🚀 #Java #GraalVM #LLM #LLama

I had lots of fun talking about my early days as a dev, how I caused double credit bookings all over Germany, stopped smoking to survive long GraalVM meetings and how to heat the room with Java inception. Already looking forward to part 2.

what's new in llama3.java and the upcoming @graalvm.org for JDK 24 🔥 Try it out here: github.com/mukel/llama3... @stephanjanssen.be @mukel.bsky.social #VDCERN #VoxxedDaysCERN

This will be a big deal 🪄🤩. Normally the debug experience of natively compiled languages get obfuscated due to compiler optimisations like inlining. Not here. All optimizations can be enabled to debug GraalVM native images and it looks just the same as without opts.

We just merged the current status of the upcoming JDWP support for @graalvm.org Native Image! 🥳 This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details. github.com/oracle/graal...

Excited to welcome @mukel.bsky.social as my co-speaker for the VoxxedDays #CERN talk on "The Era of AAP: Ai Augmented Programming using only Java" ☕️ 🚀 🔥 cern.voxxeddays.com/talk/the-era...

https://buff.ly/40KmT0t Graal compiler: +10% faster inference with the latest early access build. New features: batched prompt processing & AVX512 support.