llama.cpp streaming support for tool calling & thoughts was just merged: please test & report any issues 😅 github.com/ggml-org/lla... #llamacpp

Llama.cpp now supports tool calling (OpenAI-compatible) github.com/ggerganov/ll... On top of generic support for *all* models, it supports 8+ models’ native formats: - Llama 3.x - Functionary 3 - Hermes 2/3 - Qwen 2.5 - Mistral Nemo - Firefunction 3 - DeepSeek R1 🧵 #llamacpp

Universal llama.cpp tool call is coming: I've just released Minja, a minimalistic Jinja template engine reimplementation in C++ for LLM chat templates: github.com/google/minja (*not an official Google product*) #LLM #AI #EdgeAI #OSS 🧵 1/4

#Manifold v3.0 is out! This is a huge release - we have removed *all* required dependencies. Our npm package is half the size and twice the speed. Our #SDF LevelSet is much faster and higher quality. And so much more: github.com/elalish/mani...