model-runner

Offline desktop client for GLM-5.3-Flash — run private, local chat sessions without a server connection.

3 use cases for gemma 3n that you can install in a few lines of your bash on your local machine or a small server

Local model runner manager: launch, manage, watch, and auto-restart GGUF models via llama.cpp (llama-server) and DwarfStar (ds4-server). Zero-dependency Python 3 stdlib backend + single-page vanilla JS web UI.

OpenGradient model runner for protocol analysis, live inference, fallback execution, and leaderboard-driven evaluation.

Model-first local inference with permissioned hardware inspection and explained CPU/GPU configurations.

Universal Local LLM API Gateway for Kubernetes

📃 Ollama Guide — run LLMs locally for free. Installation steps, model library (Llama, Qwen, Gemma, DeepSeek), key features & official download links for Windows, macOS & Linux.

“Mistral Large 4 Offline Desktop Client — a local-first desktop app for developers and writers who need full data privacy. Run Mistral Large 4 models entirely offline, with a simple chat interface and no cloud dependency.”

Default-deny local execution and model-runner boundary for broker workflows, with bounded JSON results, resource controls, model verification and JSONL streaming.

Yollama | "Your-Ollama! Take control with true data privacy, plus, real offline Freedom for you and your LLM AI model inferencing!

Docker Desktop extensions for automation — manage stacks, AI agents, MCP Gateway, LLM models, ports, and container health