An experimental LLM platform for local and cloud inference, chat, RAG, agents and tools, guardrails, security, monitoring, evaluation, LLM-as-a-Judge, and research into original features.
rag fastapi large-language-models llm local-inference llama-cpp local-llm retrieval-augmented-generation cloud-inference gguf llm-platform llm-evaluation llm-agents llm-as-a-judge ai-guardrails
-
Updated
Aug 4, 2026 - Python