Skip to content
#

llmevaluation

Here are 22 public repositories matching this topic...

Portfolio of seven applied AI systems spanning multimodal interaction, local language-model training, RAG and vector-store evaluation, AI control patterns, compute-emissions scenario analysis, and social intelligence analytics.

  • Updated Oct 15, 2026
  • Python

This repository is a practical overview of inference engineering for Large Language Model deployment, with vLLM as the serving engine. It is meant to help you understand not only how to start a model server, but also how to reason about throughput, latency, batching, quantization, KV cache memory, and GPU VRAM requirements before deploying a model.

  • Updated Nov 7, 2026
  • Jupyter Notebook

Add this topic to your repo

To associate your repository with the llmevaluation topic, visit your repo's landing page and select "manage topics."

Learn more