Pinned Loading

1. joule-lat/OpenJoule joule-lat/OpenJoule Public

   Plant-level inference and control engine for AI infrastructure.

   Python

2. smol_vllm smol_vllm Public

   A minimal vllm to learn how inference engines work

   Python 2 1

3. RelayServe RelayServe Public

   Minimal LLM inference gateway

   Python 3 3

4. fullstack-inferencing fullstack-inferencing Public

   Inference Ops exercise for my class

   Python 4 4

5. awesome-gpu-engineering awesome-gpu-engineering Public

   GPU Engineering for AI Systems

   HTML 602 73

6. awesome-observability awesome-observability Public

   A curation of some of the best tools, resources, frameworks on LLM observability

   Python 9 9