Skip to content
View ShubhSarin's full-sized avatar

Highlights

  • Pro

Block or report ShubhSarin

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ShubhSarin/README.md

Shubh Sareen - AI/ML Team Lead @ IIT Bombay

Portfolio Email LinkedIn GitHub

"I turn unreliable LLM outputs into production systems."
"AI reliability is a design problem, not a model problem."


Proof Points & Operational Metrics

  • 96.1% mAP50 / 88.9% mAP50-95 on dense document layout and figure extraction via fine-tuned DocLayout-YOLO (YOLOv10m).
  • ~95% cost reduction (to ₹0 API cost) by replacing raw LLM coordinate guessing with an LLM-to-IR 16-tool deterministic geometry compiler on local dual RTX 3090s.
  • 13,000+ students served by campus digital platforms as Institute Web Convener at IIT Bombay.
  • 3.4M+ transactions & orders analyzed in production retail basket analytics.

Featured Systems & Codebases

Production RAG Platform on Azure Container Apps · Live App

  • Converts full playlist-scale lecture series into structured chapter notes, interactive flashcards, and quizzes.
  • Engineered fault-tolerant ingestion handling 5 distinct transcript failure modes with per-video isolation.
  • Multi-model routing layer across OpenRouter and Gemini with a 3-stage hallucination filtering pipeline.
  • Stack: Python, FastAPI, React 19, Vite, Tailwind CSS, Azure Container Apps, Docker, In-Memory Vector Search.

YouTube Study Helper Architecture

2. Programmatic SVG & 16-Tool Geometry Compiler

LLM-to-IR Architecture · Autonise Internship (May–June 2026)

  • Decoupled semantic reasoning from coordinate emission by creating a 16-tool domain-specific language (calculate_intersection, tangent_to_circle, compute_centroid, etc.).
  • Enforced a strict tool-before-coordinate mandate so the model outputs a topological constraint graph rather than pixel coordinates.
  • Deterministic NumPy + Matplotlib compiler analytically solves the equations into clean vector SVGs, dropping diagram failure rates from ~60% to 0%.

Programmatic SVG and Geometry DSL Compiler

3. DocLayout-YOLO & Two-Collection Ingestion Pipeline

High-Density Document Segmentation & OCR

  • Fine-tuned YOLOv10m on a 33k-image synthetic dataset with variable fonts, multi-column layouts, and margin shifts (96.1% mAP50 / 88.9% mAP50-95).
  • Diagnosed and fixed an upstream float16 export defect that silently zeroed out Distribution Focal Loss (DFL) gradients.
  • Integrated into a two-collection MongoDB staging pipeline with scope-enforced reads and interactive human review.

DocLayout-YOLO Segmentation and Ingestion

Multi-Agent State Machines & Tool Coordination

  • Implemented LangGraph state machines using TypedDict state, conditional router dispatching, and looping control flow.
  • Built 8 Google ADK agent patterns including Sequential, Parallel, Session-persistent, and Tool-calling agents.
  • Stack: Python, LangGraph, Google ADK, Streamlit.

Attention-Based Multimodal Image Captioning

  • ResNet-50 feature extractor paired with an LSTM language decoder augmented with Bahdanau additive attention.
  • Generates dynamic alignment heatmaps over image regions during autoregressive caption generation.
  • Stack: PyTorch, Torchvision, Python, Bahdanau Attention, ResNet-50.

Tech Stack & Core Tools

Python C++ PyTorch CUDA LangGraph YOLO HuggingFace Docker Azure FastAPI React MongoDB Linux

ML Systems Engineering & Cloud Core Stack Engineering Mindset
LLM Systems & Pipelines Pipeline Architecture Python, C++, SQL Systems Thinking
Programmatic IR (LLM $\to$ Code) Hybrid Local/Cloud Serving PyTorch, LangGraph Failure Mode Analysis
Evaluation Methodology Docker & Container Apps YOLOv10, FastAPI Metric Design & Critique
Pairwise & Swiss Ranking Vector Retrieval & RAG Transformers, LoRA Deterministic Boundaries
Document Layout & OCR MongoDB (Two-Collection) Azure Container Apps Empirical Benchmarking
Multimodal Attention Models Linux / POSIX Toolchains Matplotlib, NumPy First-Principles Derivation

What I'm Doing Now

  • AI/ML Team Lead @ IIT Bombay: Leading an engineering cohort preparing for and competing in national and global AI/ML competitions, data challenges, and hackathons.

GitHub Streak

Pinned Loading

  1. Vision-to-text-SOC Vision-to-text-SOC Public

    Image captioning pipeline featuring Bahdanau additive attention heatmaps with ResNet50 and LSTM.

    Jupyter Notebook

  2. WIDS-2025-Agentic-AI WIDS-2025-Agentic-AI Public

    Multi-agent workflows and state machines implemented with LangGraph and Google ADK.

    Python 1

  3. youtube-study-helper youtube-study-helper Public

    Production RAG platform converting YouTube course playlists into chapter notes, flashcards, and quizzes. Deployed on Azure Container Apps.

    HTML 1