Skip to content
View varunvaidhiya's full-sized avatar

Organizations

@ohho-robotics

Block or report varunvaidhiya

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
varunvaidhiya/README.md

Typing SVG

Robot Learning & AI Inference Engineer · Robot-learning data & training platforms · GPU / edge-GPU inference optimisation

Building OmniBot, an open-source mobile manipulator, at Ohho Robotics

Open to robot learning, AI engineering and ML/AI performance roles

Website · LinkedIn · X · Substack · YouTube


👨‍💻 About Me

I build the software platform that makes robot learning work (teleoperation data collection, episodic data pipelines, training and policy-serving infrastructure) and I make AI models run fast on real compute: GPU and edge-GPU inference, quantisation and model performance optimisation.

  • 🔭 Working on: OhhO Robotics (Founder): the open-source software stack for robot learning on mobile manipulators. Ohho OS is open source (Apache-2.0).
  • 🤖 Robot learning platform
    • Teleoperation data collection: VR / mobile teleop pipelines for recording demonstrations.
    • Data pipelines: LeRobot-format episodic datasets, shared camera schemas, bag conversion and episode quality filtering.
    • Training & serving: imitation-learning training infrastructure and a ROS 2 policy-inference node that runs trained policies on the robot.
  • ⚡ AI optimisation on compute
    • GPU / edge-GPU inference: TensorRT FP16 engine for visuomotor-policy vision encoders (OmniBotPro).
    • Model compression & benchmarking: SAM 2 post-training quantisation and structured pruning, benchmarked against SegFormer on an RTX 4070 Mobile (SAM2forAV).
    • CUDA & ARM: libfreenect2 fork with CUDA 13.0 fixes and Raspberry Pi 5 / ARM64 support; CUDA programming practice; performance trace analysis (Perfetto).
  • ⚙️ Core Stack: PyTorch, LeRobot, ROS 2, TensorRT, ONNX, CUDA, Docker, Python, C++.
  • 💡 Interests: efficient inference for robot policies and foundation models (including VLAs) on edge GPUs.
  • 📫 Email: varun@ohho-robotics.com

🔨 Recent Work

  • OmniBot #10: arm emergency stop now drops servo torque; the driver holds position on stale commands and clamps joint limits and per-cycle steps.
  • OmniBot #13: the LeRobot policy node skips missing or black camera frames, drops stale inference, and clamps arm deltas.
  • OmniBot #12: one shared wrist + bird's-eye camera schema across recording, validation, bag conversion and the policy.
  • OmniBot #14: episode quality filter CLI for LeRobot datasets that rejects frozen video, camera timestamp skew, joint jumps and too-short episodes.
  • OhhO-VR #5: GameCI workflow that runs the Unity edit-mode test suite in CI.
  • ohho-os 1.1.2: released to PyPI through a tag-triggered trusted-publishing workflow with install smoke tests on Ubuntu and macOS.

🛠️ Technology Stack

Robot Learning & Model Training

PyTorch Transformers LeRobot Imitation Learning Reinforcement Learning

GPU & Edge Inference Optimisation

NVIDIA CUDA TensorRT ONNX Quantisation Arm

Robotics Software Platform

ROS2 NVIDIA Isaac Gazebo

Languages

Python C++ TypeScript Bash

Data & Infrastructure

Docker Data Pipelines GitHub Actions Linux


📊 GitHub Statistics

GitHub Stats Top Languages

GitHub Streak


🎯 Key Focus Areas

class VarunVaidhiya:
    def __init__(self):
        self.role = "Robot Learning & AI Inference Engineer"
        self.expertise = [
            "Robot learning platforms: teleop data collection to trained policy",
            "Episodic data pipelines & dataset quality (LeRobot format)",
            "Training & policy-serving infrastructure",
            "GPU / edge-GPU inference (TensorRT, ONNX, CUDA)",
            "Model optimisation: quantisation, pruning, benchmarking",
        ]
        self.current_projects = [
            "OhhO Robotics: open-source robot learning software stack",
            "VR / mobile teleoperation data pipelines",
            "Accelerated on-robot policy inference",
        ]
        self.looking_for = {
            "opportunities": "Robot learning, AI engineering & ML/AI performance roles",
            "collaborations": "Robot learning infrastructure, efficient edge inference",
        }

    def say_hi(self):
        print("Let's make robot learning scale and AI run fast!")

📫 Connect With Me

Email GitHub Website LinkedIn X Substack YouTube


🏷️ Interests & Keywords

#RobotLearning #ImitationLearning #Teleoperation #DataEngineering #MLInfrastructure #GPUInference #EdgeAI #TensorRT #ModelOptimisation #ROS2 #OhhORobotics #PhysicalAI


Profile Views
🌟 Open to collaborations, research opportunities, and interesting projects in AI & Robotics!


🛠️ From varunvaidhiya | Last updated: 2026

Pinned Loading

  1. ohho-robotics/ohho-omnibot ohho-robotics/ohho-omnibot Public

    Open-source ROS 2 Jazzy mecanum mobile manipulator: SO-101 arm, Nav2/SLAM, Gazebo sim, Quest VR teleop, LeRobot + VLA

    Python 4 1

  2. ohho-robotics/ohho-vr ohho-robotics/ohho-vr Public

    Meta Quest 3/3S teleop app (Unity 6) for ROS 2 robots over ROSBridge: mecanum base + SO-101 arm, MJPEG video, passthrough

    C#

  3. libfreenect2 libfreenect2 Public

    Forked from OpenKinect/libfreenect2

    Kinect v2 driver fork: Raspberry Pi 5 / ARM NEON + USB transfer fixes, plus CUDA 13.0 / Ubuntu 24.04 support

    C++

  4. SAM2forAV SAM2forAV Public

    SAM 2 fine-tuning (Cityscapes) + quantization/pruning, benchmarked vs SegFormer on an RTX 4070 Mobile

    Jupyter Notebook

  5. ohho-robotics/ohho.apk ohho-robotics/ohho.apk Public

    Kotlin Android controller for ROS 2 robots via ROSBridge: joystick + arm teleop, MJPEG camera, odom, map, OTA

    Kotlin