Skip to content
View Rahul9121's full-sized avatar

Block or report Rahul9121

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Rahul9121/README.md
Rahul Ega, Senior Data Engineer. PySpark, Kafka, Snowflake, dbt, Azure, Airflow.

Portfolio Email LinkedIn Resume


About

Hi, I'm Rahul. I'm a data engineer based in New Jersey with five-plus years of building pipelines for tech and finance teams. Right now I'm at Meta, and before that I was at Bank of America and Fidelity.

Most of my work sits in the middle of the data stack. Events come in through Kafka, get cleaned up and reshaped in PySpark, land in Delta Lake or Snowflake, and get modeled in dbt so analysts can trust the numbers. I also write the checks that catch schema drift and bad data before anyone downstream sees it, and I spend a fair bit of time making slow Spark jobs faster.

I'm open to my next senior data engineer role anywhere in the US: remote, hybrid, or on-site, contract or full-time.

{
  "role": "Senior Data Engineer",
  "location": "New Jersey, USA",
  "open_to": "Roles across the US · remote / hybrid / on-site",
  "education": "MS Computer Science · Montclair State University",
  "focus": "Batch and streaming data platforms"
}

Stack

What I work with day to day.

Languages

Python PySpark SQL Scala Bash

**Processing and storage**

Apache Spark Spark Streaming Kafka Delta Lake Parquet Avro ORC

**Cloud and warehouse**

Azure Databricks Azure Data Factory ADLS Azure Synapse Snowflake dbt

**Databases**

PostgreSQL MySQL Azure SQL

**Orchestration and tooling**

Airflow Docker Git Azure DevOps CI/CD JIRA


Projects

I'm building six projects to show how I work, from streaming to migrations. Each one gets a live demo and its own repo as it ships. None are finished yet, so for now every card opens the status page on my site.

Real-Time Event Streaming Pipeline PySpark Batch ETL Framework
dbt Analytics Warehouse Airflow ELT with Data Quality Gates
Lakehouse and Spark Performance Lab Hive-to-PySpark Migration and CI/CD

Experience

Senior Data Engineer, Meta Jan 2026 – now · contract · USA PySpark and Kafka pipelines on Azure Databricks, writing to Delta Lake on ADLS. dbt models on top, Airflow for scheduling, and data quality checks inside the pipelines so problems show up early.

Data Engineer, Bank of America Jun 2024 – Dec 2025 · contract · USA PySpark ETL into Snowflake, dbt dimensional models for the warehouse, and Azure Data Factory for orchestration. I also wrote a lot of SQL for reconciliation and for the compliance teams.

Data Engineer, Fidelity Investments Feb 2021 – Aug 2023 · full time · Hyderabad, India Hive and PySpark jobs on Hadoop, Kafka ingestion from trading and transaction systems, and a migration of on-prem jobs to Azure, with every output tested against the legacy baseline.

Education: MS in Computer Science, Montclair State University, May 2025.


Contact

The easiest way to reach me is email. If you're hiring for a senior data engineer role, or you just want to talk pipelines, send me a message and I'll get back to you.

Portfolio Email LinkedIn Resume

RE-2026 · New Jersey, USA

Popular repositories Loading

  1. airbnb-rahul-streamlit airbnb-rahul-streamlit Public

    Interactive Streamlit web app for analyzing NYC Airbnb listings with comprehensive EDA, pricing insights, geographic visualizations, and market trends analysis

    Python 1

  2. iplDataViz-rahul iplDataViz-rahul Public

    This is an in-depth data visualization and analysis project that explores Indian Premier League cricket data spanning nearly a decade (2008-2017). The project demonstrates comprehensive data scienc…

    Jupyter Notebook 1

  3. Student-Management-System-Rahul Student-Management-System-Rahul Public

    A modern, web-based Student Management System built with Flask and SQLAlchemy, featuring a beautiful gradient UI and comprehensive academic data management capabilities.

    Python 1

  4. bioscope-project bioscope-project Public

    A sophisticated biodiversity monitoring and risk assessment application for New jersey , USA

    Python 1

  5. healthcare-claims-intelligence-dashboard healthcare-claims-intelligence-dashboard Public

    Healthcare claims intelligence dashboard with readmission risk API

    Python 1

  6. fintech-fraud-detection-monitoring-system fintech-fraud-detection-monitoring-system Public

    Fintech fraud detection + transaction monitoring system with hybrid rule-based and ML scoring

    Python 1