Skip to content
View Lahiru1Niroosh's full-sized avatar
📍
Focusing
📍
Focusing

Block or report Lahiru1Niroosh

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
lahiru1niroosh/README.md
Typing SVG

LinkedIn GitHub Gmail X


Profile Views   Followers


👨‍💻 About Me

coding gif

I'm a final-year BSc IT (Hons) student at SLIIT, currently working as a Database Administrator at VS Information Systems, Colombo — where I maintain high-availability production Oracle banking databases, automate monitoring workflows, and perform SQL-based analysis to identify performance bottlenecks.

My passion is bridging the gap between operational DBA work and modern data engineering: designing streaming pipelines with Kafka & Spark, building Medallion architectures, and turning raw data into real business insights. I'm actively growing toward a Senior Data Engineer role.

Name     : Lahiru Niroshan Sathsara
Role     : DBA → Data Engineer
Company  : VS Information Systems 🏦
Degree   : BSc IT (Hons) · SLIIT · Final Year
Base     : Moratuwa, Sri Lanka 🇱🇰
Focus    : Streaming · SQL Analytics · Cloud
Open to  : Data Engineering Opportunities ✅


🏗️ Data Pipeline Architecture

📥 INGEST ⚙️ PROCESS 🗄️ STORE 📊 SERVE
Tools Kafka · NiFi · REST APIs Spark SS · PySpark · ETL/ELT Cassandra · PostgreSQL · DuckDB Power BI · Superset · Streamlit
Pattern Event Streaming Medallion Architecture Dual-Store Strategy Real-Time Dashboards
Infra Docker OCI · AWS · Azure BigQuery · MongoDB Tableau · Matplotlib

🛠️ Tech Stack

⚡ Data Engineering & Streaming

Kafka Spark Airflow ETL Medallion

🗄️ Databases

Oracle PostgreSQL Cassandra MongoDB DuckDB BigQuery

🧑‍💻 Languages & Analytics

Python SQL Java Pandas NumPy Scikit-learn

📊 Visualization & BI

Power BI Tableau Superset Streamlit Matplotlib

☁️ Cloud & DevOps

OCI AWS Azure Docker Linux Git


🚀 Featured Projects

Python PostgreSQL pytest Docker

Hierarchical data reconciliation engine simulating core banking → reporting replica drift detection · Schema, aggregate, partition, and hash-based row fingerprinting · 100% precision/recall on labeled fault injection · 2.3x–6.4x faster than naive full outer-join comparison


Streamlit PostgreSQL Plotly

Business-facing BI dashboard built on DataGuard Core's output · SQL window functions for integrity trends and cohort ranking · Translates row-level discrepancies into dollar exposure and affected-account risk · Data-driven executive summary generated from live query results


Python SQL Streamlit Scikit-learn

End-to-end analytics system simulating Uber Eats marketplace data · SQL KPIs (conversion rate, revenue/eater, demand patterns) · Pricing elasticity model · Churn prediction for restaurant partners · Interactive Streamlit dashboards · Automated weekly reporting


Kafka Spark Cassandra Docker

High-volume streaming pipeline · Kafka producers & consumers for data ingestion · Dual-store strategy (Cassandra + PostgreSQL) · Real-time dashboards via Apache Superset · Fully containerized with Docker


Spark Kafka Cassandra

End-to-end ride event architecture · Spark Structured Streaming for real-time processing · Dual-storage strategy optimized for low-latency queries · Fully containerized pipeline with Docker


Python PostgreSQL BigQuery Tableau

Complex EHR data cleaning & transformation with Pandas · Loaded to PostgreSQL & BigQuery for KPI insights · Interactive Power BI dashboards · Identified patterns to improve operational efficiency


Python DuckDB Power BI

Automated Reddit API scraper (100+ job discussion sources) · Medallion Architecture (Bronze/Silver/Gold) · 50,000+ records analyzed · Interactive Power BI dashboards for KPI monitoring


📊 GitHub Stats




📈 Contribution Activity

Activity Graph


📜 Certifications

Certification Issuer Year
🔶 OCI 2025 Certified Foundations Associate Oracle 2025
🤖 OCI 2025 AI Foundations Associate Oracle 2025
🧠 Oracle Fusion AI Agent Studio Foundations Oracle 2025
☁️ AWS SimuLearn: Computing Solutions Amazon 2025
🐍 Python for Beginners Uni. of Moratuwa 2024
🔷 Introduction to Azure Virtual Machines Microsoft 2024

🌱 Currently Leveling Up

Airflow   dbt   Delta Lake   Spark


🐍 Contribution Snake

contribution snake

"Data is not information, information is not knowledge — I build the systems that bridge that gap."


Let's Connect   Hire Me



Pinned Loading

  1. F1-Real-Time-Data-Pipline F1-Real-Time-Data-Pipline Public

    2024 F1 data engineering platform using OpenF1, Kafka, Spark, PostgreSQL, Cassandra, Airflow and Docker, with interactive Superset analytics.

    Python 2

  2. dataguard-core dataguard-core Public

    Hierarchical data reconciliation engine for banking systems — schema, aggregate, partition, and hash-based fault detection with 100% precision/recall and 2.3x-6.4x speedup over naive comparison

    Python 1

  3. dataguard-insights dataguard-insights Public

    Streamlit BI dashboard translating data reconciliation results into business-facing metrics — dollar exposure, integrity trends, and a data-driven executive summary generator

    Python 1

  4. uber-eats-sl-analytics-Project uber-eats-sl-analytics-Project Public

    This end-to-end analytics platform simulates the real-world data operations of Uber Eats Sri Lanka — covering marketplace health monitoring, pricing intelligence, restaurant partner performance, dr…

    Python 1

  5. acas-social-media acas-social-media Public

    JavaScript 1 1

  6. logistics-sales-platform logistics-sales-platform Public

    An interactive operations intelligence dashboard for logistics performance, margin stress-testing, and capacity planning.

    Python 1