Databricks Platform - Architecture, Security, Automation and much more!!
A metadata-driven PySpark data pipeline on Databricks using Medallion Architecture (Bronze, Silver, Gold). Features an OOP-based framework orchestrated via dbutils.run for dynamic configuration and retail sales analytics
Databricks Genie Code Skills 🧞♂️⚡ is a curated collection of code resources, utilities, and best practices to power up your data workflow on the Databricks platform. This repo offers skills for 🚀 Data engineering automation 🤖 Machine learning workflows 📊 Data analytics solutions 🛠️ Productivity tools for Databricks users
End-to-end Databricks lakehouse pipeline analyzing GDP growth, population trends, and education investment across 217 countries using PySpark, Delta Lake, and medallion architecture
Plataforma determinística e orientada a evidências para diagnóstico e inteligência em engenharia de dados, cobrindo código, arquitetura, Spark, cloud, pipelines, qualidade, segurança, governança, runtime, performance e migrações.
Agentic AI project where an agent builds a weather-aware, day-by-day itinerary based on users saved destinations and preferences. Reschedule outdoor activities when rain or poor air quality is forecasted with proper explanations.
UrbanPulse is an end-to-end Databricks lakehouse project for analysing London Underground operations, service reliability, arrival activity, weather conditions, and calendar effects.
Real-time crypto trade data pipeline: Binance WebSocket → Kafka → S3 (lake) → Databricks Unity Catalog (lakehouse transforms) → Snowflake (warehouse) → dashboard.
To associate your repository with the databricks-platform topic, visit your repo's landing page and select "manage topics."