Building a Real-Time Stock Market Analytics Platform on GCP (Part 2)Introduction In Part 1 of this series, we introduced our Stock Market Analytics Platform built on Google Cloud Platform (GCP). We covered the architecture, infrastructure deployment with Terraform, batch processing with Dataproc/Spark, and real-time ...Mar 31, 2025·5 min read
Data Engineering with dbt: Mastering Analytics Engineering Through NYC Taxi DataFeb 26, 2025·7 min read
From Raw Data to Insights: My Journey with dlt in Data EngineeringAs a data engineering enthusiast, I recently dove into the world of modern ETL frameworks through the Data Engineering Zoomcamp's workshop on dlt (data load tool). What I discovered was not just another data pipeline tool, but a revolutionary approac...Feb 16, 2025·2 min read
My Journey Through BigQuery: Lessons from Data Engineering Zoomcamp Module 3As I wrap up Module 3 of the Data Engineering Zoomcamp, I want to share my experience working with Google BigQuery and the valuable insights I gained while analyzing the NYC Yellow Taxi dataset. This module has fundamentally changed how I think about...Feb 12, 2025·3 min read
Mastering Workflow Orchestration: My Module 2 Journey in Data Engineering ZoomcampIntroduction In the second week of Data Engineering Zoomcamp, I dove deep into workflow orchestration using Kestra, a modern and powerful orchestration tool. The journey from handling raw CSV files to implementing automated data pipelines was both ch...Feb 5, 2025·3 min read
Completing DataTalksClub’s Data Engineering Zoomcamp: My Module 1 Journey with Docker and TerraformI just wrapped up Module 1 of DataTalksClub’s Data Engineering Zoomcamp, and it’s been an exciting dive into the fundamentals of modern data engineering! This module focused on Docker, Postgres, and Terraform – tools every data engineer should know. ...Jan 27, 2025·2 min read