Skip to content
View shaileshmchalke's full-sized avatar
  • Azentio Software Pvt. Ltd.
  • Pune
  • 02:43 (UTC +05:30)

Block or report shaileshmchalke

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
shaileshmchalke/README.md

Shailesh Chalke

Snowflake Data Engineer — Cloud ELT, Migration & Performance


Introduction

I design and deliver production-grade Snowflake ELT platforms that modernize legacy Oracle and SQL Server workloads into scalable, governed, and high-performance cloud data platforms.

My work focuses on data modeling, orchestration, performance optimization, and cost-efficient data processing — building reliable pipelines that are easy to maintain, audit-ready, and built for enterprise-scale analytics.

With 14+ years of overall IT experience, including 5+ years specializing in Snowflake Data Engineering, I enjoy solving complex data engineering challenges through modern architecture, automation, and cloud-native best practices.


About

My day-to-day is Medallion architecture — Bronze, Silver, Gold — built on dbt Core and orchestrated through Apache Airflow, with Python filling the gaps around ingestion and validation. I lean toward metadata-driven design: config-driven joins over hardcoded SQL, reusable Jinja macros over copy-pasted models, SCD Type 2 snapshots over manual history tracking. A pipeline is only good if the next engineer can extend it without rewriting it.

The other half of the job is migration and governance. I've moved production Oracle systems onto Snowflake, converted nightly batch procedures into incremental dbt models, and spent a fair amount of time inside Query Profile chasing down the warehouse settings quietly inflating a Snowflake bill. RBAC and Dynamic Data Masking aren't an afterthought — they go in alongside the pipeline, not after an audit asks for them.


Core Expertise

  • Snowflake Engineering — Enterprise edition, External Stages, Storage Integration, Snowpipe, Time Travel, Zero-Copy Cloning, Clustering Keys, Query Profile tuning
  • ELT with dbt Core — Incremental models, Jinja macros, Snapshots (SCD Type 2), singular tests, ephemeral models, source & lineage documentation
  • Orchestration — Apache Airflow DAGs, dependency management, retry logic, failure alerting, scheduled production runs
  • Data Modeling — Medallion architecture, Star Schema, One Big Table (OBT), metadata-driven pipeline design, fact/dimension modeling
  • Cloud Migration — Oracle & SQL Server → Snowflake, schema conversion, batch-to-incremental re-architecture, cutover validation
  • Governance & Security — RBAC, Dynamic Data Masking, Row Access Policies, column-level security
  • Cloud & Storage — Azure Blob Storage, Azure Data Factory, AWS S3, Service Principal auth
  • Languages — Advanced SQL, T-SQL, PL/SQL, Python (Pandas, Snowflake Connector), Jinja2

Certifications

  


Technology Stack

Snowflake   Snowflake Snowpipe Snowpark

Transformation & Orchestration   dbt Airflow ADF

Languages & Databases   Python SQL Oracle SQL Server

Cloud   Azure AWS S3

Developer Tools   Git GitHub


Featured Projects

🚀 sql-server-to-snowflake-migration Migrating off SQL Server usually means hand-converting schemas and hoping the data lands intact. This project automates the schema conversion and data validation steps of that migration end to end, so the cutover itself is repeatable instead of a one-off script someone runs at 2am. Snowflake Python Azure Data Factory

💰 snowflake-finops-toolkit Snowflake bills climb quietly — an idle warehouse here, an oversized auto-suspend setting there. This toolkit tracks credit consumption in real time and surfaces the warehouse configurations actually driving cost, the same class of tuning that cut compute spend by 40% on a past production migration. SQL Python Streamlit

⚡ modern-elt-pipeline-dbt-adf A reference implementation of the Medallion architecture (Bronze → Silver → Gold) I run in production — dbt Core for transformation, Azure Data Factory for ingestion, built to scale as new source systems get added. Snowflake dbt Core Azure Data Factory

🔒 enterprise-rbac-data-masking A layered RBAC hierarchy paired with Dynamic Data Masking at the column level, modeled on the governance patterns used to pass 100% of internal audits across 30+ production schemas in a prior engagement. Snowflake Security RBAC Dynamic Data Masking

🧊 snowflake-iceberg-lakehouse A strategy and reference setup for Iceberg tables on Snowflake — evaluating where open table formats make sense for cheaper, more flexible long-term storage. Iceberg Snowflake


What I Build

  • Production-grade ELT pipelines on Medallion architecture
  • Legacy Oracle & SQL Server → Snowflake migrations
  • Metadata-driven, config-based data models
  • Incremental dbt models with SCD Type 2 history
  • Airflow-orchestrated pipelines with retry and alerting
  • Warehouse performance tuning & cost optimization
  • RBAC and Dynamic Data Masking for governed data delivery

GitHub Analytics


Open to Work

Currently open to Snowflake Data Engineer, Data Engineer, and Cloud Data Engineering roles — full-time or contract.


Connect

 

Building scalable data platforms, one pipeline at a time.

Popular repositories Loading

  1. shaileshmchalke shaileshmchalke Public

    Professional Portfolio & Technical Documentation of Snowflake Data Engineering Projects.

  2. sql-server-to-snowflake-migration sql-server-to-snowflake-migration Public

    Production-grade SQL Server to Snowflake migration framework with HIPAA-compliant PHI masking. Built for Cerner EHR (2.4TB, 5,247 tables).

    Python

  3. modern-elt-pipeline-dbt-adf modern-elt-pipeline-dbt-adf Public

    Medallion ELT pipeline for BFSI — Snowflake + dbt + ADF | FinOps optimized, with automated data quality and incremental merge.

    Python

  4. healthcare-hipaa-rbac-audit healthcare-hipaa-rbac-audit Public

    HIPAA-compliant Snowflake data platform for 12-hospital US healthcare network — Dynamic Data Masking (12 PHI policies), Row-Level Security, Immutable Audit Logs (7-yr WORM), RBAC hierarchy, and CI/…

  5. snowflake-iceberg-lakehouse snowflake-iceberg-lakehouse Public

    Snowflake to Apache Iceberg Lakehouse Migration: 500TB historical trade data, 62% storage cost reduction, zero-downtime cutover, financial services compliance (SEC Rule 17a-4, FINRA 4370). Terrafor…

    Shell

  6. sqlserver-to-snowflake-migration sqlserver-to-snowflake-migration Public

    Production-grade SQL Server → Snowflake migration pipeline for a US multi-specialty healthcare clinic. Python · pyarrow · COPY INTO · Incremental loads · HIPAA-compliant DDM · 133 tests.

    Python