About Me

Skills, Experience & Certifications

Mitul Panchal

Mitul Panchal

Lead Data Engineer

Lead Data Engineer with 7+ years of experience designing enterprise data platforms, real-time pipelines, and data-driven APIs. Deep expertise in Azure, Databricks, and Lakehouse architecture. Currently at ICICI Lombard (BFSI) — automating complex processes, reducing costs, and owning analytics platforms at scale. Outside work I enjoy football, gaming, and exploring new tech.

LinkedIn GitHub Contact Mumbai, India

Core Skills

  Data Engineering
ETL / ELTBatch PipelinesReal-Time PipelinesMedallion ArchitectureCDCData Modeling
  Cloud & Platform
AzureADLSSynapseDatabricksAzure FunctionsCosmos DBUnity CatalogDelta Lake
  Programming
PythonPySparkSQLC#.NET Core
  APIs & Streaming
REST APIsReal-Time ProcessingOCR IntegrationDatabricks Workflows
  Governance & Ops
Access ControlCost OptimizationCluster PoliciesELK StackWorkspace Mgmt (50+ users)
  Tools
Databricks WorkflowsAzure Synapse PipelinesMarket EDMELK StackGit

Proficiency

Python & PySpark90%
Azure & Databricks88%
SQL & Data Modeling85%
Delta Lake & Medallion Architecture85%
REST APIs & Azure Functions80%
C# & .NET Core75%
Platform Governance & Unity Catalog78%
ETL Pipeline Design88%

Certifications & Achievements

Microsoft Certified: Azure Data Engineer Associate
Microsoft — DP-203
Official Cert
Kudos Award
Tata Consultancy Services — September 2018
Award
Python Django — Dev to Deployment
Udemy
Course
Build Responsive Website Using HTML5, CSS3, JS & Bootstrap
Udemy
Course
Python A-Z: Learn Python by Building 10 Projects
Udemy
Course
Python REST APIs with Flask, Docker, MongoDB & AWS DevOps
Udemy
Course

Experience & Education

ICICI Lombard General Insurance

Sep 2022 — Present

Mumbai — BFSI Domain

Lead Data Engineer · Apr 2025 – Present
Senior Data Engineer · Apr 2024 – Mar 2025
Senior Developer · Sep 2022 – Mar 2024
  • Led development of enterprise Data Lake & real-time integration platform on Azure + Databricks.
  • Automated OAF regulatory calculation — reduced processing time from 7 days to ~2 days, enabling daily, MTD & YTD refresh.
  • Designed ingestion architecture for 30+ sources with Bronze/Silver medallion layers.
  • Built Customer Eligibility API: CDC datasets → Cosmos DB → Azure Function APIs for mobile apps.
  • Migrated scoring from batch (15-min) to near real-time across 9 business features with OCR validation.
  • Databricks platform owner — 50+ user workspace, Unity Catalog & cost governance.
AzureDatabricksDelta LakeSynapseCosmos DBPythonPySparkREST APIsUnity Catalog

Tata Consultancy Services (TCS)

Nov 2018 — Sep 2022

Mumbai — System Engineer / Assistant System Engineer

  • Data & application support using SQL for data correction and reconciliation.
  • Enhanced a shared C# logging framework across multiple production applications.
  • Implemented ELK Stack for centralized log monitoring and analytics.
  • Transitioned to Data Analytics — built ETL pipelines using Python and Market EDM.
  • Migrated legacy ETL jobs to a .NET Core-based framework.
SQLPythonC#ELK Stack.NET CoreETLMarket EDM

Software Development Intern

2017 – 2018 · 3 months

Tata Consultancy Services — Gandhinagar

Built a full-stack CRUD web application using Java and Spring Framework — first exposure to enterprise software development and team collaboration.

JavaSpring FrameworkCRUD

B.E. in Computer Engineering

2014 — 2018

Birla Vishwakarma Mahavidyalaya (BVM) — Anand, Gujarat

Strong foundation in data structures, algorithms, OS, and software engineering. Final year project: Android application development.

Computer EngineeringAndroidAlgorithms

Primary Education

Up to 2014

Jeevan Bharti School — Surat, Gujarat

Completed primary and secondary education with a focus on science and mathematics.