Data Engineering Lead

Job Title: Data Engineering Lead – Snowflake, dbt, Python

Experience: 8–12 Years

Location: Remote USA

Role Overview

We are looking for a skilled Data Engineering Leadwith 8–12 years of strong hands-on experience in building enterprise-scale data platforms for Mastek's healthcare, Retail and Banking clients.

This role is the primary onsite technical point of contact for the Client Project Manager and business stakeholders during the mobilization and architecture phase of the engagement. You will lead onsite requirements gathering workshops and create architecture, data models, and dbt-based transformation design that the offshore delivery team will build against. You will work closely with source-system owners and guide the offshore engineering pod on ingestion, medallion-layer design, and semantic modeling standards.

Key Responsibilities

• Act as the onsite Data Engineering Lead for Client, working directly with the Client Project Manager and business SMEs to gather, clarify, and document data and reporting requirements.
• Lead onsite architecture and design workshops for the Raw, Staging/Curated, and Semantic data layers.
• Translate business and functional requirements into a production-ready Snowflake solution blueprint, data standards, and source-to-target mappings.
• Design and review scalable data pipelines and transformation workflows using dbt (Snowflake Managed dbt), Python, and Snowflake, in coordination with the offshore delivery team.
• Define ingestion and integration patterns across NextGen (Secure Data Share), NexTech, PODIS, QuickBooks, and RealTime (API-based and Snowpipe Streaming) sources.
• Establish dbt modeling standards — models, macros, testing, and documentation — to implement business calculations, KPI logic, and data quality validations.
• Optimize Snowflake data models, warehouses, and queries for performance, cost, and scalability across large, multi-domain datasets.
• Define and enforce data quality, validation, and reconciliation frameworks across ingestion and curated layers.
• Guide and mentor the offshore Data/AI Engineering team on architecture decisions, coding standards, and pipeline orchestration best practices.
• Support design of the semantic layer and certified KPI framework that will feed Streamlit reporting and Snowflake Intelligence (Cortex AI, Cortex Analyst, Cortex Search).
• Maintain clear, structured documentation of requirements, architecture decisions, data flows, and pipeline designs for handoff and governance.
• Track open items, risks, and dependencies from onsite discovery sessions and communicate them promptly to the Mastek delivery and project management team.

Required Skills & Qualifications

• 8–12 years of hands-on experience in Data Engineering, including experience leading requirements discovery and solution design for enterprise data platforms.
• Experience leading a team of data engineers
• Strong expertise in Snowflake — data warehousing, medallion architecture (Raw/Staging/Curated/Semantic), performance tuning, and cost optimization.
• Strong hands-on expertise in dbt (Data Build Tool), including models, macros, testing frameworks, and documentation; experience with Snowflake Managed dbt is a strong plus.
• Strong expertise in Python for data ingestion, orchestration, validation, and transformation pipelines.
• Solid understanding of SQL and data modeling concepts (star schema, dimensional modeling, conformed dimensions).
• Experience with API-based data integration and incremental/change-based extraction patterns.
• Demonstrated experience gathering and documenting requirements directly with business stakeholders, ideally in an onsite/client-facing capacity.
• Experience with data pipeline orchestration tools (Airflow or similar).
• Familiarity with data quality, testing, and validation frameworks.
• Strong communication, facilitation, and stakeholder-management skills; comfortable leading workshops and guiding an offshore delivery team.
• Strong problem-solving and analytical skills.

Preferred Qualifications

• Experience in one or more domains - healthcare, life sciences, retail or banking
• Exposure to Snowflake Cortex AI, Cortex Analyst, Cortex Search, or Streamlit-based reporting applications.
• Experience working in cloud environments (AWS, Azure, or GCP).
• Familiarity with CI/CD practices for data pipelines.
• Exposure to real-time or streaming data pipelines (e.g., Snowpipe Streaming).
• Experience in enterprise-scale, multi-source data platform implementations.