Data Engineer

Jade Business Services (JBS) is seeking a Senior Data Engineer – Microsoft Fabric to support enterprise-scale data engineering and transformation initiatives.

We are looking for a hands-on data engineering professional with strong expertise in Microsoft Fabric, SQL, Python/PySpark, data integration, and modern data platform engineering. The ideal candidate will build scalable data pipelines, implement data governance practices, optimize platform performance, and develop reliable, AI-ready data solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric, including OneLake, Lakehouse, Warehouse, and Data Factory.
• Implement scalable ETL/ELT processes for data ingestion, transformation, validation, and consumption.
• Develop and optimize data solutions using SQL, Python, and PySpark.
• Implement Medallion Architecture (Bronze, Silver, and Gold layers) and Lakehouse design patterns.
• Build and maintain reusable data models, semantic models, and datasets for analytics and Power BI.
• Develop and support Data Products aligned with business and domain requirements.
• Implement data quality checks, metadata management, lineage, and governance using Microsoft Purview.
• Apply Data Mesh and Data Fabric principles where appropriate.
• Implement CI/CD pipelines, deployment automation, monitoring, and DataOps best practices.
• Troubleshoot data pipeline failures, optimize query performance, and ensure platform reliability.
• Implement security, access controls, and data protection measures in line with enterprise standards.
• Identify opportunities to use AI and automation to improve data engineering and platform operations.
• Collaborate with architects, business stakeholders, and engineering teams to deliver reliable data solutions.
• Mentor junior data engineers and contribute to code reviews, technical documentation, and engineering standards.

Required Skills and Qualifications

• 9+ years of experience in data engineering, ETL/ELT development, or enterprise data platforms.
• Strong hands-on experience with Microsoft Fabric.
• Experience with OneLake, Fabric Lakehouse, Warehouse, and Data Factory pipelines.
• Strong SQL skills and experience with data modelling and performance optimization.
• Hands-on expertise in Python and/or PySpark.
• Strong understanding of Lakehouse architecture and Medallion Architecture.
• Experience building enterprise-scale data integration and transformation pipelines.
• Knowledge of data governance, metadata, lineage, and data quality.
• Working knowledge of Microsoft Purview.
• Experience with Git, CI/CD, monitoring, and production data operations.
• Understanding of cloud security, access controls, and data privacy.
• Strong troubleshooting, analytical, collaboration, and communication skills.

Preferred Skills

• Microsoft Fabric or Azure Data certifications.
• Experience migrating Azure Synapse, SQL Server, Databricks, or other data platforms to Microsoft Fabric.
• Experience implementing Data Mesh, Data Products, and domain-oriented data solutions.
• Exposure to AI/ML, Generative AI, or Agentic AI use cases.
• Experience in Energy & Utilities, Healthcare, Financial Services, or Insurance.
• Experience working with US or international enterprise clients.