Avatar for Programmers.io
Your Extended Team

Data Platform Engineer - AI

  • Redmond
  • |Full Time
Posted: 4 weeks ago
Job Location
Redmond
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
.NET
C#
SQL Server
Git
Authentication
Data Warehousing
REST APIs
ETL
Spark
Docker
Microsoft Azure
Data Governance
Data Modeling
Data Quality
Microservices
Kubernetes
Elt
authorization
Pyspark
ASP.NET Core
Data Reconciliation
Azure Functions
Kusto
Azure Data Factory
Entity Framework Core
CI/CD
Cosmos DB
Azure DevOps
Azure Databricks
Azure Key Vault
Delta Lake
Azure SQL
Azure Data Explorer
Azure Synapse Analytics
Azure Monitor
Service Bus
Application Insights
ADLS Gen2
Event Hubs
Medallion Architecture
Lakehouse Architecture

About the job

We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure.

Key Responsibilities:

Data Platform & Engineering:

  • Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.
  • Develop large-scale data processing using Azure Databricks, Spark/PySpark, Azure Synapse, and Azure Data Factory.
  • Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers

Backend Services & Integration:

  • Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
  • Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
  • Implement microservices and event-driven processing patterns with secure authentication and authorization.

Modernization & Reliability

  • Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
  • Support platform and data migrations while ensuring functional and data parity.
  • Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights

Cloud, DevOps & Technical Leadership

  • Build and maintain CI/CD pipelines using Azure DevOps and Git.
  • Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.
  • Support Docker and Kubernetes/AKS-based workloads where applicable.

Mandatory Skills:

Data Engineering

  • Azure Databricks, Spark/PySpark
  • Azure Synapse Analytics, Azure Data Factory
  • ADLS Gen2, Delta Lake
  • SQL Server / Azure SQL
  • Cosmos DB, Kusto / Azure Data Explorer
  • ETL/ELT, Data Warehousing & Data Modeling
  • Lakehouse / Medallion Architecture
  • Data Quality, Reconciliation & Governance

Backend & Services

  • C#, .NET / ASP.NET Core
  • REST APIs & Microservices
  • Azure Functions
  • Event Hubs & Service Bus
  • Entity Framework Core
  • Authentication & Authorization

Cloud & DevOps

  • Microsoft Azure
  • Azure DevOps, Git & CI/CD
  • Azure Monitor & Application Insights
  • Azure Key Vault
  • Docker / Kubernetes

Good to Have

  • React or Angular, TypeScript
  • GraphQL
  • Power BI
  • Infrastructure as Code
  • SRE / Production Support experience
  • AI/ML or AI-enabled analytics exposure