Data Platform Engineer - AI
- Redmond
- |Full Time
Posted: 4 weeks ago
Job Location
Redmond
Remote Work Policy
In office
Visa Sponsorship
Not Available
RelocationAllowed
Skills
.NET
C#
SQL Server
Git
Authentication
Data Warehousing
REST APIs
ETL
Spark
Docker
Microsoft Azure
Data Governance
Data Modeling
Data Quality
Microservices
Kubernetes
Elt
authorization
Pyspark
ASP.NET Core
Data Reconciliation
Azure Functions
Kusto
Azure Data Factory
Entity Framework Core
CI/CD
Cosmos DB
Azure DevOps
Azure Databricks
Azure Key Vault
Delta Lake
Azure SQL
Azure Data Explorer
Azure Synapse Analytics
Azure Monitor
Service Bus
Application Insights
ADLS Gen2
Event Hubs
Medallion Architecture
Lakehouse Architecture
About the job
We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure.
Key Responsibilities:
Data Platform & Engineering:
- Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.
- Develop large-scale data processing using Azure Databricks, Spark/PySpark, Azure Synapse, and Azure Data Factory.
- Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers
Backend Services & Integration:
- Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
- Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
- Implement microservices and event-driven processing patterns with secure authentication and authorization.
Modernization & Reliability
- Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
- Support platform and data migrations while ensuring functional and data parity.
- Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights
Cloud, DevOps & Technical Leadership
- Build and maintain CI/CD pipelines using Azure DevOps and Git.
- Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.
- Support Docker and Kubernetes/AKS-based workloads where applicable.
Mandatory Skills:
Data Engineering
- Azure Databricks, Spark/PySpark
- Azure Synapse Analytics, Azure Data Factory
- ADLS Gen2, Delta Lake
- SQL Server / Azure SQL
- Cosmos DB, Kusto / Azure Data Explorer
- ETL/ELT, Data Warehousing & Data Modeling
- Lakehouse / Medallion Architecture
- Data Quality, Reconciliation & Governance
Backend & Services
- C#, .NET / ASP.NET Core
- REST APIs & Microservices
- Azure Functions
- Event Hubs & Service Bus
- Entity Framework Core
- Authentication & Authorization
Cloud & DevOps
- Microsoft Azure
- Azure DevOps, Git & CI/CD
- Azure Monitor & Application Insights
- Azure Key Vault
- Docker / Kubernetes
Good to Have
- React or Angular, TypeScript
- GraphQL
- Power BI
- Infrastructure as Code
- SRE / Production Support experience
- AI/ML or AI-enabled analytics exposure
