Team Lead / Solution Architect – (Databricks & Azure Migration)

Role: Team Lead / Solution Architect – (Databricks & Azure Migration)

Location: Grand Rapids, MI 49544

Position Type: Full-Time/Direct Hire (Preferred) or Long-term Contract

Experience Level: 8+ Years

Position Overview

Celebal Technologies is seeking a seasoned Team Lead / Solution Architect to spearhead a high-impact, enterprise-scale cloud transformation initiative. In this role, you will take ownership of migrating complex legacy data systems to a modern Databricks Lakehouse platform on Azure. The ideal candidate will combine strong hands-on engineering capabilities with strategic architectural vision to lead delivery teams and map robust data frameworks in a highly regulated environment.

Key Responsibilities

• Architecture & Design: Architect, design, and implement end-to-end data migration pipelines from legacy systems to Azure Databricks and Delta Lake.
• Technical Leadership: Lead, mentor, and provide technical governance to a team of data engineers, ensuring best practices in PySpark, Spark SQL, and Azure cloud infrastructure.
• Migration Strategy: Collaborate with business stakeholders and project managers to convert complex legacy data models into optimized cloud-native formats.
• Performance Optimization: Troubleshoot and resolve complex data engineering bottlenecks, including Spark tuning, memory optimization, and data governance frameworks.
• Compliance & Governance: Ensure all cloud data architectures meet strict enterprise data security, quality, and compliance standards.

Required Skills & Qualifications

• Experience: 8–15 years of proven IT experience with a heavy focus on data warehousing, big data, and cloud environments.
• Core Core Tech Stack: Advanced expertise in Azure Databricks, Delta Lake, Apache Spark, and cloud data architecture.
• Migration Track Record: Hands-on experience architecting and driving legacy-to-cloud data warehouse modernization projects.
• Cloud Ecosystem: Deep proficiency with Azure cloud services (ADLS Gen2, Azure Data Factory, Azure DevOps).
• Proximity: Must be locally based within Grand Rapids, MI (49544) or the immediate surrounding area for onsite delivery.