Avatar for Infinitive
Infinitive is a Data and AI consultancy

Solution Architect, Delivery (Databricks)

  • $140k – $210k
  • |
  • |8 years of exp
  • |Full Time
Posted: 6 days ago
Job Location
Remote Work Policy

In office - WFH flexibility

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
SQL
Caching
Tableau
Azure
Gitlab
S3
AWS
Terraform
Dimensional Modeling
Pyspark
Data Vault
Airflow
Power BI
GCP
DBT
MLFlow
Azure DevOps
GitHub Actions
Delta Lake
Structured Streaming
GCS
Feature Store
Vector Search
ADLS Gen2
Reverse ETL
Unity Catalog
Medallion Architecture
Data Observability
RAG Pipelines
Databricks SQL
Delta Sharing
Serverless Compute
Cloud IAM
Databricks Workflows
Private Endpoints
Cloud Object Storage
Delta Live Tables (DLT)
Auto Loader
VPC Networking
Z-Ordering
Partitioning Strategies
Spark Performance Tuning
Databricks Data Intelligence Platform
Query Execution Plans
VNet Networking
Cluster Policies
Databricks Certified Data Engineer Professional
Entra ID Integration
Databricks Model Serving
Autoscaling Rules
Databricks Asset Bundles (DABs)
Compute Governance
Databricks Certified Machine Learning Professional
Apache Spark Optimization
Delta Performance Tuning
Photon Engine Configurations
Auto-Termination Rules
Chargeback Tagging Models
Showback Tagging Models

About the job

About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.

Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 9 times most recently in 2026. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”

Role Overview:

The Solution Architect, Delivery is a premier technical leadership role responsible for the architecture, design, and end-to-end technical delivery of complex Lakehouse and Data Intelligence Platform solutions. Operating at the apex of solution design and hands-on execution, the DSA bridges client executive vision with production-grade engineering reality.

In this role, you will lead the technical vision across multi-cloud environments (AWS, Azure, GCP), architect scalable data pipelines and governance frameworks, and guide engineering pods through intricate technical migrations. The solution Architect works closely with client enterprise architects, Databricks partner engineering, and Infinitive delivery teams to ensure every implementation adheres to modern performance, security, cost-efficiency, and architectural governance standards.

Key Responsibilities:

Technical Architecture & Solution Design

  • Lakehouse Architectural Ownership: Design enterprise-scale, production-ready Lakehouse solutions leveraging the Databricks Data Intelligence Platform, Medallion Architecture (Bronze/Silver/Gold), Delta Lake, and Databricks SQL
  • Unified Governance & Security: Architect and configure enterprise security and governance models using Unity Catalog, row/column-level filtering, data masking, attribute-based access controls (ABAC), and Delta Sharing
  • Legacy Modernization & Migration: Lead architectural strategy and technical execution for migrating legacy enterprise data warehouses and Hadoop platforms (e.g., Teradata, Netezza, Snowflake, Cloudera) to Databricks
  • Modern Ingestion & Processing: Define patterns for both batch and low-latency streaming workloads utilizing Structured Streaming, Delta Live Tables (DLT), Auto Loader, and Apache Spark optimization techniques

Hands-On Technical Leadership & Governance

  • Technical Oversight & Code Quality: Lead engineering pods by example—establishing reference architectures, conducting architectural reviews, reviewing pull requests, and standardizing CI/CD pipelines (GitHub Actions, GitLab, Azure DevOps) using Terraform and Databricks Asset Bundles (DABs)
  • Performance Tuning & Optimization: Diagnose and resolve complex Spark and Delta performance bottlenecks, optimizing query execution plans, partitioning strategies, Z-Ordering, caching, and Photon engine configurations
  • FinOps & Cost Observability: Establish compute governance best practices, designing cluster policies, auto-termination/autoscaling rules, serverless compute configurations, and chargeback/showback tagging models to optimize DBU consumption
  • AI & Advanced Analytics Enablement: Partner with Machine Learning and AI engineers to integrate MLflow, Feature Store, Databricks Model Serving, and Vector Search/RAG pipelines into core data platforms

Client Advisory & Partner Engagement

  • Technical Advisory & Strategy: Act as the primary technical authority and trusted advisor to client Chief Architects, Directors of Engineering, and CDOs, leading technical workshops, architectural design sessions (ADS), and proof-of-concept (POC) evaluations
  • Databricks Ecosystem Alignment: Collaborate directly with Databricks Partner Solutions Architects (PSAs) and field engineering to evaluate preview features, adopt cutting-edge platform capabilities, and ensure best-practice alignment
  • Practice IP & Thought Leadership: Harvest repeatable architectural blueprints, reference architectures, migration accelerators, and boilerplate configurations to enrich Infinitive’s intellectual property library

Required Experience & Technical Skills

  • Architectural Experience: 8+ years in data architecture, data engineering, or enterprise software development, with at least 3+ years architecting enterprise solutions centered on Apache Spark and the Databricks Data Intelligence Platform
  • Certifications:

  • Databricks: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional

  • Cloud Platform Mastery: Deep architectural proficiency in at least one major cloud platform (AWS, Azure, or GCP), including VPC/VNet networking, private endpoints, cloud IAM/Entra ID integration, and cloud object storage (S3/ADLS Gen2/GCS)

  • Data Modeling & Governance: Mastery of modern data modeling methodologies (dimensional modeling, Data Vault, Medallion design) and hands-on production experience implementing Unity Catalog across multi-workspace environments

  • Coding & Automation: Advanced programming skills in Python, PySpark, and SQL, alongside production experience with Infrastructure as Code (Terraform) and orchestrators (Databricks Workflows, Airflow)

  • Delivery Leadership: Proven background leading technical delivery teams, breaking down complex functional requirements into architectural blueprints and user stories, and resolving critical delivery blockers

Preferred Qualifications & Certification

  • Modern Data Stack Integrations: Hands-on experience integrating Databricks with BI tools (Power BI, Tableau), reverse ETL, dbt, or data observability platforms
  • Security & Compliance: Experience delivering architectures compliant with enterprise regulatory frameworks (HIPAA, HITRUST, SOC2, FedRAMP)
  • Clearance: Active Public Trust or Secret clearance (or eligibility to obtain) for regulated/public sector client engagements is a plus

Infinitive is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $140,000 - $210,000.

Infinitive is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law.