Principal Data Engineer

$150k – $190k
|
Scottsdale
|8 years of exp
|Full Time

Posted: yesterday• Recruiter recently active

Job Location

Scottsdale

Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed

Skills

Amazon S3

Pyspark

Amazon Athena

AWS Glue

About the job

Principal Data Engineer

Pay: $150,000 to $190,000 per year

Location: Scottsdale, AZ 85258

Type: Full-time

Hours: 8:00 AM to 4:30 PM

Entity: XpertDox, Inc.

Department: Data

On-site or remote: On-site, Monday through Friday

Reports to: Chief Operating Officer

About XpertDox

XpertDox, Inc. is a physician-founded, venture-backed healthcare AI company headquartered in Scottsdale, Arizona, with a global delivery team in India. Our platform, XpertCoding, autonomously codes outpatient medical claims directly from clinical documentation using neural networks, machine learning, and natural language processing. We serve outpatient healthcare organizations in almost all 50 states, with deep expertise in Federally Qualified Health Centers (FQHCs), women’s health and OB/GYN practices, and behavioral health providers.

Position Summary

You will own the move of our data from a batch-oriented, file-based environment to an AWS lakehouse, and you will own the data platform that results. The target architecture is Apache Iceberg tables on Amazon S3, queried through Amazon Athena, with AWS Glue handling ETL and cataloging. This is a hands-on role: you will design the architecture, build the critical components yourself, and set the standards the data team follows. Our analytics team’s current pipelines remain the upstream source for the data you structure, and our self-serve analytics platform depends on the data layer you deliver. This role is not for someone who has designed a lakehouse but has never carried a production migration through to completion.

Key Responsibilities

In this role you will:

Own the design and execution of the lakehouse migration, from source ingestion through the query and reporting layer.
Design schema, partitioning, and table layout that hold up across many client datasets with varying structure.
Build and harden ETL pipelines in AWS Glue and PySpark, including upsert and merge logic, scheduling, failure handling, and monitoring.
Own data governance, access control, retention, and quality standards for protected health information (PHI).
Set and enforce engineering standards for the data platform: code review, testing, deployment, documentation, and cost management.
Own the data layer requirements for the self-serve analytics platform, so it supports natural-language querying and reporting.
Define and own the handoff between the analytics team’s existing batch outputs and the lakehouse.
Provide technical leadership and mentorship to data engineering and analytics staff.

Required Qualifications

Led at least one production migration from legacy or file-based systems to a data lake or lakehouse architecture, carried through to completion.
Deep hands-on experience with AWS Glue, Athena, and S3.
8+ years in data engineering or data platform roles, with demonstrated ownership of architecture decisions.
Experience making architecture decisions with incomplete information.

Preferred Qualifications

Strong working knowledge of open table formats, with Apache Iceberg preferred (Delta Lake or Apache Hudi also relevant), and columnar storage formats such as Parquet.
Strong Python and SQL skills; PySpark experience strongly preferred.
Experience designing for multi-tenant or multi-client data where schemas vary across sources.
Experience with data governance and security in a regulated environment.

Location and Schedule

This is an on-site role at our Scottsdale, Arizona headquarters, Monday through Friday, 8:00 AM to 4:30 PM. It is not remote or hybrid. Candidates who live outside the Scottsdale area must relocate before their start date. No travel is required. The role works with protected health information; all staff complete HIPAA training and follow XpertDox data security policies.

Compensation