Azure Data Platform Engineer

Posted: 3 days ago• Recruiter recently active
Job Location
Remote Work Policy

In office - WFH flexibility

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
SQL
Git
Pyspark
RBAC
CI/CD
Azure Databricks
Delta Lake
Azure Monitor
Vector Search
Blob Storage
App Service
Key Vault
Unity Catalog
Container Registry
Functions
Service Principals
Managed Identities
Embedding Pipelines
ADLS Storage
Azure SQL DB for Postgres

About the job

Job Title: Azure Data Platform Engineer

Location: San Jose, CA (Hybrid)

Duration: 12 Months with possibility of extension

Contract Type: W2 Only

Intelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and Talent solutions. We specialize in delivering world-class Digital Product Engineering, Data Management and Analytics, and Staffing Solutions services to Fortune companies, SMBs, ISVs, and fast-growing startups.

Job Description

We are looking for a Cloud & Data Engineer to help build, optimize, and operate our Voice of Customer (VoC) AI Platform.

The platform ingests structured and unstructured data from multiple enterprise sources with varying degrees of signal-to-noise ratio and is primarily built on Microsoft Azure, with data processing and ETL/ELT workloads powered by Azure Databricks.

This is a hands-on role spanning data engineering, cloud infrastructure, and platform reliability

Key Responsibilities

Data Engineering

  • Build and maintain ETL/ELT pipelines for structured and unstructured data sources.
  • Develop data-processing workloads using Azure Databricks, Python/PySpark, and SQL.
  • Optimize Databricks jobs, compute, and data layouts for performance and cost.
  • Work with Delta Lake and Unity Catalog for data storage, governance, and access control.
  • Implement data quality checks, monitoring, error handling, and recovery mechanisms.

Cloud & Platform Engineering

  • Build, operate, and optimize Azure services including App Service, Functions, Blob/ADLS storage, Azure SQL DB for Postgres, Key Vault, Container Registry and Azure Monitor.
  • Experience with cloud AI services including vector search and embedding pipelines.
  • Improve platform performance, scalability, reliability, security, and cost efficiency.
  • Implement secure identity, and access management using Azure managed identities, Key Vault, secrets managed via scopes.
  • Support development, staging, and production environments.

Automation & Operations

  • Improve platform observability through logging, monitoring, dashboards, and alerting.
  • Automate infrastructure and deployments using Infrastructure as Code (IaC) and CI/CD.
  • Troubleshoot issues across cloud services, storage, databases, networking, and data pipelines.
  • Support production incidents and root-cause analysis.
  • Collaborate with application, AI/ML, and data engineering teams.

Required Qualifications

  • 3–5 years of experience in data engineering, cloud engineering, or a related role.
  • Hands-on experience with Microsoft Azure, Databricks, APIs, and object storage.
  • Strong skills in Python/PySpark, SQL.
  • Experience building and operating production data ETL/ELT pipelines.
  • Experience with relational and semi-structured/unstructured data, database technologies.
  • Experience with Spark, Delta Lake, and lakehouse architectures.
  • Working knowledge of Databricks Unity Catalog and data-access controls.
  • Understanding of cloud security concepts such as RBAC, managed identities, service principals, and Key Vault.
  • Experience with Git, CI/CD, monitoring, troubleshooting, and performance optimization.

Preferred Qualifications

  • Experience with Terraform or ARM templates.
  • Experience with Azure DevOps or GitHub Actions.
  • Familiarity with Azure networking, including VNets and private endpoints.
  • Experience with Azure Data Factory, Databricks Workflows, or Airflow.
  • Familiarity with data platforms supporting AI/ML, NLP, analytics, or GenAI applications.

Equal Employment Opportunity Statement

Intelliswift celebrates a diverse and inclusive workforce. We offer equal employment opportunities to all applicants and employees. All qualified applicants will be considered regardless of race, color, sex, gender identity, gender expressions, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other protected basis under the law.

Americans with Disabilities Act (ADA)

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please contact Intelliswift Human Resources Department

Other Employment Statements

Intelliswift participates in the E-Verify program.

Learn More

For information on Intelliswift Software, Inc., visit our website at www.intelliswift.com.

Similar Jobs

tribe.ai company logo
tribe.ai
We embed elite AI engineers to ship real, production-grade AI for enterprises
FEITIAN Technologies US company logo
FEITIAN Technologies US
Certified identity authentication and payment security hardware and software, worldwide
Adeia company logo
Adeia
Tech research firm accelerating innovative technology adoption
Adeia company logo
Adeia
Tech research firm accelerating innovative technology adoption