In office
Not Available
About the job
Senior Azure Databricks EngineerJersey City, NJ | Onsite | Local Candidates Only | Contract | W2 / 1099 OnlyPosition OverviewImportant: Local candidates only. This is an onsite position in Jersey City, NJ.Our client has recently signed a Databricks contract and is launching a major implementation initiative. The team is looking to add consultant to support this effort. The organization currently operates primarily on-premises and plans to invest in its cloud strategy and maturity over the coming years. The consultant will work in a large enterprise environment and collaborate with application development, infrastructure, cloud, security, architecture, and data teams. Key Responsibilities· Develop, optimize, and support data processing and ETL/ELT pipelines using Databricks, Apache Spark, Python, PySpark, SQL, and/or Java.· Work hands-on across the Databricks ecosystem, including Databricks Workspace, Unity Catalog, Delta Lake, Spark UI, and MLflow.· Build and support solutions on Microsoft Azure, particularly Azure Databricks, Azure Data Lake Storage Gen2 (ADLS Gen2), and Azure Data Factory.· Troubleshoot and performance-tune Spark workloads and data processing pipelines.· Configure and support Databricks workflows, job orchestration, monitoring, production troubleshooting, and performance optimization.· Contribute to DevOps and MLOps practices using Git, CI/CD pipelines, OpenShift, Kubernetes, and Terraform or other Infrastructure as Code (IaC) tools.· Collaborate with enterprise application, infrastructure, cloud, security, architecture, and data teams to support implementation and cloud-maturity initiatives.· Support reliable production operations and help resolve data pipeline and platform issues.Required Skills and Experience· Strong hands-on experience across the Databricks ecosystem: Databricks Workspace, Unity Catalog, Delta Lake, Spark UI, and MLflow.· Strong development experience with Python, PySpark, SQL, and/or Java.· Experience developing and optimizing data processing and ETL/ELT pipelines.· Strong Microsoft Azure experience, especially Azure Databricks, ADLS Gen2, and Azure Data Factory.· Experience developing, troubleshooting, and tuning Apache Spark workloads.· Experience with Databricks workflows, job orchestration, monitoring, troubleshooting, performance optimization, and production support.· Experience with Git and CI/CD pipelines.Preferred Skills· AWS experience, including S3 and IAM.· Experience with OpenShift and Kubernetes.· Experience with Terraform and Infrastructure as Code (IaC).· Exposure to DevOps and MLOps practices in a large enterprise environment.Engagement Details· Location: Jersey City, New Jersey | Local candidates only· Work arrangement: Onsite· Engagement: Long term Contract· Submission type: W2 / 1099 onlyInterested candidates may share their updated resume for consideration.
About the company
Similar Jobs









