- Scale StageRapidly increasing operations
In office - WFH flexibility
Not Available
About the job
About the jobThe Wissen team continues to expand its footprint in the USA, Canada, UK, Australia, and India. More openings to come as we continue to grow the team!Please read below for a brilliant career opportunity.Role: Senior Databricks EngineerTitle: AVP/VPLocation: Boston (Day 1 Onsite/Hybrid) Work type - Fulltime & C2H(6 Months)Mode of Work: 3 days/week onsite requiredRequired Experience: 10+ yearsJob Overview:We are seeking an experienced Senior Databricks Engineer with 10+ years of experience in data engineering, cloud platforms, and DevOps practices. The ideal candidate will have strong hands-on expertise in Azure Databricks, Python, Terraform Enterprise (TFE), and Infrastructure as Code (IaC). The candidate will be responsible for designing, developing, deploying, and maintaining scalable data engineering solutions and cloud-based data platforms.Key ResponsibilitiesDesign, develop, and maintain scalable data processing and analytics solutions using Azure Databricks.Develop and optimize data pipelines using PySpark, Python, and SQL.Build and maintain ETL/ELT workflows for batch and streaming data processing.Integrate Databricks with Azure services, including Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Key Vault, and Azure DevOps.Implement and manage CI/CD pipelines for automated deployment of Databricks notebooks, jobs, workflows, and configurations.Use Terraform Enterprise (TFE) to provision and manage Azure and Databricks infrastructure.Implement Infrastructure as Code (IaC) practices using reusable Terraform modules and standardized deployment processes.Automate infrastructure provisioning, configuration, and operational tasks using Python and scripting.Optimize Spark jobs, cluster configurations, data partitioning, and performance for large-scale data processing.Implement data security, access controls, secrets management, and governance using appropriate Azure and Databricks capabilities.Monitor, troubleshoot, and resolve issues related to data pipelines, cluster performance, and infrastructure deployments.Collaborate with architects, data engineers, DevOps teams, and business stakeholders to deliver reliable data solutions.Perform code reviews, establish engineering best practices, and mentor junior team members.Required Technical SkillsAzure Databricks: Strong hands-on experience with Databricks architecture, notebooks, jobs, workflows, clusters, and lakehouse solutions.Python: Proficiency in Python scripting, automation, and data processing.PySpark and Spark SQL: Strong experience developing and optimizing distributed data processing applications.Microsoft Azure: Experience with Azure Data Lake Storage (ADLS Gen2), Azure Data Factory, Azure Key Vault, Azure networking, and identity management.DevOps and CI/CD: Experience implementing automated build, testing, and deployment pipelines using Azure DevOps, GitHub Actions, Jenkins, or similar tools.Terraform Enterprise (TFE): Experience managing Terraform workspaces, state, modules, variables, and infrastructure deployments.Infrastructure as Code (IaC): Strong understanding of infrastructure provisioning, reusable modules, configuration management, and environment standardization.SQL and Data Engineering: Strong knowledge of data modeling, ETL/ELT processes, data quality, and pipeline orchestration.Version Control: Experience with Git-based development and collaborative code management.Benefits:Healthcare insurance for you and your family (medical, dental, vision).Short / Long term disability insurance.Life Insurance.Accidental death & disability Insurance.401K.3 weeks of Paid Time Off.Support and fee coverage for immigration needs.Remote office set up stipend.Support for industry certifications.Additional cash incentives.Re-skilling opportunities to transition between technologies.Schedule: Monday to FridayWork Mode: HybridJob Type: Full-timeWe are: A high end technical consulting firm built and run by highly qualified technologists. Our workforce consists of 5000+ highly skilled professionals, with leadership from Wharton, MIT, IITs, IIMs, and NITs and decades of experience at Goldman Sachs, Morgan Stanley, MSCI, Deutsche Bank, Credit Suisse, Verizon, British Telecom, ISRO etc. Without any external funding or investments, Wissen Technology has grown its revenues by 100% every other year since it started as a subsidiary of Wissen Group in 2015. We have a global presence with offices in the US, India, UK, Australia, Mexico, and Canada.You are: A true tech or domain ninja. Or both. Comfortable working in a quickly growing profitable startup, have a “can do” attitude and are willing to take on any task thrown your way.You will:Develop and promote the company’s culture of engineering excellence.Define, develop and deliver solutions at a top tier investment bank or another esteemed client.Perform other duties as neededYour Education and Experience:We value candidates who can execute on our vision and help us build an industry-leading organization.Graduate-level degree in computer science, engineering, or related technical fieldWissen embraces diversity and is an equal opportunity employer. We are committed to building a team that represents a variety of backgrounds, skills, and abilities. We believe that the more inclusive our team is, the better our work will be. All qualified applicants, including but not limited to LGBTQ+, Minorities, Females, the Disabled, and Veterans, are encouraged to apply.About Wissen Technology:The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for diverse industries, including Banking, E-commerce, Telecom, Healthcare, Manufacturing, and Energy. We help clients build world-class products. We have offices in the US, India (Bangalore, Hyderabad, Chennai, Gurugram, Mumbai, Pune), UK, Australia, Mexico, Vietnam, and Canada.We empower businesses with a dynamic portfolio of services and accelerators tailored to today’s digital demands and based on future ready technology stack. Our services include Industry Leading Custom Software Development, AI-Driven Software Engineering, Generative AI & Machine Learning, Real-Time Data Analytics & Insights, Interactive Data Visualization & Decision Intelligence, Intelligent Process Automation, Multi-Cloud & Hybrid Cloud Strategies, Cross-Platform Mobile Experiences, CI/CD-Powered Agile DevOps, Automated Quality Engineering, and cutting-edge integrations.Certified as a Great Place to Work® for five consecutive years (2020-2025) and recognized as a Top 20 AI/ML vendor by CIO Insider, Wissen Group has delivered multimillion-dollar projects for over 20 Fortune 500 companies. Wissen Technology delivers exceptional value on mission-critical projects through thought leadership, ownership, and reliable, high-quality, on-time delivery.Our industry-leading technical expertise stem from the talented professionals we attract. Committed to fostering their growth and providing top-tier career opportunities, Wissen ensures an outstanding experience and value for our clients and employees.We Value:Perfection: Pursuit of excellence through continuous improvement.Curiosity: Fostering continuous learning and exploration.Respect: Valuing diversity and mutual respect.Integrity: Commitment to ethical conduct and transparency.Transparency: Open communication and trust.Website: www.wissen.comGlassdoor Reviews: https://www.glassdoor.com/Reviews/Wissen-Reviews-E2587444.htmWissen Thought leadership: https://www.wissen.com/articles/Latest in Wissen in CIO Insider:https://www.cioinsiderindia.com/vendor/wissen-technology-setting-new-benchmarks-in-technology-consulting-cid-1064.htmlEmployee Speak:https://www.ambitionbox.com/overview/wissen-technology-overviewLinkedIn: https://www.linkedin.com/company/wissen-technologyAbout Wissen Interview Process:https://www.wissen.com/blog/we-work-on-highly-complex-technology-projects-here-is-how-it-changes-whom-we-hire/Wissen: A Great Place to Workhttps://www.wissen.com/blog/wissen-is-a-great-place-to-work-says-the-great-place-to-work-r-institute-indiahttps://www.wissen.com/blog/here-is-what-ownership-and-commitment-mean-to-wissenites/Wissen | Driving Digital TransformationA technology consultancy that drives digital innovation by connecting strategy and execution, helping global clients to strengthen their core technology.
About the company
- Scale StageRapidly increasing operations
Similar Jobs









