Avatar for Valuemomentum Software Services
Hiring for the Product development team
  • B2B
  • Scale Stage
    Rapidly increasing operations

Data Engineer Lead

Posted: 2 weeks ago
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
SQL
DevOps
ADF
Pyspark
Azure SQL DB
CI/CD
Datalake
Azure Databricks
ADLS
Data Factory
Synapse

About the job

At ValueMomentum’s Technology Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise.

About the job

We are seeking a Tech Lead – Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volumes of data, building complex ETL solutions, and working closely with business teams to deliver robust data transformations and analytics solutions.

Responsibilities:

  • Design and develop ETL pipelines using ADF for data ingestion and transformation.
  • Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
  • Write SQL, Python, and PySpark code for efficient data processing and transformation.
  • Understand and translate business requirements into technical designs.
  • Develop mapping documents and transformation rules as per project scope.
  • Communicate project status with stakeholders, ensuring smooth project execution.

Requirements Must have:

  • 10-12 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
  • Hands-on experience with Azure services: ADLS, Azure Databricks, Data Factory, Synapse, Azure SQL DB.
  • Experience in SQL, Python, and PySpark for data transformation and processing.
  • Familiarity with DevOps and CI/CD deployments.
  • Strong communication skills and attention to detail in high-pressure situations.
  • Experience in the insurance or financial industry is preferred.

About ValueMomentum:

ValueMomentum is a leading solutions provider for the global property and casualty insurance industry, supported by deep domain and technology capabilities. We help insurers stay ahead with sustained growth and high performance for enhancing stakeholder value and fostering resilient societies. Trusted by over 100 insurers, ValueMomentum is one of the largest services providers exclusively focused on property and casualty. ValueMomentum is headquartered in Piscataway, NJ, with state-of-the-art delivery centres in Piscataway, NJ; Hyderabad, Pune, and Coimbatore in India; Toronto in Canada; and London in the United Kingdom.

ValueMomentum is an Equal Opportunity Employer committed to fostering a diverse and inclusive workplace. We make all employment decisions based on qualifications, merit, and business needs, without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, protected veteran status, genetic information, or any other characteristic protected by applicable federal, state, or local law. We are also committed to providing reasonable accommodation for qualified individuals with disabilities and applicants throughout the recruitment process, in accordance with applicable laws.

Similar Jobs

Coast company logo
Coast
Coast is re-imagining B2B payments, beginning with fleet and fuel
Scale AI company logo
Scale AI
Accelerate the development of AI applications
Treater company logo
Treater
Treater helps consumer goods brands sell more into retail
Super company logo
Super
Super is the AI assistant for property management
Rocket Money company logo
Rocket Money
The Money App That Works for You
Crosby company logo
Crosby
AI-native law firm that combined AI & lawyers to redefine the speed of legal services