Senior/Lead Azure Data Engineer

Job Description

Job Description

We are seeking a highly skilled Senior/Lead Azure Data Engineer to design, develop, and optimize large-scale cloud-based data solutions on Microsoft Azure. The ideal candidate will have strong expertise in Azure Data Factory (ADF), Azure Databricks, PySpark, and Autosys, with hands-on experience building scalable data pipelines, data transformation frameworks, and enterprise-grade data platforms.

The candidate will collaborate with business stakeholders, architects, and development teams to deliver high-performance data solutions that support analytics, reporting, regulatory, and operational requirements.

Key Responsibilities

• Design, develop, and maintain scalable data ingestion and transformation pipelines using Azure Data Factory (ADF).
• Build and optimize data processing solutions using Azure Databricks and PySpark.
• Develop and maintain batch and near real-time data integration workflows.
• Implement data quality, validation, reconciliation, and monitoring frameworks.
• Schedule, monitor, and troubleshoot jobs using Autosys and cloud-native orchestration tools.
• Design and implement robust ETL/ELT solutions leveraging Azure cloud services.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Collaborate with Data Architects and Solution Architects to define enterprise data models and standards.
• Support production deployments, incident management, and performance tuning activities.
• Ensure adherence to security, governance, and compliance standards.
• Mentor junior engineers and provide technical leadership for project delivery.
• Participate in code reviews, architecture discussions, and best practice implementation.

Required Qualifications

• Bachelor’s or master’s degree in computer science, Information Technology, Engineering, or related field.
• 8+ years of experience in Data Engineering and Data Warehousing.
• 5+ years of experience with Azure Data Platform technologies.

• Strong hands-on experience with:

• Azure Data Factory (ADF)

• Azure Databricks

• ADLS

• MYSQL

• PySpark

• SQL

• Autosys

• Experience designing and implementing ETL/ELT frameworks.

• Strong understanding of distributed computing and Spark architecture.

• Experience working with large-scale structured and semi-structured datasets.

• Proficiency in Python and SQL programming.

• Experience with source control tools such as Git/Azure DevOps.

Mandatory Skills: DataBricks - Data Engineering

Experience: 5-8 Years

The expected compensation for this role ranges from CAD 77000 to CAD 120000 .

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.

Wipro is committed to creating an accessible, supportive, and inclusive workplace. Reasonable accommodation will be provided to all applicants including persons with disabilities, throughout the recruitment and selection process. Accommodations must be communicated in advance of the application, where possible, and will be reviewed on an individual basis. Wipro provides equal opportunities to all and values diversity.