Azure Data Engineer

Responsibilities:

• Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services
• End to end development lifecycle of complex large-scale and multi-user applications
• Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios
• Big Data ETL considering enterprise data management for data lakes and data warehouses
• Data Orchestration -Data Transformation and Data integration using MS Azure services
• Develop batch processing, streaming and integration solutions
• Automate Azure Data Factory pipelines
• Manage and enforce data policies and standards
• Monitor databases and data processing for a specified scenario
• Implement big data real-time processing and integration solutions
• Manage Azure DevOps pipelines

Basic Qualifications:

• Education: B.E./M.Sc./M.E./M. Tech.
• 0-3 years in Azure Data Engineering

Knowledge & Skills:

• Very strong @ SQL-PL SQL-Spark SQL Scala PySpark
• Interaction with No SQL Databases
• Interaction with Event Hub, IoT Hub Databases
• Files Processing – XML, CSV, Excel, Jason, etc. Formats
• Structured and Non-Structured Data processing
• Data ETL Capabilities
• Knowledge of Distributed Big Data Processing
• Data Warehouse and Data Lake Implementation experience in past
• Interaction with REST APIs , Web Services

Required Competencies:

• Customer Focus
• Good verbal & written English communication
• Ability to work with globally diverse teams
• Readiness to work in flexible work timings
• Abstract & Analytical Thinking
• An interpersonal savvy. A very good team player
• Nimble learning. Willingness to explore and adapt

Certifications:

• MS Azure Data Engineer (MS Certified) is preferred