Cloud Data Engineer

Description

• We are looking for 2021 and later graduates

• Above position is expected to implement Data Orchestration -Data Transformation and Data integration using MS Azure services (including Databricks).

• Data Extraction, Transformation, Loading are main responsibilities considering enterprise data management for data lakes and data warehouses.

• MS Azure Data Engineer (MS Certified) is preferred.

Responsibilities

• Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios

• Manage Azure DevOps pipelines

• Develop batch processing, streaming and integration solutions

• Automate Azure Data Factory pipelines

• Manage source data access security

• Configure authentication and authorization

• Manage and enforce data policies and standards

• Monitor databases and data processing for a specified scenario

• Implement big data real-time processing and integration solutions

Basic Qualifications

• Education: B.E./M.Sc./M.E./M. Tech.

• Minimum 2 Years in Azure Data Engineering

Knowledge & Skills

• Very strong @ SQL-PL SQL-Spark SQL.

• Interaction with No SQL Databases

• Interaction with Event Hub, IoT Hub Databases

• Files Processing – XML, CSV, Excel, Jason, etc. Formats

• Structured and Non-Structured Data processing

• Data ETL Capabilities

• Knowledge of Distributed Big Data Processing

• Data Warehouse and Data Lake Implementation experience in past

• Interaction with REST APIs , Web Services

Required Competencies

• Customer Focus

• Good verbal & written English communication

• Ability to work with globally diverse teams

• Readiness to work in flexible work timings

• Abstract& Analytical Thinking

• An interpersonal savvy. A very good team player

• Nimble learning. Willingness to explore and adapt