Azure Cloud Data Engineer

Job Description

Mandatory Skills & Requirements

• Strong knowledge of Microsoft Azure services, cloud architecture, and cloud computing.
• Experience with Azure data services, including:Azure Data Factory (ADF)
• Azure Databricks
• Azure Synapse Analytics
• Azure SQL Database
• Azure Data Lake Storage (ADLS)
• Strong programming skills in Python, PySpark, Spark, SQL, Scala, Java, and Hive.
• Experience designing, developing, and maintaining scalable data pipelines.
• Knowledge of Azure Virtual Machines, Azure Storage, and Azure Networking.
• Experience with Infrastructure as Code (IaC) using ARM templates or Terraform.
• Proficiency in PowerShell, Python, or similar scripting languages.
• Understanding of DevOps practices, CI/CD pipelines, and cloud security best practices.
• Strong problem-solving, analytical thinking, and attention to detail.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Azure SQL Database, and Synapse Analytics.
• Design, implement, and manage cloud-based applications and infrastructure.
• Develop Infrastructure as Code to automate cloud resource provisioning and management.
• Create and maintain scripts for automation and deployment.
• Monitor and optimize cloud resources for performance and cost efficiency.
• Collaborate with DevOps and security teams to implement secure and scalable cloud architectures.
• Troubleshoot and resolve issues related to Azure services, data pipelines, and infrastructure.

Preferred Qualifications

• Microsoft Azure certifications, such as AZ-104 or AZ-303.
• Experience with cloud infrastructure automation and management.
• Strong communication, adaptability, and teamwork skills.