Cloud Data Engineer (Azure)

About Us:

Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital Transformation.

We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc.

Our team comprises 120+ professionals across Machine Learning, Data Engineering & Cloud expertise

*Job Summary: *

As a Cloud Data Engineer, you will be responsible for integrating data sources, building, managing &
orchestrating data pipelines in cloud-based data platforms (e.g. Azure).
Need to have significant Knowledge of cloud-based data platforms (e.g., AWS, Azure, GCP) and its native services e.g., Azure Data Lake, Data Integration Pipelines (Azure Data Factory), Data bricks, SQL/NoSQL, Serverless Compute services like Azure Functions, Azure Container Apps, Azure Kubernetes Services etc.
with focus on building analytics initiatives for the enterprise.
Hands on experience in implementing ETL/ELT pipelines using any open-source distributed environment framework (e.g., Apache SPARK) or cloud-based data platforms.
Strong programming skillset, knowledge of cloud platforms, ability to solve service integration challenges and implement robust cloud-based systems.
Work closely with cross-functional teams to understand business requirements and translate them into scalable and efficient cloud solutions.
Maintaining, updating, and refining technical specifications and design documentation.

*Skills and Qualifications: *

Required Technical and Professional Expertise:
4-5 years of experience in Data Engineering in Cloud.
Build scalable, robust & secure cloud-native applications and services using modern cloud platforms, such as, Azure
Collaborate with stakeholders to gather and analyze business requirements and translate them into
technical specifications and design documents.
Write clean, efficient, and maintainable code in languages such as Python (PySpark) following best
practices and design patterns.
Should have an in-depth knowledge & hands on experience with Data structures & Algorithms, Object
Oriented Programming etc.
Utilize AWS & Azure specific services and technologies, such as Azure Data Factory, Data bricks, Azure Data Lake Storage, serverless compute services like Azure Functions, Azure Container Apps, Azure Kubernetes Services to build scalable and flexible applications.
Integrate with various data storage solutions, including databases, data warehouses, and object storage, to manage and process large datasets.

**** Skills and Qualifications: ****

Implement security controls and best practices to ensure the confidentiality and integrity of data in the cloud.
Perform thorough functional/unit testing and debugging of applications and services to ensure they meet quality standards and functional requirements.
Stay up to date with emerging cloud technologies, trends, and best practices, and recommend innovative solutions to enhance the development process.
Demonstrated experience working in an Agile Environment.

Preferred Technical and Professional Expertise:
Bachelor's degree in computer science, software engineering, or a related field (or equivalent work
experience).
Proven experience working as a Data Engineer/Cloud Developer or in a similar role, with a focus on
developing cloud-native applications.
Strong proficiency in Python, SQL, PySPARK and at least one programming language, such as Java or C#.
Hands-on experience with cloud platform services & tools, such as Azure.

Understanding concepts of databases, data lake, data warehouse and data storage technologies, such as SQL, NoSQL, and object storage.
Application development in serverless compute resources like Azure Functions, Azure Container Apps, Azure Kubernetes Services etc.
Strong problem-solving and analytical skills, with the ability to debug and troubleshoot complex issues in a distributed cloud environment.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Relevant certifications, such as Associate or Azure Developer Associate, are highly desirable.