Senior Data Engineer

Job Title: Senior Data Engineer
Required Experience: 5+ years

We are looking for an experienced Senior Data Engineer to join our team. You will be responsible for large-scale data ingestion, cleaning, and standardization from diverse data sources into Microsoft SQL Server. The ideal candidate will have expertise in creating efficient data pipelines, writing complex stored procedures, and managing ETL processes using SSIS, Azure Data Factory, and Python. Experience with .NET C# is a plus. If you have a passion for working with large volumes of data, optimizing data performance, and working in cloud environments, this role is for you!

Key Responsibilities:

• Design, implement, and manage mass data ingestion processes into MSSQL Server from various data sources.
• Clean, transform, and standardize large data sets to ensure data integrity and consistency.
• Write and optimize complex stored procedures to process and clean data efficiently.
• Develop, deploy, and maintain ETL pipelines using SSIS and Azure Data Factory.
• Build and automate data pipelines using Python for continuous data integration and transformation.
• Collaborate with stakeholders to define and implement data quality standards and ensure adherence.
• Manage Azure cloud infrastructure to support scalable and efficient data processing.
• Create technical documentation and maintain data process flows.
• Leverage .NET C# (if applicable) for additional data processing and automation tasks.

Required Qualifications:

• 5+ years of experience as a data engineer working with large-scale data systems.
• Strong proficiency in Microsoft SQL Server, including expertise in writing and optimizing stored procedures.
• Hands-on experience with ETL tools, specifically SSIS and Azure Data Factory.
• Proficient in Python for data processing and pipeline creation.
• Experience in handling large volumes of data in a production environment.
• Solid understanding of data warehousing concepts and techniques.
• Azure cloud experience with data management, ingestion, and pipeline automation.
• Excellent problem-solving and analytical skills.
• Strong communication skills to work with cross-functional teams.

Nice to Have:

• Experience with .NET C# for building data solutions.
• Familiarity with Azure DevOps or other CI/CD pipelines.
• Knowledge of modern cloud data architecture and best practices.

Company Overview:
Aventior is a leading provider of innovative technology solutions for businesses across a wide range of industries. At Aventior, we leverage cutting-edge technologies like AI, ML Ops, DevOps, and many more to help our clients solve complex business problems and drive growth.
We also provide a full range of data development and management services, including Cloud Data Architecture, Universal Data Models, Data Transformation & and ETL, Data Lakes, User Management, Analytics and visualization, and automated data capture (for scanned documents and unstructured/semi-structured data sources). Our team of experienced professionals combines deep industry knowledge with expertise in the latest technologies to deliver customized solutions that meet the unique needs of each of our clients. Whether you are looking to streamline your operations, enhance your customer experience, or improve your decision-making process, Aventior has the skills and resources to help you achieve your goals.
We bring a well-rounded cross-industry and multi-client perspective to our client engagements. Our strategy is grounded in design, implementation, innovation, migration, and support. We have a global delivery model, a multi-country presence, and a team well-equipped with professionals and experts in the field.