Senior Data Engineer

We are seeking a Senior Data Engineer with strong expertise in Databricks, Python, ETL, SQL, and Data/Financial Modeling to design, build, and operate scalable data pipelines and lakehouse data products. The role will support data-driven capabilities across device supply chain, reverse logistics, procurement, network supply chain, and real-time control tower initiatives.

The ideal candidate will have hands-on experience building production-grade data solutions in large enterprise environments and working across data ingestion, transformation, modeling, validation, and delivery

Primary Skills: Databricks, Python

Secondary Skills: Data Engineering, ETL, SQL, Azure Data Factory, Salesforce, Data/Financial Modeling

Key Responsibilities

• Design, develop, and maintain production-grade data pipelines covering source ingestion, Bronze landing, Silver transformation, and Gold-layer data products.
• Implement Medallion Architecture (Bronze, Silver, Gold) and follow established data product development and certification standards.
• Develop scalable data engineering solutions using Databricks, Python, SQL, Azure Data Factory, and related Azure data technologies.
• Collaborate with System Analysts, Data Scientists, Product Managers, and business stakeholders to translate requirements into robust data solutions.
• Implement field-level transformations, business rules, data validation, and data quality checks based on product requirements.
• Perform data wrangling, profiling, cleansing, and transformation to create reliable datasets for analytics and downstream applications.
• Develop and maintain data and financial models that support business reporting, analytics, forecasting, and decision-making.
• Analyze source systems and perform ad-hoc SQL queries to validate data and troubleshoot pipeline issues.
• Build and optimize ETL/ELT processes for performance, scalability, reliability, and cost efficiency.
• Collaborate with cross-functional teams to understand business objectives and deliver data solutions that provide measurable business value.
• Support data product releases, testing, deployment, and production operations.
• Document data pipelines, transformation logic, data models, business rules, and other technical artifacts.
• Identify opportunities to improve data quality, pipeline performance, automation, and overall engineering efficiency.

Required Qualifications

• 5–10 years of experience in Data Engineering with a strong track record of delivering production-grade data solutions.
• 5+ years of IT experience with Python, including data processing, automation, and pipeline development.
• Strong hands-on experience with Databricks and modern data engineering practices.
• Strong expertise in ETL/ELT and SQL, including data transformation, validation, troubleshooting, and source-system analysis.
• 7+ years of experience with Azure Data Factory or comparable pipeline orchestration technologies.
• Experience working with Salesforce data and integrating Salesforce with enterprise data platforms.
• Strong understanding of Data Modeling, including dimensional modeling and data structures supporting analytics and financial use cases.
• Experience with Microsoft Fabric or Azure Synapse Analytics is highly desirable.
• Familiarity with Microsoft Fabric, OneLake, and Fabric IQ is a plus.
• Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, or Apache Airflow.
• Strong understanding of data warehousing, lakehouse architecture, data quality, and data governance.
• Experience working in large enterprise environments with cross-functional business and technology teams.

Preferred Qualifications

• Experience with Microsoft Fabric and OneLake.
• Knowledge of Fabric IQ certification standards and enterprise data product practices.
• Experience supporting supply chain, procurement, logistics, finance, or related business domains.
• Exposure to Machine Learning/AI data pipelines and collaboration with Data Scientists or ML Engineers.
• Experience optimizing large-scale data pipelines for performance and cost.
• Experience with cloud-based data platforms and modern lakehouse architectures.

Education & Certifications

• Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, Data Science, or a related field preferred.
• Certifications: Not required.

ABOUT BRICKRED SYSTEMS

BrickRed Systems is a global leader in next-generation technology consulting and workforce solutions, specializing in delivering high-quality talent across digital, engineering, marketing, analytics, finance, operations, and business transformation domains. With a strong emphasis on innovation, scalability, and client success, BrickRed Systems helps organizations solve complex business challenges by providing skilled professionals across strategy, technology, creative, and operational functions. BrickRed fosters a culture of continuous learning, collaboration, and excellence, enabling professionals to contribute to high-impact global initiatives while advancing their careers.