Senior Data Engineer, Data Platform

Tronic is at the forefront of transforming how enterprises connect with their customers. We specialize in advanced brand loyalty and customer engagement solutions, leveraging data-driven insights to build meaningful, lasting customer relationships. Our platform is designed to handle large-scale data across multiple touchpoints, providing businesses with deep analytics and actionable insights.

We’re looking for a Senior Data Engineer who will play a pivotal role in managing our data platform and analytics infrastructure. This role is critical in ensuring the reliability, performance, and scalability of our data ecosystem, which powers our loyalty and customer engagement solutions for enterprises across industries like retail, hospitality, and consumer goods.

What You’ll Do:

As a Senior Data Engineer, you will oversee the data architecture, data pipeline performance, and scalability of our customer data platform. You will work closely with the engineering, analytics, and product teams to design and maintain the infrastructure for data pipelines, data lakes, and large-scale OLAP databases.

• Design, deploy, and manage OLAP databases at scale (e.g., ClickHouse, Amazon Redshift, Snowflake, Postgres) for high-performance analytics across large data volumes.

• Implement and optimize event streaming pipelines using Kafka to process and manage real-time data streams.

• Manage and scale Elasticsearch clusters for efficient indexing and retrieval of large datasets.

• Ensure data governance and schema management practices are followed to maintain data quality, security, and compliance.

• Develop and maintain data lake architectures using AWS technologies like Amazon S3 and AWS Glue, ensuring efficient ingestion, storage, and retrieval of customer data from multiple sources.

• Collaborate with product teams to define data schema and manage schema evolution to support new features and analytics.

• Ensure the availability, security, and performance of the data platform, monitoring key performance metrics, and proactively addressing any issues.

• Automate infrastructure and data pipeline deployments using Terraform, AWS CloudFormation, or Ansible.

• Implement backup, disaster recovery, and failover procedures for mission-critical data systems using AWS services like Amazon RDS, AWS Backup, and AWS Lambda.

• Assist in building data governance frameworks, ensuring compliance with privacy regulations (e.g., GDPR, CCPA) and industry standards.

• Support and optimize SQL and NoSQL databases to meet high-volume, high-velocity data processing needs.

• Collaborate with engineering and data science teams to ensure efficient data flow and integration across systems.

Our Tech Stack:

• OLAP Databases: ClickHouse, Amazon Redshift, Snowflake, Postgres for high-performance analytics.

• Event Streaming: Kafka for real-time data ingestion and processing.

• Search and Indexing: Elasticsearch for scalable search and analytics on large datasets.

• Data Pipelines: Apache Spark, AWS Glue, and Airflow for data orchestration and transformation.

• Cloud Infrastructure: AWS with core services including Amazon S3, EC2, EKS (Kubernetes), AWS Lambda, RDS, Amazon Redshift, DynamoDB, and CloudFormation for cloud orchestration.

• Automation Tools: Terraform, Ansible, AWS CloudFormation, and Docker for automating infrastructure provisioning and deployments.

• CI/CD Pipelines: Managed using GitHub Actions, Jenkins, and CircleCI.

• Data Governance & Compliance: Implementing industry best practices for data security, privacy, and schema evolution.

What We’re Looking For:

We’re seeking an experienced Data Engineer who is passionate about data architecture and scalability and who has extensive experience managing data platforms for customer analytics.

• Proven experience designing and managing OLAP databases at scale, with a deep understanding of their performance and query optimization.

• Expertise in managing and scaling event streaming pipelines with Kafka or similar tools.

• Experience deploying and optimizing Elasticsearch for search and analytics across large data volumes.

• Solid understanding of data governance and schema management, with experience implementing data security, privacy, and compliance frameworks (e.g., GDPR, CCPA).

• Hands-on experience managing data lake architectures using AWS technologies like Amazon S3, AWS Glue, and Lambda, and implementing scalable, performant ETL pipelines.

• Strong knowledge of SQL and NoSQL databases and how to optimize them for high-throughput and low-latency operations.

• Familiarity with Terraform, Ansible, Docker, and Kubernetes for managing and automating cloud infrastructure.

• Experience with cloud platforms (AWS preferred) and managing infrastructure as code.

• Ability to collaborate with cross-functional teams, including engineering, product, and data science teams, to ensure the smooth operation of the data platform.

• Strong problem-solving skills and the ability to think strategically about long-term data architecture and governance.

• Passion for data analytics, with an understanding of how to build scalable systems that support high-volume customer analytics and insights.

What We Offer:

At Tronic, we believe in fostering a culture of innovation and collaboration. We provide a dynamic environment where you can grow your career and work on cutting-edge technologies that impact millions of users.

• The opportunity to work on large-scale, complex data platforms that drive business insights for global brands.

• Competitive salary and equity options, ensuring you're rewarded for your contributions to our success.

• Remote work opportunities with flexible hours to maintain a healthy work-life balance.

• Comprehensive health, dental, and vision insurance.

• Generous and flexible time off policies.

• A team-first culture where your ideas and expertise are valued, and you can make a direct impact on the future of our platform.

If you’re passionate about building and scaling high-performance data platforms and want to work with some of the best minds in the industry, join Tronic and help us shape the future of customer data and analytics.