Lead Data Engineer - Data Automations

At Klaviyo, we love tackling tough engineering problems and look for engineers who specialize in certain areas but are passionate about building, owning & scaling features end to end from scratch and breaking through any obstacle or technical challenge in their way. We push each other to move out of our comfort zone, learn new technologies and work hard to ensure each day is better than the last.

Team Overview:

Klaviyo operates a real-time data analytics platform coded primarily in Python that is built for massive scale and hosted on Amazon Web Services (AWS). The Data Automation team builds tooling that helps our Data Platform engineers provision and test infrastructure to power core Klaviyo functionality and generate data-driven insights.

As a founding member on the Data Automation team, you will have ownership over defining the evolutionary, technical vision for our data automation suite. You will be responsible for the design, implementation of frameworks that help us operate our mission critical analytics infrastructure.

Team Tech Stack:

• Python
• Clickhouse
• Spark
• Flink
• Airflow
• Kafka
• DynamoDB
• MySQL
• Kubernetes
• AWS

How You'll Make a Difference

• Wholly owning the framework that enables us to provision, update, test, monitor, and scale infrastructure to power features that 50,000+ customers rely on daily to reach 4B+ consumers to drive their business forward.
• Working on facilitating and optimizing infrastructure for teams that own Klaviyo’s analytics system that provides insight through hundreds of terabytes of data.
• Responsible for coaching engineers, managing/reviewing technical documentation and articulating a phased approach to achieving the team's overall technical vision.
• Be responsible for the mission, technical direction and operations of projects that have immediate impact.
• Contributing to the company as a subject matter expert in multiple areas, constantly pushing yourself to be a better engineer and to level up all of your peers within your team and within Klaviyo.

Who You Are

• Solid 10+ years of experience in the SRE/Devops field with specific experience in data processing systems
• 3+ years of experience in a Tech Lead role
• BA or BS Degree in Computer Science, related field, or equivalent experience
• Ability to handle yourself in outage situations and to drive failures to root cause analysis and prevention of future issues
• Understanding of Linux (we run Ubuntu) and all layers of the networking stack
• Experience working on an engineering team building software
• Experience writing code using best practices in a language such as Python, Ruby, Go, etc.