Senior Software Engineer - Platform

At Atlan, we are both proud and humbled by the fact that we are building products that power data teams in more than 50 countries around the world, ranging from small startups to Fortune 500 giants. Our products form the very backbone of our users, have become a part of their daily workflows and directly impact their success.In the past decade, products like GitHub helped companies build great engineering cultures. At Atlan, we are on a quest to help build winning data teams of the future. Every line of code we write, every feature we add, every pixel we create—everything we do—is to help data teams around the world do their lives’ best work.

Let’s show the world how it’s done!

We are currently hiring an experienced Senior Software Engineer with expertise in building distributed systems in Java leveraging Cassandra & Elastic Search. This role requires prior experience building data platforms focusing on ingestion, storage & consumption for both batch & streaming data.

Familiarity with optimizing Elastic Search instances for search query & latency and event consumption, Kafka cluster management is a big plus.

What will you do? 🤔

• Metadata Consumption Optimization: Spearhead efforts to reduce search and graph lookup times to sub-second latency, enhancing the overall performance of our platform.
• Storage & Consistency Enhancement: Optimize storage mechanisms and consistency protocols for handling large datasets efficiently and reliably.
• Background Tasks Management: Develop robust solutions for managing resource-intensive background tasks, ensuring smooth operation of our systems under heavy workloads.
• Metadata Ingestion Systems: Lead the design and implementation of systems capable of ingesting millions of data assets per hour, supporting the seamless integration of diverse datasets into our platform.
• Technical Mastery: Rapid familiarity with our codebase and technical stack, coupled with active contributions to ongoing projects.
• Leadership: Assume a leadership role on a core project, providing mentorship to junior engineers and driving innovative solutions.
• Subject Matter Expertise: Become a recognized Subject Matter Expert (SME) in a critical area, making significant contributions to the performance and scalability of our platform.

What makes us a match? 😍

• Design and Implementation Skills: Proven ability to design and implement complex distributed systems, coupled with a strong grasp of architectural principles.
• Backend Services Development: Experience in building highly scalable and reliable backend services, with a focus on performance optimization and fault tolerance.
• Problem-solving Abilities: Strong analytical and problem-solving skills, with a knack for tackling challenging technical issues.
• Communication: Excellent written and verbal communication skills, essential for effective collaboration within cross-functional teams.
• Collaborative Mindset: A collaborative team player with a growth mindset, eager to learn, share knowledge, and contribute to collective success.