Staff Engineer - Backend (Data Quality)

We are seeking a highly experienced Staff Engineer to join our team and lead the development for Atlan’s Data Quality module. This is a 0-1 initiative that will play a critical role in enhancing data quality and data contracts within our platform. An ideal candidate will bring prior experience with solution architecture along with building Data SaaS products/ platforms.

What will you do? 🤔

• Architect, design, and implement backend systems for the new Data Quality module, focusing on data quality and data contracts (ODCS).
• Develop and standardize frameworks for integrating Atlan connectors with Data Quality tools (e.g., Soda, Monte Carlo, Anomalo, etc) to ensure seamless data integration and metadata synchronization.
• Enhance the developer experience by improving tools, libraries, and processes for internal and external engineers.
• Optimize backend systems to improve user experience for customers, ensuring the system is reliable, scalable, and user-friendly.
• Mentor junior engineers, providing guidance on best practices and helping them grow technically.
• Maintain high standards of code quality through reviews, testing, and continuous integration.
• Work closely with cross-functional teams to deliver features and enhancements that align with the product roadmap.
• Drive innovation within the backend team by staying updated with the latest technologies and industry trends.

What makes you a great match for us? 😍

• Proven data & Backend engineering experience, with a track record of building scalable systems and integrating with data quality and profiling tools.
• Prior experience as a customer-facing solutions architect is highly preferred.
• Experience contributing to open-source projects is highly preferred.
• Experience with Data Quality tools such as Soda, Monte Carlo, or Anomalo is preferred.
• Exposure to Data Contracts (ODCS) is advantageous.
• Hands-on experience with Java, Deequ, Spark, and Kafka.
• Experience with search stores like Elastic, Solr, or Typesense is a plus.
• Understanding of Data Lineage is a significant advantage.
• Strong problem-solving skills and the ability to drive complex technical projects from inception to completion.