Senior Software Development Engineer- Data Engineering

About the Role:
As an engineer specializing in Data Engineering, you will be an integral part of our fast-paced
team. You will work closely with senior engineers to design, implement, and optimize data
pipelines and systems using cutting-edge open-source tools. This role offers the opportunity to
contribute directly to key projects, learn from experienced team members, and take on
increasing responsibilities as you grow within the team.

Key Responsibilities:
● Data Pipeline Development:
○ Assist in designing and building scalable ETL/ELT pipelines using tools.
○ Participate in the development and maintenance of data processing workflows,
ensuring data accuracy and reliability.
○ Collaborate with the team to implement real-time and batch data solutions that
meet business requirements.
● Open-Source Tool Integration:
○ Contribute to the integration and optimization of open-source data engineering
tools.
○ Work on integrating and managing databases to support various applications.
○ Stay engaged with new developments in open-source technologies and bring
innovative ideas to the team.
● Collaboration and Learning:
○ Work closely with senior engineers and data scientists to understand data
requirements and translate them into technical solutions.
○ Engage in code reviews, pair programming, and team discussions to
continuously improve your skills and contribute to the team’s success.
○ Actively participate in team meetings and share your insights to help solve
technical challenges.
● System Monitoring and Improvement:
○ Monitor the performance of data systems and pipelines, identifying and
addressing any issues proactively.
○ Contribute to the ongoing optimization of data systems for better performance,
scalability, and cost-efficiency.
○ Help implement best practices in data governance, security, and documentation.

*Education: *

Bachelor’s degree in Computer Science.

Experience:
○ 3-5 years of experience in software development and data engineering.
○ Hands-on experience with open-source data pipeline tools.
○ Strong programming skills in languages like NodeJs, Golang and Java.
○ Proficiency in SQL and experience with both relational and NoSQL databases.

Skills:
○ Solid understanding of data warehousing concepts, ETL processes, and data
modeling.
○ Experience with CI/CD pipelines, containerization, and orchestration tools.
○ Strong problem-solving skills and a willingness to learn and adapt in a dynamic
environment.
○ Excellent communication skills, with the ability to work collaboratively in a
fast-paced, team-oriented environment.

Preferred Qualifications:
● Experience in operating with self-hosted infrastructure across all major cloud platforms.
● Participation in or contributions to open-source projects.
● Exposure to data visualization tools and techniques.

Tech Stack:
● Data Processing & Streaming: Apache Kafka, Apache Flink
● Orchestration: Apache Airflow
● Data Storage: Apache Iceberg, MySQL, PostgreSQL, MongoDB, TiDB, Redis
● Search & Analytics: Elasticsearch, Druid
● Query Engines: Trino
● Infrastructure: Docker, Kubernetes, CI/CD pipelines
● Cloud Platforms: AWS, GCP, Azure

Why Join Us?
● Work in a fast-paced, agile environment with the opportunity to have a significant impact
on the company's data infrastructure.
● Be at the forefront of leveraging open-source technologies to solve complex data
challenges.
● Enjoy a collaborative, inclusive work culture that encourages continuous learning and
innovation.
● Benefit from a competitive salary and comprehensive benefits package.