Senior/ Lead Data Engineer

Role Overview:

The Senior Data Engineer will have deep hands-on experience in data engineering concepts and will work extensively with AWS and GCP.

Key Responsibilities:

● Design, develop, and maintain scalable data pipelines and ETL processes.
● Collaborate with data scientists and analysts to understand data requirements.
● Optimize data architecture for performance and cost-efficiency.
● Implement data governance and security measures.
● Provide technical guidance and mentorship to junior data engineers.
● Ensure data quality and reliability across the organization.

Qualifications:

● Bachelor’s degree in Computer Science, Engineering, or related field.
● 7+ years of experience in data engineering.
● Strong proficiency in AWS and GCP cloud services.
● Over 1-2 years of hands-on experience in a programming language such as Python, Java, or Scala.
● Database Skills: A strong understanding of SQL is essential.
● Big Data Technologies: Proficiency with Hadoop, Hive, Yarn, and Sqoop.
● Data Pipeline & Scheduler Tools: Hands-on experience with Oozie, Airflow, or Nifi.
● Streaming Engines: Knowledge of Kafka, Storm, or Spark Streaming.
● Database and ETL: Experience with any relational database or data warehouse, as well as ETL tools.
● Pipeline Design & Application Development: Practical experience in pipeline design, ETL processes, and application development.
● Ability to work in a dynamic, young environment with intercultural aspects.