Data Engineer
- 1 year of exp
- Full Time
Not Available
In office
About the job
Role and responsibilities
As a Data Engineer at CBR, you will architect and implement data pipelines to collect, store, and deliver data to various stakeholders. Responsibilities include:
- Data Pipeline Construction: Design and build data pipelines, ensuring a smooth data flow from multiple sources to a data lakehouse.
- Data Quality Assurance: Implement data cleaning and validation processes to enhance data accuracy and consistency.
- Scalability: Design scalable systems that can handle large volumes of data.
- ETL (Extract, Transform, Load) or ELT Processes: Transform raw data into a structured format as well as implement automated standardized calculations and transformations.
- Data Security: Collaborate with Data Security engineers to implement data security measures.
Key Skills and Qualifications:
Technical skills:
- Proficiency in Python and SQL, version control (Git), and Linux OS tools.
- Fluency in relational databases (e.g., PostgreSQL, MySQL) and related schema design, and object storage systems e.g. MinIO.
- Fluency with ETL tools such as Apache Nifi or Apache Airflow.
- Familiarity with big data technologies like Kafka, Hadoop, and Spark, and cloud technologies Docker and Kubernetes.
- Familiarity with mathematics, statistics, and algorithms needed for data science and analytics is a bonus.
Soft skills: Quick learner with the ability to pick up on new technologies and tools, strong communication skills, and maturity to self-manage task delivery.
Educational Background: Strong foundation in CS, EE, Physics, Mathematics, or a related field. A bachelor's degree is the minimum requirement.
Experience: Junior (1-2 yrs)
Expected start date
Jan 1 – Feb 1, 2025
Benefits
A competitive salary, commensurate with the qualifications and experience of the candidate, will be offered. The contract duration will be 2 years, extendable up to 4 years depending on performance.
Application procedure
Interested candidates should send their CV and a cover letter (~500 words) to jobs[at]cbr-iisc[dot]ac[dot]in (with ‘Application for DevOps Engineer position’ in the email subject line) on or before Dec 05, 2024.
Only shortlisted candidates will be contacted. CBR reserves the right to fill the vacancy only if suitable candidates are found.