Avatar for Infinite Analytics
Infinite Analytics
Actively Hiring
Consumer Insights AI Platform
  • Growing fast
    Showed strong hiring growth in the past month

Senior Big Data Engineer - multiple positions

  • ₹15L – ₹25L • 0.1% – 0.5%
  • 5 years of exp
  • Full Time
Reposted: 1 month ago
Visa Sponsorship

Available

Remote Work Policy

In office

RelocationAllowed
Skills
Python
Java
Scala

About the job

We are seeking an Senior Big Data Engineers to join our team immediately who can design, develop, maintain, and implement large-scale data processing systems for the Sherlock platform. In this role, you will work closely with cross-functional teams such as data scientists, software engineers, business analysts, and product managers to ensure the successful implementation and scaling of our data infrastructure.
As an ideal candidate, you must have a deep understanding of big data technologies and best practices and the ability to work with large amounts of data from various sources. One of the key skills required for this role is the ability to understand existing solutions and debug performance issues. This means being able to identify bottlenecks in the system, analyze the root cause of performance issues, and implement solutions to improve system efficiency.

Responsibilities:
• Design, develop, and implement large-scale data processing systems using Big Data technologies such as Spark, Cassandra, and Kafka
• Develop data pipelines for data ingestion, transformation, and storage
• Develop and maintain data models and database schemas for structured and unstructured data
• Identify bottlenecks in the system, analyze the root cause of performance issues, and implement solutions to improve system efficiency
• Implement data security and access control measures to ensure the confidentiality, integrity, and availability of data
• Develop and maintain data quality and validation frameworks to ensure the accuracy and completeness of data
• Develop and maintain monitoring and alerting systems to proactively identify and address data processing issues
• Work closely with data scientists, software engineers, business analysts, and product managers to understand data requirements and design solutions that meet their needs
• Continuously evaluate and implement new Big Data technologies and frameworks to improve the performance, scalability, and reliability of our data infrastructure
• Ensure compliance with data privacy regulations such as GDPR and CCPA

Requirements:
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
• 5+ years of experience in Big Data engineering or a related field
• Strong programming skills in one or more languages such as Python, Java or Scala
• Strong experience with Big Data technologies such as Spark, Cassandra, and Kafka
• Strong experience with data modeling and database design for structured and unstructured data
• Strong experience with data processing and ETL frameworks such as Apache NiFi, Airbyte, or Apache Beam
• Strong experience with data security and access control measures
• Strong experience with data quality and validation frameworks
• Experience with monitoring and alerting systems for Big Data technologies
• Experience with cloud-based Big Data platforms such as Databricks, AWS EMR or Google Cloud Dataproc
• Excellent communication and collaboration skills with the ability to work effectively in a cross-functional team environment

This Big Data Engineer position provides an exciting opportunity to work with cutting-edge Big Data technologies and design scalable data processing systems. You will have the opportunity to work closely with data scientists, software engineers, and product managers to deliver innovative data-driven solutions that solve our customers' toughest challenges.

Hiring Process

  1. Fill this candidate form and submit your details
  2. Submit your resume to [email protected]
  3. HR team will review the resume and schedule an Intro call
  4. Once we match you with a role, we will ask you to complete an assignment to test your hands on skills
  5. Tech Interview
  6. HR Interview
  7. Reference check
  8. Offer ***Salary commensurate with experience and grade/range

Start exploring career options at Infinite Analytics by completing steps #1 and #2 today!

Good luck!

About the company

Infinite Analytics company logo

Infinite Analytics

Actively Hiring
Consumer Insights AI Platform11-50 Employees
Company Size
11-50
Company Industries
Artificial Intelligence / Machine Learning
  • Growing fast
    Showed strong hiring growth in the past month
Learn more about Infinite Analytics image

Funding

AMOUNT RAISED
Undisclosed amount
FUNDED OVER
1 round
Round
S
Undisclosed amount
Seed - Mar 2022

Founders

Purushotham Botla
Founder • 3 years
image
Akash Bhatia
Founder • 3 years
image
View the team image

Similar Jobs

LogiNext company logo
LogiNext
SaaS for Delivery and Transportation Business
SuperTokens company logo
SuperTokens
SuperTokens (YC S20) is building open source user authentication
Rockmetric company logo
Rockmetric
Intelligent AI-powered Business Analytics Platform
Fintricity company logo
Fintricity
We're a venture studio, providing consulting and building ventures, and helping scaleups
Vistaar Digital Communications Jobs company logo
Vistaar Digital Communications Jobs
Digital Technology Agency looking for bright minds to grow together