Avatar for SparkCognition
SparkCognition
Actively Hiring
Transforming industries with AI and ML to solve big problems and make better decisions
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • Valuation $1B+
    This company has a valuation of $1B or more

Senior Data Engineer

Posted: 1 month ago
Visa Sponsorship

Not Available

RelocationAllowed

About the job

As a Senior Data Engineer, you will design, implement, and maintain large-scale, high-performance data infrastructure to support our AI models and analytics platforms. You’ll work with various data sources to create efficient, scalable data pipelines and ensure data quality, accessibility, and security. This role offers the chance to collaborate with data scientists, software engineers, and business stakeholders to influence data strategy and decision-making.

You Will:

  • Architect, build, and maintain robust, scalable data pipelines and ETL processes to handle large volumes of data.
  • Ensure high availability, reliability, and quality of data used across the company, optimizing pipelines for performance and scalability.
  • Collaborate with data scientists, engineers, and business stakeholders to define data requirements and design solutions that enable advanced analytics and AI models.
  • Lead the optimization of data processing workflows, storage solutions, and data models to improve efficiency and performance.
  • Develop and implement data governance strategies, ensuring data security, integrity, and compliance.
  • Mentor and guide junior data engineers and provide technical leadership in designing data architectures.
  • Troubleshoot complex data engineering challenges and drive continuous improvement in data practices.

You’ll Have:

  • A bachelor's or master’s degree in Computer Science, Information Systems, or a related field.
  • 5-10 years of experience in designing and maintaining large-scale data infrastructure and pipelines.
  • Strong expertise in SQL, data modeling, and experience with modern ETL frameworks.
  • Proven experience with cloud platforms like AWS, Google Cloud, or Azure, including data storage and processing tools (e.g., Redshift, BigQuery, Snowflake, Databricks).
  • Deep understanding of distributed systems, data architecture principles, and best practices for building data pipelines.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Strong problem-solving skills and experience optimizing data workflows for performance and scalability.
  • Experience with version control systems (e.g., Git), CI/CD pipelines, and orchestration tools like Airflow.
  • Excellent communication and collaboration skills, with a demonstrated ability to work with cross-functional teams.

About the company

SparkCognition company logo

SparkCognition

Actively Hiring
Transforming industries with AI and ML to solve big problems and make better decisions201-500 Employees
Company Size
201-500
Company Type
Artificial Intelligence
Company Industries
Renewable Energies
Company Industries
DOD/Military
Company Industries
Blockchains
Company Industries
Artificial Intelligence / Machine Learning
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • Valuation $1B+
    This company has a valuation of $1B or more
Learn more about SparkCognition image

Funding

AMOUNT RAISED
$318M
FUNDED OVER
5 rounds
Rounds
D
$123,000,000
Series D - Jan 2022+4

Similar Jobs

Spero Institute company logo
Spero Institute
Optimizing virtual intensive mental healthcare
Archesys company logo
Archesys
Improving the government services that impact everyday lives
MOLTEN Cloud company logo
MOLTEN Cloud
Multi-cloud SaaS arming digital rights holders with better operations to manage & monetize content
BigID company logo
BigID
Find what you need, when you need it. Data driven intelligence and inventory for your business