Avatar for Tredence Analytics Solutions
Connect the dots
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • Valuation $500M+
    This company has a valuation of $500M or more

Lead Data Engineer

Posted: 1 week ago
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
SQL
Cloud Storage
DevOps
Spark
Google Cloud Platform
Big Query
Pyspark
Airflow
Dataproc
CI/CD
Pub/Sub
Cloud Composer

About the job

: Lead Data Engineer (GCP Dataproc & BigQuery)Location: Edison, NJ (Onsite)Employment Type: Full-TimeExperience Required: 10+ YearsPosition OverviewWe are seeking a highly skilled Lead Data Engineer with deep expertise in Google Cloud Platform (GCP), specifically Dataproc and BigQuery, to lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions. This is an onsite role based in Edison, NJ.The ideal candidate will possess strong technical leadership capabilities, exceptional communication skills, and a proven ability to solve complex data engineering challenges. This individual will work closely with business stakeholders, architects, data scientists, and engineering teams to deliver scalable, high-performance data solutions that drive business outcomes.Key ResponsibilitiesLead the design and implementation of large-scale data engineering solutions on GCP.Architect and develop robust ETL/ELT pipelines using Dataproc, BigQuery, and related GCP services.Build scalable data ingestion, transformation, and processing frameworks for structured and unstructured data.Optimize data models, query performance, and processing efficiency within BigQuery environments.Drive cloud migration and modernization initiatives from on-premise or legacy platforms to GCP.Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.Mentor and guide data engineers through code reviews, design discussions, and best practice adoption.Establish data quality, governance, security, and operational monitoring standards.Troubleshoot and resolve complex production issues while ensuring platform reliability and performance.Communicate effectively with technical and non-technical stakeholders, including executive leadership.Required Qualifications10+ years of experience in Data Engineering, Data Warehousing, or Big Data ecosystems.5+ years of hands-on experience with Google Cloud Platform (GCP).Strong expertise in:Google BigQueryGoogle DataprocCloud Storage (GCS)Cloud Composer / AirflowPub/SubDataflow (preferred)Advanced SQL development and query optimization skills.Strong experience with Python, PySpark, or Spark-based data processing frameworks.Experience building enterprise-scale batch and real-time data pipelines.Strong understanding of data modeling, dimensional modeling, and data warehouse concepts.Experience with CI/CD, DevOps practices, and cloud-native architecture patterns.Leadership & Communication RequirementsExceptional verbal and written communication skills.Proven ability to lead client-facing discussions and technical workshops.Strong stakeholder management and requirements-gathering experience.Ability to influence architecture decisions and drive consensus across teams.Demonstrated capability to present complex technical concepts to business audiences.Strong mentoring and team leadership skills.Problem-Solving ExpectationsThe successful candidate will:Exhibit outstanding analytical and troubleshooting abilities.Drive root cause analysis and resolution for complex data platform issues.Identify optimization opportunities across architecture, performance, and cost management.Provide innovative solutions to business and technical challenges.Thrive in fast-paced, highly collaborative environments.Preferred QualificationsExperience with Terraform, Infrastructure as Code (IaC), and cloud automation.Exposure to data governance and metadata management tools.Experience with Snowflake, Databricks, or other modern cloud analytics platforms.GCP Professional Data Engineer certification.Experience leading distributed or offshore teams.EducationBachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field.

Similar Jobs

Archesys company logo
Archesys
Improving the government services that impact everyday lives
AMPAworks  company logo
AMPAworks
AI applications and devices that drive efficiency and cost savings in hospitals
Tradable xyz company logo
Tradable xyz
We are an on-chain listing and liquidity protocol for real world assets
Cross River company logo
Cross River
Cross River is a highly profitable, fast-growing financial technology company
VIDERIS company logo
VIDERIS
Engineering data into a unified, high-performance enterprise asset
Cross River company logo
Cross River
Cross River is a highly profitable, fast-growing financial technology company
Cross River company logo
Cross River
Cross River is a highly profitable, fast-growing financial technology company
Thirty Madison company logo
Thirty Madison
A family of specialized healthcare brands all in service of you
BlueVine company logo
BlueVine
Empower small businesses with innovative banking designed for them