Lead GCP Data Engineer

Job Summary

We are looking for a highly skilled Lead GCP Data Engineer with strong expertise in Google Cloud Platform (GCP), BigQuery, Data Engineering, and LookML development. The ideal candidate will lead the design, development, and optimization of scalable data platforms, data pipelines, and analytical solutions while collaborating with business stakeholders, data analysts, and engineering teams.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP).
• Build and optimize data solutions using BigQuery, Cloud Storage, Dataflow, Dataproc, Cloud Composer, and Pub/Sub.
• Develop and maintain semantic data models using LookML in Looker.
• Create reusable dashboards, reports, and analytics solutions to support business decision-making.
• Lead data architecture discussions and provide technical guidance to engineering teams.
• Implement data governance, data quality, security, and performance optimization best practices.
• Collaborate with business stakeholders to translate analytical requirements into scalable data solutions.
• Mentor junior engineers and conduct code reviews.
• Troubleshoot and resolve data pipeline, reporting, and performance issues.
• Work closely with DevOps and cloud teams to implement CI/CD and infrastructure best practices.

Required Skills

GCP Data Engineering

• Strong hands-on experience with:
• BigQuery
• Cloud Composer (Airflow)
• Dataflow
• Dataproc
• Cloud Storage
• Pub/Sub
• Cloud Functions
• IAM & Security

Looker / LookML

• Advanced experience in Looker development.
• Expertise in LookML modeling, explores, views, dimensions, measures, and derived tables.
• Experience designing and maintaining enterprise semantic layers.
• Strong understanding of dashboard development and performance tuning.

Data Engineering

• Strong SQL and query optimization skills.
• Experience with ETL/ELT frameworks.
• Data warehousing and dimensional modeling expertise.
• Batch and real-time data processing experience.

Programming

• Python
• SQL
• Shell Scripting

Preferred Skills

• Experience with dbt.
• Knowledge of Terraform and Infrastructure as Code.
• Experience with CI/CD tools such as GitHub Actions, GitLab CI, or Jenkins.
• Exposure to machine learning workloads on GCP.
• Familiarity with Agile/Scrum methodologies.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Google Cloud certifications such as:
• Professional Data Engineer
• Professional Cloud Architect (preferred)

Nice to Have

• Experience in Retail, Financial Services, Healthcare, or E-commerce domains.
• Migration experience from on-premise or other cloud platforms to GCP.
• Stakeholder management and client-facing experience.