GCP Data Engineer

Generic Skills (Must Have) :

• Python and advanced SQL.

• Data quality checks, reconciliation, alerting, retries, and backfills.

• Production pipeline monitoring and troubleshooting.

GCP Skills (Must Have) :

• Mandatory: BigQuery: datasets, tables, views, partitioning, clustering, SQL optimisation, cost awareness.

• Option 1: Dataflow / Apache Beam or equivalent streaming/batch framework.

• Option 2: Dataproc / PySpark or strong Spark experience.

• Pub/Sub or equivalent event streaming.

• Cloud Composer / Airflow DAG development.

Nice to have (Trainable) :

• Dataform, dbt, CI/CD for data.

• BigQuery ML.

• Dataflow templates.

• Looker / LookML basics.

• Terraform for data infrastructure.