Data Engineer
- Old Toronto
- |Full Time
Posted: 3 days ago
Job Location
Old Toronto
Remote Work Policy
In office
Visa Sponsorship
Not Available
RelocationAllowed
Skills
SQL
Hive
HDFS
Yarn
Apache Spark
Spark SQL
Hadoop Ecosystem
Apache Kafka
Pyspark
Apache NiFi
Dataframes
About the job
- Build Kafka-based streaming and event-driven solutions.
- Write complex SQL queries for data transformation and validation.
- Implement data ingestion from databases, APIs, files, and streaming sources.
- Monitor performance, troubleshoot issues, and ensure data quality, security, and governance.
- Support deployments, testing, upgrades, and production releases.
Mandatory Skills
- PySpark and Apache Spark (Spark SQL, DataFrames)
- Apache Kafka
- Hadoop Ecosystem (HDFS, Hive, YARN)
- Apache NiFi
- SQL
