Avatar for CGI
Global Consulting Firm, Information and technology services
  • Public Stage
    Publicly traded company

Lead Data Engineering

  • $60k – $115k
  • |
    St. John's
  • |8 years of exp
  • |Full Time
Posted: 3 weeks ago
Job Location
St. John's
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
Database
SQL
API
agile methodologies
Event Driven Architecture
Data Processing
Apache Kafka
Automation Frameworks
Testing Strategies
RBAC
Data Lake
Asset Bundles
Azure Data Factory
databricks
CI/CD Pipelines
Error Handling
Unity Catalog
Files
ETL Pipelines Testing
Azure Authorization Methods

About the job

Position Description

The Sr/Lead Data Engineering is someone who has the skills to lead the engineering team, including strong communication skills and ability to be self sufficient

Your future duties and responsibilities

  • Database Management: Data Modelling, administer, secure, and maintain databases.  Hands on experience with SQL databases, query optimization, and schema design.  Data Pipeline Development: Design and implement data pipelines to efficiently collect, process, and store data.
  • Data Publishing: Enable data distribution through outbound streams, queues, and APIs.
  • API Integration: Implement API mutations to facilitate data updates from external systems.
  • Replication Management: Build and oversee replication stores to support data consistency and availability.
  • Software engineering: Developing, deploying, and supporting backend data services, pipelines, and platforms.   Direct experience with event driven architecture using Apache Kafka
  • Software Development Practices:  Familiarity with agile methodologies Experience in Continuous Integration/Continuous Deployment (CI/CD) pipelines.  Knowledge of testing strategies and automation frameworks.

Required Qualifications To Be Successful In This Role

  • 6 8 years of experience in data engineering space
  • Strong SQL expertise
  • Strong Python and Data Processing
  • Understanding of Data Modeling for a modern platform medallion architecture
  • Big Data processing
  • Experienced in ETL, ETL Pipelines testing and Error handling
  • Experience integrating multiple data sources (and data source types, i.e. API, Database, Files)
  • Experience with a data modernization project
  • Databricks knowledge Jobs, Unity Catalog, Asset Bundles
  • Azure Data Factory for orchestration
  • Knowledge of Azure Architecture including RBAC, Data Lake, Azure Authorization methods

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $60,000–$115,000.

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

To learn more about accessibility at CGI, contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our team—one of the largest IT and business consulting services firms in the world.