Senior Data Engineer
- $80k – $140k • No equity
- Remote •
- 5 years of exp
- Contract
Posted: 5 months ago
Visa Sponsorship
Not Available
Remote Work Policy
Remote only
Hires remotely in
Preferred Timezones
Pacific Time
Collaboration Hours
9:00 AM - 5:00 PM Pacific Time
RelocationAllowed
Skills
Python
SQL
DBT
About the job
Job Description:
As a Senior Data Engineer at Quarter Lab, you will be responsible for designing, implementing, and maintaining robust data infrastructure solutions and a complex ETL which drives our core business operations. You will work closely with our team to ensure the efficient and effective processing of large datasets. Your expertise in SQL and ETL processes will be crucial in shaping our data strategy!
Key Responsibilities:
- Database Design and Implementation: Architect scalable and high-performance data solutions to process millions of rows of data.
- ETL Development: Design, implement, and manage ETL pipelines to support data integration and transformation processes.
- Data Modeling: Develop and maintain complex data models and database schemas to support various business needs.
- Tool Integration: Utilize tools like DBT and Prefect (or similar) to streamline data workflows and ensure data quality.
- Collaboration: Work closely with company stakeholders & engineers to understand data requirements, deliver solutions, and collaborate cross-functionally.
- Documentation: Document core data processes using industry standard best practices
- Performance Tuning: Optimize database performance and ensure efficient query execution.
Requirements:
- Experience: Minimum of 5 years of experience in data engineering or software engineering
- SQL: Mastery of SQL with a strong ability to write and optimize complex queries and stored procedures.
- Python: Strong programming skills using python or other OO programming language
- DBT: Hands-on experience with DBT (Data Build Tool) for data transformation and modeling.
- ETL Skills: Proven experience in designing and implementing robust ETL processes.
Nice to Haves:
- Automated Testing: Experience writing and devloping unit or E2E tests for data pipelines and/or python backends
- Prefect: Experience building data pipelines with Prefect, or other similar ETL tools
- DevOps Experience: Familiarity with DevOps practices and tools to manage and deploy data solutions.
- Web Development: General familiarity with PHP / Javascript / HTML / CSS
About the company
Similar Jobs
Everlance
(1) Automatic mileage & expense tracking (2) Powering the future of work
GVOS
An Edge Cloud for Autonomous Driving
dYdX
The world's leading decentralized exchange for crypto assets
Imprint Payments
We are reimagining the relationship between consumers and the brands they love
JetInsight
Best-in-class quoting and fleet management software for aircraft charter operators
C3.ai
C3 AI is a leading enterprise AI software provider for accelerating digital transformation
Voicera.io
Voice of Customers Insights with Empathy AI & LLM
SigScalr
Observability made inexpensive and fast
Ploomber
We help data scientists build faster!