Senior Data Engineer
$180k – $220k
Published: 2 weeks ago
Willow Innovations
We're on a mission to build solutions to mom's most meaningful problems
Job Location
Job Type
Full TimeVisa Sponsorship
AvailableHires remotely in
Relocation
AllowedThe Role
About The Role:
We are building a modern data platform that will allow Willow Innovations the ability to make the most optimal business decisions. We are a growing organization and the Senior Data Engineer will have a huge influence in shaping the data strategy. If you feel a deep sense of ownership for your work, are passionate about data, desire to solve problems, are curious and love learning new things, we’d love to talk to you!
Roles & Responsibilities | What You'll Do:
- Own and drive data integration architecture involving streaming, micro-batch and batch
- Work closely with various business groups to collect business requirements
- Design, develop and deploy high performance data pipelines both inbound and outbound
- Build aggregate and enriched data sets needed to effectively analyze / visualize data
- Document, maintain and support data pipelines
- Measure and monitor quality and availability of data
- Implement data policies - retention, privacy, security, and compliance
- Responsible for maintaining the Data Pipeline framework
- Mentor and guide junior data engineers
Experience | What You'll Bring:
Must Have:
- 5+ years of experience in building data lakes and data warehouses
- Experience working with Google Cloud, BigQuery, GCS, Pub Sub, Data Flow etc
- Expert knowledge on SQL and Python programming
- Good understanding of data formats such as JSON, Parquet, ORC, XML, etc
- Experience in tuning queries for performance and scalability
- Experience working with any workflow management tools (Airflow, Oozie, etc)
- Excellent organizational, prioritization and analytical abilities
- Strong communication and interpersonal skills
Nice to Have:
- Experience in Real Time Data Ingestion using Kafka, Spark, Storm etc
- Knowledge of NoSQL
- Experience with Data visualization tools such as Looker, Tableau, PowerBI
More about Willow Innovations
Similar Jobs
Crew32
Crew32, Stealth startup based in Santa Monica, CA
Oncora Medical
Software, data, and ML to help doctors and scientists in the fight against cancer
Box Score
Sports Betting for the Rest of Us
Ashana Health
Adding Digital Element to Rehabilitation Process
Bridg
Know every guest. profile, analyze, and reach all your past and current guests
Eight Sleep
Designed to help you fall asleep faster and stay asleep
Enki
The AI-powered skills coach for professionals and teams
PatternAI
DSaaS - Data Science as a Service
Viaduct
AI for connected vehicles