Senior Data Engineer

👋 Hi, I’m Daren - Engineering Manager here at Dwolla. I’m looking for a curious, passionate and determined data engineer who loves trouble-shooting and working in a fast-paced, collaborative, diverse Engineering team.

Here is what you can expect to work on in this critical role:You will lead the efforts to leverage the data we hold to its maximum value. Our Dwolla API platform processes billions of dollars in payment every month on behalf of millions of users. Using this data, you will assist the rest of Dwolla in making the most informed decisions possible. This includes developing and executing a technical vision for cutting-edge AWS-based data pipelines. Additionally, you can expect to support new product offerings and business intelligence development efforts while also ensuring deployed systems uphold required levels of performance.

Experience working with infrastructure-as-code and CI/CD systems (such as Terraform, Troposphere, Cloudformation, Jenkins) would be clutch for this position 🎉.

How do our Senior Data Engineers spend their time?You can expect to spend about 50% building and growing the Dwolla data lake and date pipelines and about 20% of your time defining and implementing DataOps methodologies. Additionally, 20% of your time will be spent writing and optimizing queries and reports. Lastly, you’ll spend about 10% of your time supporting and monitoring existing databases.

Our team values collaboration, a passion for learning and a desire to become a master of your craft. We thrive in asynchronous communication. You will have a lot of support from leadership when you communicate proactively with detailed information about any roadblocks you may encounter.

Qualities of Data Engineers Who Thrive in This Role🔥 You are a driven, self-starter type of person who isn’t afraid to dig for answers, stays up-to-date on industry trends and is always looking for ways to enhance your knowledge (yes, industry-related podcasts count! 🎧) .💡Your skill set includes a blend of DataLake-related technologies in AWS (Redshift, Glue, Athena, S3 would be great!)🖥️ Experience with Python and SQL are clutch! (Perhaps you’ve got a software engineering background?)

What’s expected of a Senior Data Engineer at Dwolla?

• Design, build, monitor, and maintain infrastructure-as-code AWS-based data pipelines and warehousing tooling to support both internal and client-facing use cases.
• Write and optimize Python code for ETL and other jobs to populate the Dwolla Data Lake and integrate with Salesforce (and related tools).
• Help define and implement the principles and technologies for a Data Lifecycle to enable application of CI/CD principles to data problems while ensuring integrity, security, privacy, and performance.
• Support the Technology department’s use of a combination of AWS database technologies through advising on implementations, troubleshooting, and maintenance.
• Partner with other engineers and data specialists in writing and optimizing queries or developing performant schemas with consideration for security and privacy.
• Assist other Engineers in supporting highly-available RDS database instances including user management, configuration, migrations, and performance troubleshooting.
• Contribute to plans and exercises to ensure databases and data pipelines are resilient to outages and recoverable in the event of a disaster.
• Communicate technical decisions through RFCs, design docs, technical training, and the wiki.
• Mentor other engineers via pairing, design review, and code review.

What are the preferred qualifications for this position?

• Experience implementing relevant AWS technologies for the purposes of building data pipelines and executing extract, transform, load (ETL) jobs.
• Experience with infrastrastructure-as-code (i.e., Terraform, CloudFormation) methodologies.
• Experience with distributed computing technologies such as Spark.
• Experience designing and reviewing multi-function Python programs in accordance with style and security guidelines.
• Experience optimizing SQL queries for high performance.
• Experience with AWS database solutions such as RDS, DynamoDB and Redshift.
• A knack for seeking empirical evidence through proofs of concept, tests and external research.
• Empathy with the user of the work you are producing to guide decision-making.
• Strong analytical thinking and troubleshooting skills.
• Strong written and verbal communication skills.
• Typically requires 5+ years of experience in a closely-related role. Education and certifications are valued and may contribute towards this criteria as applicable.