Data Engineer (Remote, F/T)

42 is an end-to-end analytics stack for retailers and brands!

Whether it's store managers running A/B tests on new product placement, CEOs looking at their global store performance, or merchandisers planning the next season, our platform enables retailers and brands to get instant visibility in their business.

The majority of retailers don't have the in-house expertise to spin up data infrastructure. Instead, they piece together reports in excel on a daily basis. This works fine for small eCommerce brands, but not for retailers in the $50M-$5B range. That's where we come in.

We offer our customers:

• Retail-specific dashboards: best-practice metrics / visuals are built-in and customizable
• No integration: we make their data and systems work with our platform
• Hosted infrastructure: we host the pipelines and data warehouse

So, why join?

• We have high user engagement
• We run the analytics for brands you know
• YCombinator-backed
• Small team, lots of opportunities to grow and shape the future of the company
• We are a no ego, no bs, collaborative group passionate about our product and customers

Here's our stack

• App: Isomorphic JS / TS Monorepo, SQL
• Data: PySpark, OLAP SQL
• Infrastructure: AWS, GCP, Docker, K8s

What you'll be responsible for

• You'll be the data engineering expert for brands that you know
• Working with SMEs (internal & sometimes external) to understand data and reporting requirements
• Reducing our onboarding times by improving / creating tools and processes for you and the team
• Being an owner & user of our data platform, continually improving it in parallel with customer onboardings
• Build new data products & generalize features so that they work with all of our customers
• Troubleshooting technical issues with performance, data discrepancies, alerts

Sample projects working at 42

• Build pipelines for one of the big gaming console companies
• LLM-powered validators / parser generators for human-made data
• Automated data deduplication and cleaning for all sorts of entities (e.g. customers, products)
• Improve our raw data storage by using someething like Iceberg, Hudi, Delta Lake, etc..
• Build a lineage tracking tool, and a metrics library
• Analyze and tune the performance of Spark jobs
• Evaluate and implement new tools to enhance our data pipeline

You are a person that...

• has 3+ years professional experience in data engineering, data science, or analytical products
• can overlap ~4hrs with San Francisco Timezone (Pacific Time)
• can work well as part of a fast-paced remote-first startup
• has a Bachelors degree, with a major in an analytical or technical field strongly preferred
• has work experience with Python (or similar languages)
• Prior experience working with Apache Spark is preferred
• has strong technical intuition and ability to understand complex business systems
• has strong technical accomplishments in SQL, ETLs, and data analysis skills
• has knowledge in data modeling concepts and implementation
• is experienced with git, cli, and general software development
• is familiar with cloud platforms like AWS or GCP

What we provide

• Competitive salary and equity package
• IRL offsite every 4-6 months
• Flexible family benefits
• Flexible vacation policy
• Special requests welcome!

To wrap up, a few fun facts about us

• We are a lean team, located across three continents and speak six languages 🌏🌍🌎
• More than half of us are parents 👶🐶🐱
• We like sharing food updates 🍱🌮🍕though we are split on loving or detesting peppers 🫑

If this sounds interesting to you, we would love to hear from you! Write "DON'T PANIC" in the intro note to help us distinguish you as a human 🤖