Avatar for Stripe
A new, comprehensive and clean standard for online payment processing
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • Top Investors
    This company has received a significant amount of investment from top investors
  • +3

Senior Staff Engineer, Big Data Infrastructure

Posted: 2 weeks ago
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Hive
Spark
Yarn
S3
Kubernetes
Airflow
Azure Blob Storage
Iceberg
Celeborn

About the job

Who we are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.

About the team

In this role, you’d be joining the Big Data Infrastructure team. Our team builds and maintains the platforms that power data work across Stripe, managing three core layers:

  • Data Orchestration (Airflow)
  • Batch Compute (Spark, Celeborn)
  • Data Lake (Iceberg, Hive, S3, Azure Blob Storage)

We support over 2,000 engineers and 600+ internal teams, processing workloads that organically grow more than 30% year over year. Our infrastructure handles massive scale, managing over 800 PB of data, running 325,000 applications a day, and accounting for hundreds of millions of dollars in annual spend, directly powering critical pipelines like inbound payments, network reconciliation, and capital underwriting.

What you’ll do

As the technical leader for the Big Data Infrastructure organization, you will guide a 40+ person engineering team to scale our foundational data systems. You will partner closely with major internal customers like Data Foundations, Payins Engineering, and AI/ML Foundations to modernize our tech stack and execute Stripe's transition to the "Agentic Era" - building "invisible infrastructure" where AI agents operate data pipelines end-to-end.

Responsibilities

  • Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe's total AWS spend
  • Execute Stripe's transition to the "Agentic Era" by building invisible infrastructure that empowers AI agents to author, validate, ship, and operate data pipelines
  • Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization
  • Lead the implementation of a multi-region and multi-cloud data strategy for high availability, disaster recovery, and Azure Blob Storage compliance
  • Reduce operational burden and maintenance overhead (KTLO) from over 40% to under 10% by shifting fixes into the platform instead of relying on runbooks
  • Foster a culture of operational excellence and mentor engineers at various stages in their careers, up to Staff+

Who you are

We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.

Minimum requirements

  • BS or MS in Computer Science or a related field
  • This is a Senior Staff role, so ideally 12+ years of professional experience in a software development role
  • A strong engineering background in distributed infrastructure and/or platform services, including one or more of the following: storage, databases, or compute
  • Experience leading projects on a cross-team and company-wide scale, including scaling and migrating systems with little to no downtime
  • Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security
  • Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards

Preferred qualifications

  • Experience driving AI-led architectural transformations and integrating agentic workflows into large-scale data systems
  • Experience in a development team at AWS, Azure, OCI, or Google
  • Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn
  • Experience with database internals and/or with Kubernetes

About the company

Stripe company logo
A new, comprehensive and clean standard for online payment processing5000+ Employees
Company Size
5000+
Company Type
Startup
Company Type
Web Development
Company Type
Software
Company Type
Payment
Company Type
Software Development
Company Industries
Developer APIs
  • B2B
  • Scale Stage
    Rapidly increasing operations
  • Top Investors
    This company has received a significant amount of investment from top investors
  • YC Funded
    Startup funded by Y Combinator
  • Valuation $1B+
    This company has a valuation of $1B or more
  • 4.1
    Strong Leadership
    Employees rate Stripe 4.1/5 on Glassdoor for faith in leadership
Learn more about Stripe image

Funding

AMOUNT RAISED
$8.1B
FUNDED OVER
15 rounds
Rounds
I
$6500000000
Series I - Mar 2023+14

Perks

Inclusive coverage
We offer comprehensive mental, physical, and medical health plans, supporting Stripes’ financial futures, providing fertility benefits and parental leave.
A principled approach to food
Our food program work with local ingredients and grows a global team through sustainable food practices and minimal waste.
Growth by the way of learning
We are voracious learners and teachers. Our Education team delivers an onboarding and product training curriculum for all new Stripes, and hosts expert-led courses on things like project management fundamentals and macroeconomics.

Founders

John Collison
Founder
San Francisco
image
Patrick Collison
Founder
San Francisco
image
View the team image

Similar Jobs

Stochastic company logo
Stochastic
Intelligent interface that finally adapts to you
Archesys company logo
Archesys
Improving the government services that impact everyday lives
Onos Health company logo
Onos Health
The first comprehensive AI platform for health plans to improve behavioral & mental health services
Astranis company logo
Astranis
Building next-generation internet satellites to get the world online
Zania company logo
Zania
AI Agents for Security
Mercor company logo
Mercor
Mercor is at the intersection of labor markets and AI research
Mercor company logo
Mercor
Mercor is at the intersection of labor markets and AI research
Arcade.dev company logo
Arcade.dev
The MCP Runtime to Secure and Level Up Your AI Agents