Senior Python Backend Engineer (Async Systems & Pipeline Infrastructure)

Location: Remote

Nature of Collaboration: Contract Role with Opportunity for Full-Time

Compensation: 15$-20$ per hour

We're hiring a Senior Python Backend Engineer to build and own highly reliable, long-running async pipeline systems.

This is a backend-heavy role where the challenge is reliability, orchestration, and distributed systems, not CRUD applications. Our core platform is a pipeline engine where jobs move through complex multi-step workflows that can run for hours. Some steps interact with external APIs, some require human input, and others orchestrate LLM workflows. The system must handle failures, retries, duplicate deliveries, and partial execution gracefully.

We're looking for someone who has built and operated production-grade async, queue-driven systems and can independently own critical backend infrastructure.

What You'll Work On

• Design and build long-running, multi-step async pipeline systems.
• Develop background processing infrastructure using Celery, Dramatiq, Redis, or similar technologies.

• Implement robust distributed systems patterns, including:

  • Idempotency
  • Retries
  • At-least-once delivery
  • Dead-letter queues
  • Failure recovery

• Build orchestration layers for LLM and multi-agent workflows, including timeout and cost controls.

• Develop backend services using:

  • FastAPI
  • SQLAlchemy 2.0 (async)
  • PostgreSQL
  • Pydantic v2

• Design pipeline state models that are:

  • Observable
  • Resumable
  • Fault-tolerant

• Build monitoring, observability, and incident response tooling.

Requirements

*** 5+ years of experience** building backend systems with Python.

• Production experience with FastAPI.
• Hands-on experience with Celery, Dramatiq, or similar task queue systems.
• Strong experience with PostgreSQL, SQLAlchemy, and database design.
• Comfortable independently owning large areas of backend infrastructure.

If you enjoy building resilient backend systems, distributed workflows, and long-running asynchronous infrastructure, we'd love to hear from you.

To apply, please share:

• Your resume or LinkedIn profile
• Relevant distributed systems or async infrastructure projects
• Your availability and expected hourly rate