Software Engineer in Test, CI & Flaky-Test Tooling

Flaky tests quietly erode trust in CI, and we build the internal tooling that helps teams get it back. We're hiring a software engineer in test to own the analysis core. It reads batches of test results, decides which tests are genuinely flaky, quarantines the worst offenders, and rolls everything up into a stable report. It's plain Ruby, standard library only.

What you'll do:

• Classify each test as passed, failed, or flaky, and get the retry logic right
• Set sensible quarantine thresholds and handle the history window they look back over
• Produce a report that comes out the same way every time
• Maintain the small hand-rolled fixtures and custom assertions the harness ships with, without pulling in gems

What we're looking for:

• Solid Ruby and a feel for test tooling and harness design
• Care with classification and aggregation logic, and deterministic output
• Comfortable in minitest and staying inside the standard library

Nice to have:

Worked on CI or flaky-test analytics, and familiar with fixture and factory patterns