- Top 10% of respondersCOTID is in the top 10% of companies in terms of response time to applications
- Responds within a few daysBased on past data, COTID usually responds to incoming applications within a few days
- Growing fastShowed strong hiring growth in the past month
QA & Test Automation Engineer
- 0.25% – 0.5%
- |Remote (Everywhere)
- |No experience required
- |Internship
Remote only
Not Available

About the job
QA & Test Automation Engineer — Desktop (Windows + iOS/macOS)
Compensation: Equity + Revenue Share
Type: Full-time
Location: Desktop-based (on-site/hybrid) — must work from a Windows workstation
Remote: Optional (desktop-based preferred)
Summary
We need one engineer to bring a comprehensive testing environment to our Tauri v2 desktop app so we can prove it works on Windows and iOS/macOS. You own the entire testing strategy and infrastructure — unit, integration, E2E, device/OS matrix coverage, CI gating, and regression detection. Desktop-based role: you sit at a Windows machine and validate real-world behavior, not just CI logs.
Hardware Requirements (Must Have)
- Windows device required to hold this role (physical Windows workstation for native testing, signing verification, and CI parity). Non-negotiable.
- Access to an iOS device and/or macOS machine with Xcode/simulator for iOS testing (Mac provided or BYOD).
- Both platforms must be testable locally, not only via remote CI.
Responsibilities
Testing Strategy & Coverage
- Design and own the test pyramid for the Tauri app (Rust backend + React/TS frontend): unit, integration, contract, and E2E tests.
- Define acceptance criteria, test plans, and coverage gates per feature; own regression suites and flaky-test triage.
- Build cross-platform test matrices: Windows x64/ARM64, macOS x64/ARM64, iOS device + simulator; multiple OS versions and hardware tiers.
- Keep the suite fast, deterministic, and trustworthy.
Automation & CI Integration
- Integrate tests into GitHub Actions / CI: parallel sharding, retries, artifact collection, test reporting dashboards.
- Device-farm and emulator/simulator orchestration for iOS and Windows; real-device coverage where it matters.
- Performance and reliability tests: startup time, memory, inference latency, crash-free sessions, battery/thermal.
Update & Distribution Validation (Air-Tight Delivery)
- Test the full update lifecycle: detection, download, signature verification, install, restart, rollback, and failure recovery on Windows and iOS/macOS.
- Validate updater behavior across OS versions, permissions, proxies, offline/air-gapped scenarios, and interrupted/partial downloads.
- Verify version reporting, build metadata, and that "new version installed" actually sticks (no silent revert, no stale cache, no duplicate installs).
- Test installers/packages: MSIX/AppX, DMG/pkg, iOS IPA/TestFlight; silent install, upgrade from prior versions, clean uninstall, sidecar binary delivery.
- Build canary/smoke suites that run against signed release artifacts before they reach users; gate releases on green.
- Reproduce and automate "update didn't stick" reports; add regression tests for every failure mode.
Quality Gates & Release Confidence
- Block bad releases: required checks, smoke tests on signed builds, rollback triggers.
- Crash reproduction and verification: turn Sentry reports into reproducible, automated tests.
- Compatibility validation: models × OS × hardware matrix; regression checks for new model releases.
Test Infrastructure & Developer Experience
- One-command local test runs with parity to CI; fast feedback loops.
- Test data management, fixtures, mocks for ML inference, networking, and platform APIs.
- Debugging tooling for platform-specific failures (Metal/CUDA/ARM64 quirks, iOS sandbox limits, Windows driver issues).
Collaboration
- Partner with platform/release and ML engineers to define testable interfaces and observability hooks.
- Triage incoming bugs, reproduce, and add regression tests before fixes ship.
- Document testing standards, matrices, onboarding, and contribution guidelines.
Qualifications (Required)
- 3+ years building comprehensive automated test environments for desktop and/or mobile apps.
- Desktop testing experience on Windows (native + webview) — must be comfortable debugging on a Windows workstation.
- Strong in test automation frameworks: Playwright/Cypress/WebdriverIO (webview E2E), Rust test harnesses (cargo test), XCTest (iOS), pytest.
- CI/CD mastery: GitHub Actions, matrix builds, artifact management, test sharding, parallel execution.
- Cross-platform testing: Windows + Apple (macOS/iOS), real-device and simulator farms.
- Scripting fluency: TypeScript/JavaScript, Rust, Python, Bash/PowerShell.
- Debugging mindset: reproduce elusive platform-specific failures and convert them into tests.
Preferred (Bonus)
- Tauri v2 testing experience (webview, sidecar binaries, updater flows, custom protocols).
- ML/inference testing: model loading, quantization correctness, latency/memory profiling.
- Performance profiling: Instruments (macOS/iOS), ETW/PerfView (Windows), Xcode, Visual Studio.
- Contributions to testing tooling or open-source test frameworks.
Keywords (for search/ATS)
Tauri v2, Rust, React, TypeScript, Playwright, Cypress, WebdriverIO, XCTest, cargo test, pytest, GitHub Actions, CI/CD, E2E testing, integration testing, test automation, cross-platform, Windows x64/ARM64, macOS, iOS simulator, device farm, regression testing, flaky tests, Sentry, crash reproduction, performance testing, memory profiling, Instruments, ETW, PerfView, SRE, quality gates, smoke tests, compatibility matrix, ML inference testing, sidecar binaries, updater testing, auto-update, delta updates, signature verification, rollback testing, installer testing, MSIX, AppX, DMG, pkg, IPA, TestFlight, version reporting, release gating, canary testing, air-gapped, offline updates, proxy testing, stale cache, silent install.
Success Criteria (First 90 Days)
- Comprehensive test suite (unit + integration + E2E) running in CI across Windows and iOS/macOS.
- Quality gates block regressions; flaky rate near zero.
- Reproducible bug-to-test pipeline: every filed bug gets a regression test.
- Documented test strategy, matrices, and onboarding for new contributors.
- Validated on a real Windows workstation and iOS device/simulator.
- Update/distribution smoke suite green on signed artifacts; documented evidence that updates stick across OS versions.
About the company
- Top 10% of respondersCOTID is in the top 10% of companies in terms of response time to applications
- Responds within a few daysBased on past data, COTID usually responds to incoming applications within a few days
- Growing fastShowed strong hiring growth in the past month
Similar Jobs









