Software Engineer, Test Automation

Job Overview

As a Test Automation Engineer at Relyance AI, you will collaborate closely with development teams to design, implement, and scale our test automation framework. Your primary goal is to increase test coverage, optimize testing efficiency, and elevate automation practices across our software development lifecycle. You’ll thrive in a dynamic, fast-paced startup environment, where constant iteration and innovation are key to delivering high-quality products quickly.

This is an exciting opportunity to have a direct impact on both the engineering team’s workflow and the quality of the product through automation.

Responsibilities:

Test Automation Ownership and Innovation:

• Drive the design, development, and optimization of the test automation framework to support the team’s automation strategy.
• Champion automation best practices and advocate for continuous improvement of test automation processes across the engineering organization.
• Identify gaps and areas of improvement in the existing test coverage and automation suite, and take ownership of scaling and enhancing it.
• Lead the development of scalable, maintainable, and effective automation solutions for different levels of the application (unit, integration, and end-to-end tests).

Hands-On Test Automation Development:

• Build and extend automated test suites at various levels, including unit tests, integration tests, and end-to-end tests.
• Develop automation scripts that integrate with the CI/CD pipeline to enable continuous testing and fast feedback.
• Continuously measure test coverage and effectiveness, ensuring that the automation suite evolves in line with code changes and product features.
• Leverage modern tools and frameworks (e.g., Playwright, Selenium, pytest) to create robust and reliable automated tests.

CI/CD Integration:

• Integrate automated tests into the CI/CD pipeline, ensuring that all automated tests are executed as expected and provide actionable feedback to developers.
• Work closely with DevOps and development teams to ensure that the testing infrastructure is optimized for speed, reliability, and scalability.
• Work on creating a fully automated testing flow that is efficient, repeatable, and error-free.

Impact and Continuous Improvement:

• Deliver test automation solutions that ensure high-quality, scalable software with minimal manual intervention.
• Use your expertise to guide decision-making around test coverage priorities, balancing speed and risk.
• Monitor test results, debug failures, and provide recommendations for improvements to the development team.
• Collaborate with cross-functional teams to help identify and automate repetitive test cases, ensuring maximum test coverage with minimal manual testing effort.

What We’re Looking For:

• 3+ years of experience in test automation, with a proven track record of developing and scaling automation frameworks and suites for complex software systems.
• Expertise in Python or other modern programming languages used for test automation (e.g., JavaScript, Java, or Go).
• Deep knowledge and hands-on experience building automation at all levels: unit tests, integration tests, and end-to-end (E2E) browser tests.
• Experience with Playwright (preferred), Selenium, or other modern test automation frameworks for browser-based E2E testing.
• Experience integrating test automation into a CI/CD pipeline for seamless, automated software delivery.
• A deep understanding of test automation principles, including designing for maintainability, scalability, and reliability.
• A passion for automation, with an eye for optimizing repetitive tasks and a constant desire to improve processes.
• Excellent problem-solving skills and the ability to work in a collaborative, cross-functional team environment.
• Strong communication skills and the ability to work closely with developers, product managers, and other stakeholders to achieve the best possible testing outcomes.

Nice to Have:

• Knowledge of Docker or other container orchestration tools.
• Familiarity with modern development practices such as Agile, DevOps, and Test-Driven Development (TDD).
• Experience with performance or load testing tools (e.g., JMeter, Gatling) for testing scalability.

Why You’ll Love It Here:

• Growth: Join a fast-paced startup environment where you’ll have the opportunity to shape and grow our test automation practices from the ground up.
• Impact: Your work will directly contribute to the speed, reliability, and scalability of our software releases, empowering engineering teams to deliver high-quality features quickly.
• Collaboration: Work closely with talented engineers, product managers, and stakeholders to build innovative solutions in a dynamic and supportive environment.
• Innovation: Be part of an engineering culture that encourages creative problem-solving and innovation, with a strong emphasis on automation.

Working at Relyance AI

At Relyance AI, we create an unreasonably hospitable and data-driven culture. We prioritize exceeding customer, and each other’s, expectations in every interaction. This means empowered team members solving problems proactively based on information, crafting personalized experiences, and radiating enthusiasm. Behind the scenes, trust and freedom allow team members to find creative solutions, while shared purpose and recognition fuel a spirit of greatness to truly wow customers and each other. We deconstruct failures to learn from them and take great pride in our successes; celebrating both.

Relyance AI is proud to be an equal-opportunity employer. We celebrate representation and are committed to creating an inclusive environment for all employees. We are committed to fair and equitable compensation practices. We use data-driven pay practices with the goal of ensuring offerings are competitive to the market and our team members are being compensated correctly based on their roles, experience, and location.