About Rhombus AI
Rhombus AI is a Sydney-based AI research lab pioneering an agentic AI DataOps platform that transforms raw and siloed data into actionable insights. The platform allows data teams to build complete data pipelines, from ingestion through transformation to orchestration, using natural language prompts, eliminating the need for manual scripts and complex engineering. It connects to major data sources (cloud storage, spreadsheets, databases, APIs) and enables transformations, enrichments, and load operations into targets, all via a visual and prompt-based interface. The platform also provides observability, lineage, and monitoring capabilities to ensure data quality and pipeline health. Curious to see how it works? Watch the video:
Backed by AWS Startups and named one of the Top 100 Generative AI Startups in APAC by AWS, a recipient of the NSW MVP Ventures Grant 2024–25, and funded by UNSW Founders, Rhombus AI is redefining what it means to be a data and AI platform, empowering organisations to operationalise AI at the data layer with unprecedented simplicity and speed.
The Role
We're looking for a Software Development Engineer in Test (SDET) to design and build the automated testing systems that ensure our platform scales safely and confidently. This is not a manual QA role. You will write production-quality code, build test frameworks, design regression strategies, and integrate automation into CI. You'll work closely with our QA engineer and development team to improve testability and prevent regressions before they reach users. You will play a key role in how we ship software.
What You'll Do
Build & Own Test Automation
* Design and implement automation across layers, including API/backend testing, end-to-end UI testing, and data validation & correctness checks
* Build black-box test suites that validate real system behaviour
* Create and maintain smoke vs regression test separation
Test Data & AI-Driven Workflows
* Validate correctness of data transformations and pipelines
* Test AI-assisted behaviour using schema validation, invariants, and deterministic or tolerance-based assertions
* Design tests that remain stable despite probabilistic outputs
CI & Regression Strategy
* Integrate tests into Continuous Integration (CI)
* Design targeted test execution for PRs and full regression for nightly/release runs
* Define quality gates that block merges or releases when necessary
* Improve test reliability and reduce flakiness over time
Enable the Engineering Team
* Partner with engineers to improve testability (stable selectors, APIs, hooks)
* Help define Definition of Done for new features
* Review and improve automated tests written by others
* Use production signals (e.g., error monitoring) to inform new tests
What We're Looking For
Required
* Strong coding ability in Python, JavaScript/TypeScript, or similar
* Experience building automated test frameworks
* Hands-on experience with API testing (REST/JSON) and end-to-end browser automation (Playwright, Cypress, or similar)
* Solid understanding of test layering (unit, integration, API, E2E), regression and smoke testing strategies, and CI-based test execution
* Ability to reason about data correctness and edge cases
* Comfortable working in fast-moving startup environments
Nice to Have
* Experience testing data pipelines, ETL systems, or analytics platforms
* Experience testing AI- or ML-driven systems
* Familiarity with test tagging, flaky test mitigation, or contract testing
* Experience integrating automation into GitHub Actions, GitLab CI, or similar
* Experience using production monitoring tools to inform test coverage
Why This Role Matters
We don't want to scale quality by hiring more manual testers. We want to scale quality through automation, intelligent regression, and strong engineering discipline. This role will define how we ship reliably as the product and team grow.
Interview Process
* CV Review and
Initial Screening
* Take-home automation exercise (time-boxed, real system)
* Review discussion of your submission
* Final culture and collaboration interview
Application Closing Date:
11th January PM AEDT
Have Questions?
Please direct any inquiries to