CloudMarc is a specialist technology consultancy delivering Quality Engineering, Test Automation, Data, Cloud, and AI-driven delivery solutions to enterprise clients across Australia.
We partner with organisations to uplift quality practices, improve test automation, and deliver scalable cloud-native solutions across complex technology environments.
The Opportunity
We're looking for a Senior Quality Engineer with strong experience across data engineering, automation, and cloud-native testing to support a large-scale data platform environment.
This role will focus on designing, developing, and supporting scalable automation across data ingestion, transformation, validation, and monitoring pipelines using Python, SQL, BigQuery, Dataform, and Google Cloud Platform.
This is a hands-on role suited to someone who has strong technical capability across backend data processing, automated validation, and CI/CD quality controls.
Key Responsibilities
* Design, develop, and support scalable automation for cloud-native data ingestion and transformation pipelines
* Work across multi-layer data architectures using Python, SQL, BigQuery, Dataform, and GCP
* Engineer automated validation and monitoring solutions within Dataform linting frameworks
* Ensure schema consistency, data quality, and adherence to Data Vault modelling standards
* Develop reusable Python and SQL modules and BigQuery scripts
* Support scalable, reliable, and maintainable backend data processing systems and BigQuery tables
* Contribute to the design and testing of batch and streaming data pipelines
* Develop and test Python-based cloud functions and cloud schedulers
* Implement and validate retry logic, error handling, recovery mechanisms, and system resilience
* Integrate automated testing, validation frameworks, and quality controls into GitLab CI/CD pipelines
* Support continuous integration, automated quality gates, and reliable deployment of data platform services
* Participate in code reviews, technical design discussions, and pipeline architecture initiatives
* Contribute to reusable data patterns, platform capability uplift, and improved testability of Dataform and BigQuery solutions
Skills & Experience Required
* Strong experience as a Senior Quality Engineer / Data Quality Engineer / Technical Test Engineer
* Hands-on experience with:
* Python
* SQL
* BigQuery
* Dataform
* Experience testing or validating data ingestion and transformation pipelines
* Strong understanding of backend data processing systems
* Experience with automated validation, monitoring, and data quality controls
* Exposure to batch and streaming data pipelines
* Experience with CI/CD pipelines, ideally GitLab
* Strong understanding of quality engineering principles in cloud-native data environments
* Strong analytical, problem-solving, and communication skills
Highly Regarded
* Experience with Data Vault modelling standards
* Experience with cloud functions, cloud schedulers, retry logic, and recovery mechanisms
* Experience participating in technical design reviews or architecture discussions
* Experience in large-scale enterprise data platform environments
What You'll Bring
* Strong technical quality engineering mindset
* Ability to work across engineering, data, and delivery teams
* Confidence designing scalable and maintainable automated validation approaches
* Strong ownership of quality across data pipelines and platform services
* Ability to work in a fast-paced enterprise environment
If you're a hands-on Senior Quality Engineer with strong GCP, BigQuery, Python, SQL, and Dataform experience, we'd love to hear from you.
#J-18808-Ljbffr