ETL Test Analyst
Your new company
Our client is undertaking a transformation initiative aimed at streamlining and enhancing its ability to harness data effectively. Central to this effort is the adoption of a cloud-based data platform (Databricks) which will serve as a foundation for improved data management and analytics capabilities.
Your new role
We are seeking a detail-oriented and technically skilled Testing Analyst to support the implementation of a modern cloud-based data platform, transitioning from an on-premise data warehouse to Databricks on Azure. To be successful in this role, we are seeking a detailed, oriented analyst with the ability to:
Understand business requirements and translate them into test cases
- Execute test cases using SQL/Python to extract and compare data sets
- Investigate and document defects
- Liaise with engineering teams in relation to defects
What you'll need to succeed
- Develop and execute test plans, test cases, and test scripts for data platform components, including ETL/ELT processes, data pipelines, and data models.
- Validate data migrations and transformations from legacy on-premise systems (e.g., SQL Server, Oracle) to the Databricks environment
- Perform data reconciliation between source and target systems to ensure completeness, consistency, and accuracy
- Collaborate closely with data engineers, architects, business analysts, and project managers to understand requirements and identify quality risks.
- Conduct regression testing and validation of data quality across multiple layers of the medallion architecture (bronze, silver, gold)
- Utilise tools such as PySpark, SQL, or Delta Live Tables to automate and enhance testing processes
- Log, track, and manage defects using tools like JIRA, and support root cause analysis
- Ensure adherence to testing standards (including an evolution of testing standards where required) and best practices across the data platform implementation
- Support user acceptance testing (UAT) by preparing data scenarios, guiding users, and capturing feedback
Required Skills & Experience
- 3+ years of experience in a QA or data testing role, preferably in a data migration or data platform project
- Strong knowledge of SQL for data validation, transformation testing, and reconciliation.
- Hands-on experience testing in cloud environments – preferably Databricks on Azure.
- Familiarity with data lake architecture and modern data stack concepts (e.g., Delta Lake, medallion architecture)
- Understanding of ETL frameworks, orchestration
- Understanding of ETL/ELT pipelines and experience validating large datasets.
- Excellent problem-solving skills and attention to detail
Strong communication skills to work effectively with cross-functional teams
- What you'll get in return
- Opportunity to work within a high-performing government agency
- Exposure to cutting-edge cloud and data technologies
- Collaborative and inclusive team culture
- Competitive hourly rate
- Flexible working arrangements
What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.
#2956002