Job Description
As a Data Platform Engineer, you'll be at the heart of building and evolving our modern data platform, powered by Azure Data Factory, Azure SQL, Databricks, Synapse Analytics, and AI Foundry. This platform is critical to how we deliver analytics, insights, and AI capability across the organisation.
You'll ensure the platform is reliable, scalable, and high‐performing, enabling trusted data delivery at pace, while playing a key role in supporting AFCA's growing data and AI ambitions.
Staying ahead of cloud‐native innovation, you'll continuously look for ways to enhance architecture, drive automation, and improve efficiency, helping future‐proof our platform and keep us aligned to our enterprise vision.
Responsibilities
* Design, build and maintain scalable data pipelines, lake and lakehouse architectures across Azure (ADF, Databricks, Synapse, Azure SQL)
* Develop robust batch and streaming pipelines to deliver reliable, high‐quality data across the organisation
* Drive best practice through CI/CD, infrastructure as code, automated testing and observability
* Monitor and optimise performance, cost and reliability (clusters, jobs, queries and governance)
* Contribute to data models and architectures that enable analytics and AI/ML use cases
* Ensure solutions align with security, privacy and data governance standards
* Partner closely with data analysts, engineers, scientists and AI teams to improve platform capability and developer experience
Qualifications
* Strong experience in data engineering or data platform roles, with demonstrated hands‐on expertise in Azure Data Factory, Azure SQL, Databricks, Synapse Analytics and the broader Azure data ecosystem or similar (e.g. Fabric).
* A Bachelor degree in Computer Science, Information Systems or relevant field.
* Proficiency in SQL, Python, PySpark and Spark SQL, with experience building and optimising data pipelines at scale.
* Experience with lakehouse, Delta Lake and medallion architecture patterns, familiarity with infrastructure‐as‐code tools (e.g. Terraform, ARM) and Azure DevOps CI/CD practices for data platform deployments.
* Understanding of data modelling concepts, data warehousing principles and modern data platform architectures.
* Exposure to supporting AI/ML workloads on Databricks (e.g. MLflow, model serving, feature engineering) highly regarded.
* Experience with or exposure to Azure AI Foundry highly regarded.
* Experience in financial services, digital‐first organisations or highly regulated environments highly regarded.
* Excellent stakeholder management skills, with the ability to clearly communicate end elicit requirements from non‐technical audiences.
* Growth mindset with a practical, outcome‐focused approach.
* Customer‐centred, pragmatic and delivery‐oriented.
Benefits
* Silver AWEI Accreditation 2025 – Recognised for LGBTQ+ workplace inclusion.
* Accredited Family Friendly Workplace – Supporting work‐life balance and inclusivity.
* Hybrid working – Flexible arrangements with two days a week in our modern offices designed for collaboration and wellbeing.
* Additional and inclusive leave options – Flexible public holidays, gender affirmation leave, women's health leave, and bonus paid time off over the end‐of‐year holiday period.
We welcome applications from people of all backgrounds, cultures, abilities, sexual orientations, and gender identities.
If you require any accessibility support during the recruitment process, please reach out to our team at Careers@afca.org.au.
#J-18808-Ljbffr