The Opportunity
Austroads is seeking a highly skilled Senior Data Engineer to design, develop, and enhance complex data pipelines that underpin business critical operations and large scale analytics. Working within our Databricks ecosystem, you will contribute to Big Data architecture, collaborate with multidisciplinary teams, and help drive the delivery of contemporary data and technology solutions that support transport agencies across Australia and New Zealand.
Contract Type: Fixed Term, Contract Term: 18 Months
Responsibilities
* Design and develop SQL/Azure Cloud–based data insights processes, data models, and operational workflows.
* Provide technical insights to support functional and non-functional requirements within the Databricks ecosystem.
* Collaborate with Data Analysts, Administrators, GIS Analysts, and business SMEs to expand platform capabilities and meet client needs.
* Build, enhance, and maintain complex data pipelines supporting business-critical operations and large-scale analytics.
* Support analytics, data science, and engineering teams, understanding and enabling their unique requirements.
* Work within Agile Scrum/Kanban environments and adopt contemporary development, testing, and release practices.
* Contribute to continuous improvement, quality processes, and organisational standards.
* Perform other duties as required.
About You
The successful candidate will demonstrate:
Required
* Experience with Big Data solutions in cloud ecosystems, including Data/Delta Lakes.
* Expertise with data pipeline tools such as Azure Data Factory and Spark (Databricks, Spark, Delta Lake).
* Strong Python/PySpark/SparkSQL skills; Scala is a plus.
* Experience with GitHub Enterprise or similar source control tools.
* Advanced SQL skills with the ability to write complex, optimised queries across large datasets.
* Experience working in Agile Scrum/Kanban environments.
Desirable
* Data modelling and profiling experience (Kimball/star schema).
* Experience with Kafka or other live data streaming technologies.
* Familiarity with database deployment pipelines and unit testing/data quality frameworks.
* Experience with Telematics Data, road maps, or conceptual/logical/physical database design.
Employee Benefits
* Flexible working arrangements and hybrid work (home + office)
* Extra 5 days personal leave per financial year
* $500 wellbeing allowance annually
* Additional paid parental leave
* EAP access for employees and immediate family
* Subsidised further education and development opportunities
* LinkedIn Learning subscription for ongoing professional growth
About Austroads
Austroads is the collective of Australian and New Zealand transport agencies. We provide practical, impartial advice, tools, and services to support safe, reliable, and efficient mobility outcomes. We are a national organisation with staff located in Melbourne, Sydney, Brisbane, and across Australia and New Zealand, including teams from NEVDIS and TCA.
We embrace diversity of identity, thought, and experience, and strive for a genuinely inclusive workplace.
The successful candidate will be required to undergo a National Police Check.
How To Apply
Please press Quick Apply and upload your resume and a cover letter outlining your interest in the role and why you are an exceptional candidate. Due to anticipated volume, only shortlisted applicants will be contacted.
#J-18808-Ljbffr