Assistant Director, Data Engineer
National Archives of Australia
Pay range
A$119,189.00/yr - A$128,279.00/yr
About the Role
As part of the Digital First program, the Unified Data View (UDV) will provide a complete, accurate, and up‑to‑date data for Business Intelligence, data analysis, and enhanced collection search capability. The UDV aggregates, unifies and presents collection metadata from multiple, disparate sources into a single, cohesive view to facilitate better decision making, improve data accessibility, and enhance data analysis capabilities for staff across the National Archives of Australia. The underpinning technologies are based on Microsoft cloud technologies, including Microsoft Fabric OneLake data warehouse, Power BI business intelligence and Microsoft Azure Application Programming Interface Management (APIM).
To sustain, maintain and further develop these new technologies, Technology Branch has a vacancy for an EL1 Data Engineer to manage ongoing operations of the Unified Data View.
Responsibilities
* Lead and manage the team responsible for delivery of the Unified Data View.
* Oversee the sustainment and development of the unified data warehouse and associated data engineering solutions.
* Design and implement complex ETL data flows to integrate collection system data into the warehouse, enabling the creation of business intelligence products while ensuring robust data security and governance.
* Manage data warehouse architecture and configuration, establish standardised data modelling guidelines, and implement industry best practices.
* Define and enforce data quality standards, processes, and controls, continuously monitoring data quality and integrity, and addressing issues promptly to ensure reliability.
* Collaborate with stakeholders to identify and prioritise data sets for ingestion into the warehouse, aligning with current and future business reporting requirements.
* Maintain, or ability to gain, skills in database fundamentals, Python and Power BI, Microsoft Azure SQL, Azure DevOps and MS Fabric. Relevant certifications or equivalent qualifications would be well regarded.
* Perform detailed analyses on data and business processes, translating business needs into actionable and effective data solutions.
* Support the Unified Data View's self‑service function for the wider National Archive users.
* Lead the development and enhancement of data engineering frameworks and best practices, focusing on optimising the availability, security, and performance of data assets and maintenance of data pipelines.
* Apply the principles of APS Values, Code of Conduct, workplace diversity principles, work health and safety and participative management within a work and team environment.
* Promote and apply the National Archives' Vision, Mission and Commitments as expressed in Strategy 2025–2030: Evolving National Archives and Our Values.
Qualifications & Skills
* Australian citizen.
* Pre‑employment check and baseline security clearance.
* Database fundamentals, Python, Power BI, Microsoft Azure SQL, Azure DevOps and MS Fabric.
* Relevant certifications or equivalent qualifications.
How to Apply
You need to apply through our e‑recruitment system.
#J-18808-Ljbffr