About The Role
We are seeking Data Engineers to build and maintain the data infrastructure that powers analytics and decision-making across our clients. This is an opportunity to work with modern cloud platforms and technologies, designing scalable solutions that handle diverse data needs across Defence and enterprise environments.
About The Role
We are seeking Data Engineers to build and maintain the data infrastructure that powers analytics and decision-making across our clients. This is an opportunity to work with modern cloud platforms and technologies, designing scalable solutions that handle diverse data needs across Defence and enterprise environments.
You will build robust data pipelines, optimise data architectures, and ensure data quality and governance compliance. Your work will enable analysts, data scientists, and business users to access reliable, high quality data when they need it.
What You'll Do
1. Design and manage databases and data warehouses, including dimensional modelling
2. Build and maintain scalable data pipelines using ETL/ELT processes
3. Design and optimise data architectures including data warehouses and data lakes
4. Ensure data quality, security, and governance compliance across all systems
5. Collaborate with analysts and data scientists to understand and deliver on requirements Monitor and improve pipeline performance, reliability, and efficiency
6. Implement DevOps practices including CI/CD and containerised development Conduct unit testing and ensure code quality
What You'll Bring
7. Strong proficiency in DevOps, CI/CD, containerised development, and unit testing practices
8. Expertise in SQL across major platforms (PostgreSQL, MySQL, Oracle) and NoSQL databases
9. Proficiency in Python and PySpark for data processing and transformation
10. Experience with Google Cloud Platform (GCP) services Data engineering experience with a focus on building scalable, reliable systems
11. Strong problem-solving skills and attention to detail
12. Tertiary qualifications in Computer Science, Information Technology, Engineering, or a related discipline
Highly Valued:
13. Data migration experience, particularly in Defence or government contexts involving legacy system
14. modernisation Experience with big data technologies and distributed processing
15. frameworks API integration experience for connecting diverse data sources and system
#J-18808-Ljbffr