Federal Government Agency - Sydney, Canberra Hybrid - 12 month contract Australia Citizen with ability to obtain NV1 clearance This Federal Government Agency is looking for a Senior Data Engineer to work collaboratively with a cross-functional team and be responsible for the following:- Delivering high quality pipeline and API code aligned to approved designs and industry best practice implementations. Technical release co-ordination, within the team for weekly releases and to all clients for cutover releases. Proactive management of potential API outages to internal and external clients. Experience 5 years in senior software engineer roles Commercial experience with Apache Spark, Kafka and the Elastic stack (Kibana, Logstash, Elasticsearch) Experience in choosing & writing efficient processing algorithms. Previous experience with containerisation and associated tools (including Rancher, Kubernetes) Experience with automated testing frameworks. Knowledge and Skills Excellent development skills in Java An understanding of continuous delivery techniques and tools (including Jenkins). Ability to work with business analysts and testers to define feature files (which explain data processing logic). Ability to write complex applications that use data from both SQL and NoSQL data stores (and optimise these applications for speed). Strong stakeholder engagement and leadership skills with a demonstrated ability to be able to work collaboratively with a cross-functional team. Qualifications Degree in Computer Science or equivalent NOTE: Applicants must be an Australian Citizen with ability to obtain a NV1 Security Clearance. If you have the right skills and experience please apply now through the job board quoting JL632080. Balance Recruitment is committed to equal opportunity employment. We celebrate diversity and encourage people from all sections of our community to apply for this role.