Join to apply for the Engineer - Data Platforms role at Westpac Group
Get AI-powered advice on this job and more exclusive features.
Job Description
Create your best future and join Westpac as an Engineer .
What’s the role?
The Data Platforms (DP) function comprises a team of data professionals dedicated to building innovative data capabilities for Westpac Group and shaping the future of banking. We focus on delivering initiatives that have a significant and positive impact on the Group.
In this hands-on role, you will be a strong technical expert, responsible for building real-time and batch data solutions. You will handle multiple programs concurrently and serve as a go-to SME for developing engineering solutions.
Responsibilities include:
1. Enhancing, maintaining, and supporting technical deliverables, including hands-on coding, ensuring quality, representing the team in forums, and aligning contributions with strategic roadmaps.
2. Designing and implementing scalable, reliable, and secure solutions, collaborating with cross-functional teams to gather requirements and ensure successful delivery.
3. Working with fellow Engineers to define technical directions, and coordinating with Service Owners and stakeholders to shape delivery roadmaps and ensure smooth execution.
What do I need?
1. Solid experience developing large-scale applications using Scala and Python, with handling large datasets via PySpark in production workloads.
2. Proven expertise in real-time streaming, time data processing, and pipelines.
3. Experience in optimizing Spark code using DAGs to enhance performance.
4. Experience with HDFS, Pig, Hive, HBase, Phoenix, etc.
5. Understanding of cloud platforms, especially Azure, with experience in ALDS, EventHub, Stream Analytics, HDInsight, Synapse Analytics, Data Factory, Cosmos DB, Kubernetes. Similar experience with AWS/GCP is also acceptable.
6. Strong functional programming skills and understanding of data warehousing concepts.
7. Experience with DevOps, CI/CD pipelines, and MLOps pipelines is advantageous.
8. Proficiency with source control tools like Bitbucket, and understanding of branching and merging strategies.
This role is part of the UNITE program, Westpac’s largest transformation project, aimed at simplifying processes, systems, and technology to improve customer experiences and operational efficiency.
Why join us?
We aim to be our customers' #1 banking partner for life, and we seek passionate individuals to help us achieve this. We offer:
* Special offers on banking products and discounts, including employee mortgage rates
* Flexible work arrangements and various leave options
* Tailored learning and career development opportunities
* Community involvement and volunteering initiatives
Create your future today
Click on the APPLY or APPLY NOW button to get started.
We are committed to an inclusive community, welcoming everyone regardless of age, gender, background, or abilities. Additional support is available for veterans, Indigenous Australians, and neurodiverse individuals. For adjustments during recruitment, visit the 'People with Disability and/or needing Accessibility Requirements' page on our website.
Additional Details
* Seniority level: Associate
* Employment type: Full-time
* Job function: Information Technology
* Industries: Banking, Financial Services, Investment Banking
#J-18808-Ljbffr