Overview
Join to apply for the Senior Data Engineer (AWS, Big Data) role at Commonwealth Bank.
We're building state-of-the-art data solutions that power seamless experiences for millions of customers. Our Data Engineering team is among the largest and most advanced in the country.
Responsibilities
* Collaborate on building enterprise-wide data ingestion, data integration, and data pipeline solutions using Scala, Java, or Python in a Big Data and Data Warehouse environment.
* Design and implement data solutions on Hadoop ecosystems (Spark, MapReduce, Sqoop, Kafka) and AWS Cloud technologies (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift/PostgreSQL, S3).
* Develop conceptual, logical, and physical data models using techniques such as Data Vault, Kimball, and 3NF; apply design patterns in data architecture.
* Contribute to data security, data quality, and data management practices; collaborate with stakeholders and engineers to deliver data-driven solutions.
What we are looking for (Qualifications)
* Experience building data products or data assets from scratch by integrating large data sets from hundreds of internal and external sources.
* Ability to collaborate, co-create, and contribute to existing Data Engineering practices in the team.
* Experience or ability to lead and mentor other engineers in Agile teams delivering projects or initiatives.
* Strong background in data design, data security, and data management; ability to educate and coordinate with internal stakeholders and consultants.
Technical Skills
* Experience designing, building, and delivering enterprise-wide data ingestion, data integration, and data pipeline solutions using Scala, Java, or Python in Big Data and Data Warehouse platforms.
* Experience with Hadoop ecosystem (Spark, MapReduce, Sqoop, Kafka) and ETL frameworks for distributed data storage and processing.
* Experience with AWS Cloud technologies (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift/PostgreSQL, DocumentDB/MongoDB, S3).
* Ability to produce conceptual, logical, and physical data models and apply data modeling techniques (Data Vault, Kimball, 3NF).
* Strong Unix/Linux shell scripting and programming skills in Scala, Java, or Python; proficiency in SQL for building data pipelines.
* Familiarity with data warehousing or data mart build experience in Teradata, Oracle, or RDBMS systems is a plus; experience with Ab Initio products is a plus.
Nice-to-Have
* Prior experience as a Tech Business Analyst.
* Skills in requirements gathering, data discovery, and stakeholder management.
Working with us
Our people bring diverse backgrounds and perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. We value our culture, support sharing ideas and energy, and strive to make a positive impact for customers and communities.
You'll be supported when faced with challenges and empowered to tackle new opportunities. We're hiring engineers from across Australia and have technology hubs in Melbourne and Perth. We offer flexible working options including part-time, job share, and varying start/finish times. Discuss what arrangements could work for you.
Accessibility and Additional Information
If you require additional support due to accessibility needs, please contact HR Direct on 1800 989 696.
Advertising End Date: 20/09/2025
#J-18808-Ljbffr