Overview
Senior Data Engineer (AWS, Big Data) role with Commonwealth Bank based in Sydney, NSW, AU. This is a Senior Data Engineer role with Commonwealth Bank.
Role seniority
Senior
Responsibilities
* Building data solutions
* Collaborating with teams
* Leading and mentoring engineers in Agile teams delivering project work or initiatives
What you'll work on
To us, data is everything. It powers cutting-edge features and enables seamless experiences for millions of customers from app to branch. We're responsible for CommBank's key analytics capabilities and work to create world-leading capabilities for analytics, information management, decisioning and Generative AI. We work across platforms like AWS Cloud, Cloudera Hadoop Big Data, Teradata, Ab Initio, Gen AI, etc.
Technical Skills
We use a broad range of tools, languages, and frameworks. Experience or exposure with some of these (or equivalents) will set you up for success:
* Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using Scala, Java, or Python in Big Data and Data Warehouse platforms.
* Experience in building data solutions on Hadoop platforms using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing.
* Experience in building data solutions using AWS Cloud technologies (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift/PostgresSQL, DocumentDB/MongoDB, S3, etc.).
* Ability to produce conceptual, logical and physical data models using techniques such as Data Vault, Kimball, 3NF, and design patterns (FSLDM, IBM IFW DW).
* Unix/Linux shell scripting and programming in Scala, Java, or Python.
* Proficient in SQL scripting, writing complex SQL for building data pipelines.
* Familiarity with data warehousing/build experience in Teradata, Oracle or RDBMS is a plus.
* Experience with Ab Initio software products (GDE, Co>Operating System, Express>It, etc.) is a plus.
Nice-to-Have
* Prior experience as a Tech BA
* Skills in requirements gathering, data discovery, and stakeholder management
Working With Us
Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. We're driven by our values and supported to share ideas, initiatives, and energy. We're focused on making a positive impact for customers, communities and each other.
We offer flexibility to balance where work is done with at least half of time each month connecting in office, plus other options including different start and finish times, part-time arrangements and job share. Talk to us about how these arrangements might work in the role you're interested in.
If this sounds like the role for you, apply today. If you're already part of the Commonwealth Bank Group, you'll need to apply through Sidekick to submit a valid application. We're keen to support your next step in your career. For accessibility issues, contact HR Direct on 1800 989 696.
Note: This role is with Commonwealth Bank, not Hatch.
#J-18808-Ljbffr