We are seeking an experienced Data Engineer to join our team and play a key role in building robust data pipelines that unlock new business insights. As part of our Data & Growth Strategy Team, you will collaborate with Senior Data Engineers to design and implement cutting-edge tools and technologies such as Apache Spark, Apache Kafka, AWS EMR, AWS Glue, Hive, and DataBricks for both local and global projects.
About this Role
This position is responsible for making quality data available to data consumers like Data Scientists and Data Analysts by building data pipelines, so they can focus on developing data products such as machine learning models, dashboards, and analytical deep dives. The team works closely with our global Data Engineering team to ensure ANZ data architecture and data pipelines align with global Data Engineering projects and strategies.
As a Data Engineer, you will assess data engineering opportunities and current process improvements in collaboration with the Data Product team to help the organisation produce more value from vast amounts of data processed and collected.
The ideal candidate has 2-4 years' work experience as a Data Engineer, hands-on experience in building production-ready end-to-end data pipelines with AWS, and worked with SQL, Python, Spark, Kafka, cloud-based services (AWS S3, EMR, Glue), and containers (Docker, Kubernetes, ECS, EKS). Strong project management and prioritization skills, good interpersonal and communication skills with technical and non-technical audiences, and a willingness to learn and share best practices are essential.
You Will...
* Build and engineer data pipelines that make decision-critical data available for data consumers.
* Promote data literacy and enablement by upholding data engineering best practices.
Key Responsibilities:
* Design and implement data pipelines using Apache Spark, Apache Kafka, and other cutting-edge tools and technologies.
* Collaborate with Senior Data Engineers to build robust data pipelines.
* Work with data consumers to understand their needs and develop solutions.
* Assess data engineering opportunities and current process improvements.
Requirements:
* Experience as a Data Engineer with 2-4 years of experience.
* Hands-on experience in building production-ready data pipelines with AWS.
* Strong project management and prioritization skills.
* Good interpersonal and communication skills with technical and non-technical audiences.
Benefits:
* A chance to have a significant impact on one of the fastest-growing companies in the world.
* Professional and technical learning opportunities.
* Flexible working arrangements.
* Egoless environment, constant learning with room for personal growth.
* Diverse and vibrant international environment.
What We Offer:
* A competitive salary and benefits package.
* Ongoing training and development opportunities.
* A collaborative and dynamic work environment.
* The opportunity to work on high-profile projects and contribute to the company's growth and success.