Data Engineer
1. Permanent role
2. Hybrid and flexible working environment
3. Sydney (Norwest) office location
About Woolworths
Woolworths Group is a food and everyday needs retailer united by the shared purpose of creating better experiences together for a better tomorrow. With more than 1,400 stores across its Woolworths Supermarkets, Countdown Supermarkets (New Zealand) and BIG W brands, and fast-growing eCommerce businesses, Woolworths Group is Australia and New Zealand’s largest retailer. A top 10 company on the Australian Securities Exchange (ASX), Woolworths Group employs more than 180,000 team members and serves more than 20 million customers a week.
About the role
The Risk Analytics team helps the risk community across Woolworths Group use data to make risk-informed choices with confidence and helps them focus on what matters most. The team drives the organisation towards the effective use of data and analytics to support decision-making and early detection of issues across Woolworths Group
We are searching for a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and infrastructure on GCP to support our organisation's data-driven initiatives.
Responsibilities will include, but are not limited to:
4. Design and develop scalable, reliable, and efficient data pipelines using GCP technologies such as BigQuery, Cloud Dataflow, Cloud Storage, and Pub/Sub.
5. Architect and implement data models, schemas, and structures that support optimal data storage, retrieval, and analysis.
6. Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and implement solutions that meet business needs.
7. Optimise data workflows and ensure data quality, integrity, and security throughout the entire data lifecycle.
8. Perform data modelling, schema design, and performance tuning to support efficient data storage and retrieval.
9. Implement data governance practices and ensure compliance with Group Data Management policies
10. Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to ensure system stability and performance.
11. Ensure data quality and integrity by implementing robust data validation, cleansing, and governance processes.
12. Stay up to date with the latest advancements in GCP technologies and provide recommendations for adopting new tools and frameworks to enhance data engineering capabilities.
13. Develop and maintain documentation for data engineering processes, workflows, and solutions.
Who we are looking for
We are looking for an experienced Data Engineer, with proven technical capabilities, alongside excellent problem-solving skills and the ability to analyse complex data-related issues.
This role will work on a variety of data engineering projects within the risk team and will collaborate closely with data science and analytics team members.
Requirements:
14. Proven experience in data engineering, with a focus on designing and implementing solutions on Google Cloud Platform.
15. Strong proficiency in GCP services such as BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, and Data Catalog.
16. Solid understanding of data modelling, ETL/ELT processes, and data integration techniques.
17. Proficiency in programming languages such as Python, Java, or Scala, with experience in writing efficient and scalable code.
18. Experience with version control systems Git) and CI/CD practices.
19. Familiarity with data governance, data security, and compliance frameworks.
20. Ideally a Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
21. Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Grow with the Group
As an inclusive, team-first company