Job Description
We are seeking an experienced GCP Data Engineer to join our team at Macquarie Bank Limited. In this role, you will be responsible for designing, developing, deploying, and supporting data assets.
Key Responsibilities:
* Coordinate requirements, schedules, and activities
* Contribute to team meetings, development, peer code reviews, and testing
* Create templates, implementation methods, standards, and frameworks
* Learn from senior developers about products and solutions servicing multiple businesses
Requirements:
* 5+ years of enterprise engineering experience working in a mature cloud environment, preferably GCP
* Proven experience in building and deploying data lakes and data warehouses on GCP using services such as BigQuery, Cloud Spanner, Cloud Functions, and GCS
* Solid experience in authoring complex SQL queries, CTEs, Data Definition Language (DDL) and performance optimizations
* Experience with working on real-time data streaming services like Pub/Sub or Kafka, and familiarity with orchestrating data pipeline workflows using Dataform
* Proficient in handling PII, data formatting and wrangling, and data preparation
* Experienced in ingesting data from various sources, including databases, APIs, streaming data feeds, and other cloud platforms
* Strong hands-on coding ability in Python, with experience in developing code-based ETL/ELT data pipelines and performance-optimized data modeling
About Us
Macquarie is a global financial services group operating in 34 markets and with 55 years of unbroken profitability. We are committed to fostering a diverse, equitable, and inclusive workplace.
Why Join Us
You will be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes. You will have the opportunity to work on challenging projects and collaborate with talented individuals from around the world.