Join to apply for the Lead Data Engineer | CIE role at Macquarie Group
1 week ago Be among the first 25 applicants
Join to apply for the Lead Data Engineer | CIE role at Macquarie Group
Get AI-powered advice on this job and more exclusive features.
Join our Customer Intelligence Engine (CIE) Technology team and help us build the best technology business in financial services. This is a great opportunity to be in a leadership as well as hands on role while working with a team of talented engineers in developing the next generation Customer Intelligence Engine.
At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 31 markets and with 56 years of unbroken profitability. You’ll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes.
What role will you play?
As a Lead Data Engineer, you will architect, build, and maintain scalable and efficient data pipelines using Java to process large volumes of data from various sources. Implement best practices for data organisation and storage. You will Develop and maintain microservices to support data processing and integration tasks, ensuring high availability, scalability, and fault tolerance.
You will design and implement real-time data streaming solutions using Apache Kafka. Ensure data is processed and delivered in a timely manner to downstream systems and establish and enforce data quality standards, implement data governance policies, and ensure compliance with regulatory requirements. You will also monitor data pipelines for accuracy and performance while leading and mentoring junior data engineers.
What You Offer
* Bachelor’s degree in Computer Science, Engineering, Information Technology, Maths, or a related field
* Extensive experience in Python OR Java for developing data processing solutions
* Experience with data processing pipelines and streaming architectures, and proficiency with relevant tools, technologies, and frameworks for real-time data ingestion, transformation, and analysis
* Strong understanding and hands-on experience with microservices architecture and development
* Expertise in relational databases (PostgreSQL, MySQL, SqlServer)
* Knowledge of designing and managing data flow patterns to efficiently process both real-time and batch data, leveraging Lambda and Kappa architectural frameworks
* Data quality assurance and testing experience
* Ability to lead projects and mentor junior data engineers.
We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply.
About Technology
Technology enables every aspect of Macquarie, for our people, our customers and our communities. We’re a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow’s technology solutions.
Our commitment to diversity, equity and inclusion
We are committed to fostering a diverse, equitable and inclusive workplace. We encourage people from all backgrounds to apply and welcome all identities, including race, ethnicity, cultural identity, nationality, gender (including gender identity or expression), age, sexual orientation, marital or partnership status, parental, caregiving or family status, family and domestic violence status, neurodiversity, religion or belief, disability, or socio-economic background. We welcome further discussions on how you can feel included and belong at Macquarie as you progress through our recruitment process. To learn more, contact our team by clicking here.
Our aim is to provide reasonable adjustments to individuals who may need support during the recruitment process and through working arrangements. If you require additional assistance, please let us know in the application process.
Seniority level
* Seniority level
Mid-Senior level
Employment type
* Employment type
Full-time
Job function
* Job function
Information Technology
Referrals increase your chances of interviewing at Macquarie Group by 2x
Get notified about new Data Engineer jobs in Sydney, New South Wales, Australia .
Sydney, New South Wales, Australia 1 day ago
Macquarie Park, New South Wales, Australia 4 months ago
Sydney, New South Wales, Australia 3 weeks ago
Sydney, New South Wales, Australia 2 days ago
Greater Sydney Area A$140,000.00-A$190,000.00 1 week ago
Sydney, New South Wales, Australia 3 weeks ago
Sydney, New South Wales, Australia 4 days ago
Sydney, New South Wales, Australia 2 weeks ago
Pyrmont, New South Wales, Australia 4 weeks ago
Surry Hills, New South Wales, Australia 1 week ago
Sydney, New South Wales, Australia A$130,000.00-A$150,000.00 3 days ago
Sydney, New South Wales, Australia 4 days ago
Software Engineer, Early Career, NetSoft
Millers Point, New South Wales, Australia 3 days ago
Sydney, New South Wales, Australia 1 day ago
Baulkham Hills, New South Wales, Australia 1 week ago
Sydney, New South Wales, Australia 3 days ago
Macquarie Park, New South Wales, Australia 6 months ago
Sydney, New South Wales, Australia 1 day ago
Sydney, New South Wales, Australia A$150,000.00-A$160,000.00 4 days ago
Sydney, New South Wales, Australia 3 weeks ago
Sydney, New South Wales, Australia 5 days ago
Sydney, New South Wales, Australia 18 hours ago
Sydney, New South Wales, Australia 1 month ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 5 days ago
Sydney, New South Wales, Australia 2 months ago
Sydney, New South Wales, Australia 1 day ago
Kensington, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 3 weeks ago
Data Engineer - Brisbane, Sydney or Perth location
Sydney, New South Wales, Australia 3 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr