We are seeking a talented Data Engineer to join our Customer Intelligence Engine (CIE) Technology team at Macquarie Group. This is an opportunity to contribute to the development of innovative financial technology solutions that make a real impact.
Macquarie Group is a leading financial institution with 55 years of profitability, operating in 34 markets worldwide. We value diversity and empower our people to shape possibilities, creating a collaborative environment where everyone contributes ideas and drives outcomes.
Key Responsibilities
* Design and develop scalable data pipelines using Java to process large volumes of data from various sources, ensuring high availability and scalability.
* Develop and maintain microservices supporting data processing and integration, enforcing data governance policies and ensuring regulatory compliance.
* Create real-time data streaming solutions using Apache Kafka, facilitating efficient data ingestion and analysis.
* Establish data quality standards, monitor data pipelines for accuracy and performance, and ensure adherence to regulatory requirements.
Requirements
* Bachelor's degree in Computer Science, Engineering, IT, Maths, or related field.
* Extensive experience in Python or Java for data processing solutions, with a strong understanding of microservices architecture.
* Familiarity with data pipelines, streaming architectures, and relevant tools for real-time data ingestion and analysis.
* Proficiency with relational databases (PostgreSQL, MySQL, SQL Server), as well as knowledge of data flow patterns, Lambda, and Kappa architectures.
* Experience with data quality assurance and testing, ensuring the delivery of high-quality data products.
About Us
We are committed to diversity, equity, and inclusion, welcoming applicants from all backgrounds. We provide reasonable adjustments during recruitment and employment, fostering a culture of inclusivity and respect. If you are inspired to build a better future, we encourage you to apply.