3 weeks ago Be among the first 25 applicants
We are seeking a seasoned Data Engineer with expertise in Cloudera, Hadoop, and Spark to develop and optimize data ingestion pipelines. This role is ideal for a professional with a strong background in building and managing large-scale data infrastructures, specifically in a dynamic environment such as the banking sector.
Key Responsibilities:
* Design, construct, install, test, and maintain highly scalable data management systems, ensuring optimal extraction, transformation, and loading (ETL) of data from diverse data sources using SQL, Spark, and Cloudera technologies.
* Build high-performance algorithms, predictive models, and prototypes using Spark and Scala to support data analytics initiatives.
* Manage and deploy interactive Hive queries for data analysis and manipulation.
* Ensure data privacy and compliance with data governance standards and regulatory requirements.
* Collaborate with stakeholders, including Executive, Product, Data, and Design teams, to address data-related technical issues and support their data infrastructure needs.
* Work closely with data scientists to transform raw data and integrate algorithms and models into automated processes.
Software Requirements:
* Proficient in Spark, Scala, and Hive, with hands-on experience in Cloudera Data Platform (CDP).
* Strong experience in building and optimizing big data pipelines, architectures, and datasets.
* Solid experience with Spark SQL and ANSI SQL for data manipulation and analysis.
* Familiarity with data pipeline and workflow management tools.
Category-wise Technical Skills:
* Big Data Technologies: Expertise in Cloudera, Hadoop ecosystem, and Spark frameworks.
* Data Management: Strong understanding of ETL processes and data ingestion techniques.
* Programming Languages: Proficient in Scala and Spark for data processing and algorithm development.
* Data Analysis: Experience with Hive and SQL for querying data and generating insights.
Experience:
* 7 to 10 years of experience in data engineering, with a strong focus on Cloudera, Hadoop, Spark, and Scala.
* Experience in the banking sector, with a preference for experience in Payments or Financial Crime.
* Proven track record of supporting and collaborating with cross-functional teams in a fast-paced environment.
Day-to-Day Activities:
* Design and implement scalable data pipelines and ETL processes.
* Optimize existing data architectures and workflows for performance and efficiency.
* Collaborate with data scientists and analysts to support data-driven decision-making.
* Conduct regular maintenance and updates of data management systems.
* Participate in team meetings to discuss project progress, challenges, and solutions.
Qualifications:
* Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
* Relevant certifications in big data technologies (e.g., Cloudera Certified Developer for Apache Hadoop) are a plus.
Soft Skills:
* Strong project management and organizational skills, with the ability to manage multiple tasks and deadlines.
* Excellent communication and interpersonal skills to collaborate effectively with various stakeholders.
* Proactive and solution-oriented mindset, with strong analytical and problem-solving abilities.
* Ability to thrive in a dynamic environment and work well under pressure.
Seniority level
* Seniority level
Mid-Senior level
Employment type
* Employment type
Full-time
Job function
* Job function
Finance
Referrals increase your chances of interviewing at Synechron by 2x
Sign in to set job alerts for “Data Engineer” roles.
Sydney, New South Wales, Australia 6 days ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 2 weeks ago
Macquarie Park, New South Wales, Australia 2 months ago
Sydney, New South Wales, Australia 23 hours ago
Data Engineer, 2025/2026 Intern Australia & New Zealand
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 6 days ago
Sydney, New South Wales, Australia 3 weeks ago
Frenchs Forest, New South Wales, Australia 4 weeks ago
Software Engineer (Python) - Data Platform (Open to remote across ANZ)
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 3 weeks ago
Minchinbury, New South Wales, Australia 6 days ago
Sydney, New South Wales, Australia A$170,000.00-A$200,000.00 2 weeks ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 1 day ago
Sydney, New South Wales, Australia 2 weeks ago
Software Engineer, Early Career, NetSoft
Sydney, New South Wales, Australia 4 days ago
Sydney, New South Wales, Australia 5 days ago
Liverpool, New South Wales, Australia 1 day ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 3 weeks ago
Mascot, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 4 days ago
Haymarket, New South Wales, Australia 13 minutes ago
Sydney, New South Wales, Australia 2 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr