Outsized Sydney, New South Wales, AustraliaOutsized Sydney, New South Wales, Australia3 weeks ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from OutsizedProject DescriptionContract: 6-MonthsWorking Arrangement: HybridOur client, a leading bank, is seeking an experienced Senior Data Engineer to enhance their Big Data and Data Warehouse capabilities, leveraging cutting-edge technologies to optimise data-driven decision-making.The ideal talent will lead the development of data pipelines, ensure data quality and security, and collaborate with stakeholders to build scalable, high-performing solutions. The role requires expertise in Hadoop, Spark, Kafka, and Python/Java/Scala, with strong experience in designing and implementing data integration, ingestion, and transformation processes. The talent will work in an Agile environment, engaging with internal teams and mentoring junior engineers.Key Activities:Design, develop, and optimise Big Data pipelines and data processing solutions using Hadoop, Spark, and other modern data technologies.Develop efficient and secure data ingestion, integration, and transformation processes from various internal and external sources.Implement best practices for data governance, quality assurance, and security controls.Lead data engineering projects and provide mentorship to junior engineers.Collaborate with stakeholders to define data engineering blueprints and roadmaps.Work in Agile teams, contributing to sprint planning and continuous improvements.Optimise SQL queries and implement scalable ETL frameworks for distributed data storage and processing.Your Background:5+ years of experience in Data Engineering, specialising in Big Data and Data Warehouse platforms.Strong programming skills in Scala, Java, or Python for data engineering solutions.Expertise in Hadoop ecosystem (Spark, MapReduce, Hive, Sqoop, Kafka).Experience in Unix/Linux shell scripting and writing complex SQL queries.Proven ability to lead projects and mentor data engineers.Hands-on experience with data security, compliance, and governance frameworks.Experience working in Agile teams, engaging with internal business stakeholders.Experience in Teradata, Oracle, or RDBMS-based data warehousing.Certification in Cloudera CDP, Hadoop, Spark, Teradata, AWS, or Ab Initio.Experience with AWS (EMR, Redshift, DocumentDB, S3, etc.).Background in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.).Who are we?Outsized is a curated platform of professional freelancers, independent consultants, and specialist consulting firms - all tailored to the needs of the financial services sector in Asia, Africa and the Middle East. We support insurers, banks, financial inclusion organizations as well as management consulting firms in the finance space. We help them find the best freelancers and independent consultants in the professional/ white-collar areas, from our leading growth markets-focused ecosystem of curated expertise. Since launching in 2016, the business has delivered strong performance and is working with household names across BFSI, private equity, FMCG and consulting.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeContractJob functionJob functionEngineering, Information Technology, and OtherIndustriesBanking and Financial ServicesReferrals increase your chances of interviewing at Outsized by 2xGet notified about new Data Engineer jobs in Sydney, New South Wales, Australia.We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr