Director/Recruitment Specialist @ Recmatrix | IT & Non-IT Hiring | Ex-HCL
Location: Sydney/Melbourne
About the Role
We are seeking a highly skilled Senior Cloud Data Engineer to join our client's team.
In this role, you will work with cutting-edge cloud technologies to design and implement high-performance data management solutions.
You will collaborate closely with customers to build scalable data architectures using AWS and Snowflake, ensuring seamless integration and optimal performance.
Primary Skills
Snowflake (Snowpipe, SnowSQL, Data Loading)
DBT (Data Build Tool)
Secondary Skills
DataStage
Key Responsibilities
Architecting Scalable Solutions: Collaborate with customers to understand their requirements and design cloud-based data architectures on AWS and Snowflake that operate at large scale with high performance.
Snowflake Data Management: Develop and monitor Snowpipes for continuous data ingestion and perform data loading into Snowflake tables using SnowSQL (CLI).
Data Platform Implementation: Work with AWS services like EMR, Redshift, Kinesis, Athena, Glue, Lake Formation, S3, RDS to build and manage data platforms.
Security & Compliance: Ensure the security of cloud-based solutions, including the use of KMS keys for EMR clusters, and meet compliance standards.
Collaboration: Work with customers to advise on best practices and help transition data systems to production.
Assist with troubleshooting and optimization.
Automation & DevOps: Automate deployment and infrastructure using CloudFormation and other DevOps practices.
Familiarity with containerization and serverless computing is a plus.
Best Practices & Knowledge Sharing: Contribute to the AWS solution architect community by sharing learnings, reference architectures, and best practices.
Basic Qualifications
Education: Technical degrees in Computer Science, Software Engineering, or Mathematics.
Experience: 5+ years of experience in Data Engineering and hands-on experience with Snowflake and AWS Services (e.g., S3, Glue, Redshift).
Snowflake Expertise: Strong understanding of Snowflake architecture and performance optimization.
Teradata/DataStage: Understanding of Teradata or DataStage architecture and experience with tools like TPT, MLOAD, and BTEQ scripting.
Data Engineering Skills: Solid experience in data modelling, ETL processes, and data warehousing.
Security & Compliance: Knowledge of cloud security and compliance requirements.
Methodologies: Familiarity with Agile development and version control systems.
Communication & Leadership: Strong interpersonal, communication, and leadership skills.
Certifications: AWS Certified Data Analytics – Specialty (preferred).
Cloud & Migration Experience: Background in cloud and data engineering, with a focus on data migration.
Seniority Level
Mid-Senior level
Employment Type
Contract
Job Function
Information Technology
Industries: Software Development, IT System Custom Software Development, and IT Services and IT Consulting
Referrals increase your chances of interviewing at Recmatrix Consulting by 2x
Get notified about new Data Engineer jobs in Sydney, New South Wales, Australia.
Salary: A$150,******-A$170,******
#J-*****-Ljbffr