Job Title:
Cloud Data Engineer (AWS, Snowflake & Redshift)
Location:
Sydney/Melbourne
Job Type:
Contract/fulltime
About the Role:
We are seeking a highly skilled
Senior Cloud Data Engineer
to join our client's team. In this role, you will work with cutting-edge cloud technologies to design and implement high-performance data management solutions. You will collaborate closely with customers to build scalable data architectures using AWS and Snowflake, ensuring seamless integration and optimal performance.
Primary Skills:
* AWS (S3, Redshift, Glue, Kinesis, Athena, EMR, RDS, EC2, DynamoDB, ElastiCache, etc.)
* Snowflake (Snowpipe, SnowSQL, Data Loading)
* DBT (Data Build Tool)
Secondary Skills:
* Teradata (SQL, TPT, MLOAD, FASTEXPORT)
* DataStage
* Big Data (Hadoop, Cloudera)
Key Responsibilities:
* Architecting Scalable Solutions:
Collaborate with customers to understand their requirements and design cloud-based data architectures on AWS and Snowflake that operate at large scale with high performance.
* Snowflake Data Management:
Develop and monitor
Snowpipes
for continuous data ingestion and perform data loading into Snowflake tables using
SnowSQL
(CLI).
* Data Platform Implementation:
Work with AWS services like
EMR, Redshift, Kinesis, Athena, Glue, Lake Formation, S3, RDS
to build and manage data platforms.
* Security & Compliance:
Ensure the security of cloud-based solutions, including the use of
KMS keys
for EMR clusters, and meet compliance standards.
* Collaboration:
Work with customers to advise on best practices and help transition data systems to production. Assist with troubleshooting and optimization.
* Automation & DevOps:
Automate deployment and infrastructure using
CloudFormation
and other DevOps practices. Familiarity with containerization and serverless computing is a plus.
* Best Practices & Knowledge Sharing:
Contribute to the AWS solution architect community by sharing learnings, reference architectures, and best practices.
Basic Qualifications:
* Education:
Technical degrees in
Computer Science
,
Software Engineering
, or
Mathematics
.
* Experience:
5+ years of experience in Data Engineering and hands-on experience with
Snowflake
and
AWS Services
(e.g.,
S3, Glue, Redshift
).
* Snowflake Expertise:
Strong understanding of
Snowflake architecture
and performance optimization.
* Teradata/DataStage:
Understanding of
Teradata
or
DataStage
architecture and experience with tools like
TPT, MLOAD
, and
BTEQ
scripting.
* Data Engineering Skills:
Solid experience in
data modelling
,
ETL processes
, and
data warehousing
.
* Security & Compliance:
Knowledge of
cloud security
and
compliance
requirements.
* Methodologies:
Familiarity with
Agile development
and
version control systems
.
* Communication & Leadership:
Strong interpersonal, communication, and leadership skills.
* Certifications:
AWS Certified Data Analytics – Specialty (preferred).
* Cloud & Migration Experience:
Background in
cloud and data engineering
, with a focus on
data migration
.