We are seeking an ambitious and self‐starting Data Engineer to join our client's team during a high‐growth phase. As they kick off Phase 2 delivery, you will play a critical role in maintaining, optimizing, and evolving their AWS platform.
Our client values innovation and efficiency. They are looking for someone who doesn't just "do the job" but actively leverages AI tools to automate workflows and drive results faster.
Melbourne‐based candidates with full time work rights only will be considered for this role as it is a requirement for this position and no sponsorship is on offer.
The Technical Skillset
* Data Integration: Expert‐level development using the Matillion platform to orchestrate complex ETL/ELT workflows.
* AWS Data Ecosystem: Proven expertise in S3 (Data Lake architecture), AWS Glue (Cataloging and Jobs), and Lambda (Serverless functions).
* Infrastructure as Code (IaC): Robust experience writing and maintaining Terraform and CloudFormation scripts to ensure "Infrastructure as Code" standards.
* Scripting & SQL: Advanced SQL for data transformation and Python for Lambda development and automation tasks.
* Data Modeling: Solid understanding of Data Warehousing concepts (Star/Snowflake schema) and data partitioning strategies.
Key Responsibilities & Tasks
* Pipeline Maintenance: Take ownership of existing Matillion and AWS pipelines, ensuring high availability and resolving bottlenecks.
* Phase 2 Delivery: Design and deploy new data features and integrations to support the next stage of the business roadmap.
* Automation: Utilize Terraform/CloudFormation to automate the deployment of cloud resources, reducing manual intervention.
* Performance Tuning: Optimize SQL queries and AWS Glue jobs to improve processing speed and reduce cloud consumption costs.
* Security & Governance: Implement and manage IAM roles, encryption, and data lifecycle policies within the AWS environment.
* Cross‐Functional Collaboration: Work closely with the wider team to cross‐skill, share knowledge, and ensure architectural alignment.
What You'll Bring
* Innovator's Mindset: You are enthusiastic about achieving new things and aren't afraid to suggest better ways of working.
* AI‐Driven Efficiency: You are a modern engineer who leverages AI (LLMs, Copilots) to be as productive and efficient as possible.
* Self‐Starter Attitude: You can take a high‐level brief and run with it, ensuring the platform remains stable and scalable.
* Industry Agnostic: Background in any industry is welcome—it's your technical craft and mindset that matter.
The Opportunity
While the initial contract is for 3–6 months, our client has a history of retaining high‐performing contractors for up to a year. This is a chance to work in a collaborative, office‐based environment where your contributions directly impact the success of a major project phase.
#J-18808-Ljbffr