Our state government client is seeking a Senior Data Engineer on the delivery of a analytics project. This role is ideal for someone who enjoys working on a project driven environment, meeting deadlines and collaborating with different teams.
Key Responsibilities
Design, develop and test secure scalable REST APIs
Build and optimised ETL pipelines for efficient performance
Develop workflow orchestration to manage job dependencies, reliabilities and scheduling
Package application workloads and data processes using Docker
Build cloud native solution using AWS services
Ensure security, governance and best practices are followed
Identify bottlenecks and implement performance improvements
Implement structured logging and auditing to support taceabilility, compliance and operational monitoring
Perform testing, troubleshooting and optimisation
Collaborate with different teams to deliver project outcomes on schedule
Mandatory Skills and Experience
Demonstrate experience on working on a software development project
Strong background in ETL development and workflow orchestration
Experience with orchestration tools such as Rundeck, AWS Step function
Familiarity with ETL tools likes Pentaho, Apache Hop
Strong hands on experience with developing APIs
Proficiency in SQL and relational databases(Oracle/Postgres)
Solid experience with AWS services - Glue, Lambda, S3, RDS, IAM, SecretManager, SQS, EventBridge, CloudWatch ...
Practical experience using Docker for packaging workloads
Strong communication and teamwork skills
Ability to manage priorities and deliver within project timelines
Desirable skills
Experience with CI/CD tools
Understanding of Agile/Scrum methodologies
Experience with performance and load testing tools
Understanding of mircoservices and distributed architecture
Familiarity with high volume transactions and concurrent processing
Knowledge of Infrastructure as Code like Terraform
Hourly rate:$120+super
Location: Paramatta
Duration- End of June + Possible extension
We prefer candidates with Previous experience in similar role. If you meet the criteria, please send the resumes directly to OR call me