Job Description
Our team is seeking an experienced Data Engineer to design and develop innovative data products. As a key member of our Engineering team, you will work on creating scalable and efficient data solutions using the AWS technology stack.
Key Responsibilities:
* Develop and maintain data ingestion and transformation pipelines, cloud infrastructure, APIs, query engines, and orchestration platforms.
* Utilize Amazon Data Services such as Redshift, Glue, RDS, and EMR to build and deploy scalable data architectures.
* Design and implement data modeling techniques to meet business requirements.
Desirable Skills:
* Proficiency in Spark SQL with experience in tuning and optimization.
* Proven hands-on experience in developing and supporting ETL frameworks and tooling.
* Experience with Big Data technologies, focusing on Spark, DBT, Presto, and big data storage formats such as Parquet, ORC, Avro, and data pipeline orchestration tools like Airflow.
* Knowledge of containerization using Docker and Kubernetes.
Requirements:
* Mid-Senior level experience in data engineering.
* Contract employment type.
Location:
Sydney, New South Wales, Australia.
As a successful candidate, you will have the opportunity to collaborate with a talented team of professionals and contribute to the development of cutting-edge data products.