Position
: Data Engineer
Location
: Sydney, NSW
Duration
: 6 months
Job Details:
Must Have Skills:
* Hands On with advanced SQL, Python etc.
* Hands On in data profiling
* Hands On in working on Cloud like Azure and Cloud DW like Databricks
* Hands On experience on Scheduling tools like Airflow, Control M etc.
* Knowledgeable on Big Data tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase)
* Knowledgeable in CICD processes – BitBucket/GitHub, Jenkins, Nexus etc.
* Knowledgeable managing structured and unstructured data types.
Nice to have skills :
* Experience in working with a team of data engineers working from different locations in different time zones.
* Excellent communication.
* Effective prioritisation
Pragmatic stakeholder management.Cloud Platform Familiarity: Understanding of cloud services (AWS, Azure, GCP) to analyze and optimize cloud-based systems.
Basic Scripting Knowledge: Ability to write simple scripts in Python, SQL, or R for data extraction, transformation, and analysis.
Experience
: 6 years