Position
: Senior Data Engineer
Location
: Sydney, NSW
Duration
: 6 months
Job Details:
* Must Have Skills:
* Hands On with advanced SQL, Python etc.
* Hands On in data profiling
* Hands On in working on Cloud like Azure and Cloud DW like Databricks
* Hands On experience on Scheduling tools like Airflow, Control M etc.
* Knowledgeable on Big Data tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase)
* Knowledgeable in CICD processes – BitBucket/GitHub, Jenkins, Nexus etc.
Knowledgeable managing structured and unstructured data types.
Nice to Have Skills:
* Experience in working with a team of data engineers working from different locations in different time zones.
* Excellent communication.
* Effective prioritization
* Pragmatic stakeholder management. Cloud Platform Familiarity: Understanding of cloud services (AWS, Azure, GCP) to analyze and optimize cloud-based systems.
* Basic Scripting Knowledge: Ability to write simple scripts in Python, SQL, or R for data extraction, transformation, and analysis.