2 weeks ago Be among the first 25 applicants
Position: Lead/Senior/Principal Data Engineer
Location: Melbourne, Victoria
Job Type: Permanent Full Time
About the role
We are seeking an experienced Data Engineer for our client in the utilities/energy industry. There's quite a few projects going on right now, you will be pivotal in the following:
* Design, build, and maintain cloud-based (AWS) data pipelines and ETL processes using Databricks, ensuring high data quality, performance, and integrity across Bronze, Silver, and Gold layers.
* Develop scalable data models and transformations using Python and SQL, integrating data from internal, external, API, and real-time sources.
* Orchestrate data workflows and manage dependencies using tools such as Apache Airflow, DBT Core, or Databricks Workflows.
* Collaborate with cross-functional teams in an agile environment to gather data requirements and deliver reliable, high-quality data products.
* Leverage Spark, PySpark, Delta Lake, and CI/CD tools (e.g. GitLab) to enable efficient large-scale data processing and infrastructure deployment.
A Bit About You
We are looking for an individual who ideally possesses the following attributes and experiences:
* Strong experience in data engineering within modern cloud-based data lakehouse environments (AWS & Databricks).
* Proficient in Python and SQL for developing scalable data transformations and ETL workflows.
* Hands-on experience with Apache Spark, PySpark, and tools like Airflow and DBT for data orchestration.
* Skilled in version control and CI/CD practices using Git and platforms like GitLab.
* Familiar with data integration from APIs and other sources, with a strong understanding of data security and governance best practices.
There are a few vacancies for the same client. Looking for Principal/Lead/Senior Data Engineers who are still happy to remain hands-on.
Seniority level
* Seniority level
Mid-Senior level
Employment type
* Employment type
Full-time
Job function
* Job function
Information Technology
* Industries
Staffing and Recruiting
Referrals increase your chances of interviewing at Method Recruitment Group by 2x
Get notified about new Data Engineer jobs in Melbourne, Victoria, Australia .
Melbourne, Victoria, Australia 2 months ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 2 days ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 5 days ago
Melbourne, Victoria, Australia 1 week ago
Software Engineer (Python) - Data Platform (Open to remote across ANZ)
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia A$120,000.00-A$140,000.00 3 weeks ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia A$100,000.00-A$120,000.00 5 days ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 6 days ago
Melbourne, Victoria, Australia 6 days ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 2 days ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 7 hours ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 4 weeks ago
Melbourne, Victoria, Australia 5 days ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 2 days ago
Customer Engineer, Data and AI, Google Cloud
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 2 weeks ago
Melbourne, Victoria, Australia 1 week ago
Melbourne, Victoria, Australia 16 hours ago
Melbourne, Victoria, Australia 2 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr