2 weeks ago Be among the first 25 applicantsPosition: Lead/Senior/Principal Data EngineerLocation: Melbourne, VictoriaJob Type: Permanent Full TimeAbout the roleWe are seeking an experienced Data Engineer for our client in the utilities/energy industry. There's quite a few projects going on right now, you will be pivotal in the following:Design, build, and maintain cloud-based (AWS) data pipelines and ETL processes using Databricks, ensuring high data quality, performance, and integrity across Bronze, Silver, and Gold layers.Develop scalable data models and transformations using Python and SQL, integrating data from internal, external, API, and real-time sources.Orchestrate data workflows and manage dependencies using tools such as Apache Airflow, DBT Core, or Databricks Workflows.Collaborate with cross-functional teams in an agile environment to gather data requirements and deliver reliable, high-quality data products.Leverage Spark, PySpark, Delta Lake, and CI/CD tools (e.g. GitLab) to enable efficient large-scale data processing and infrastructure deployment.A Bit About YouWe are looking for an individual who ideally possesses the following attributes and experiences:Strong experience in data engineering within modern cloud-based data lakehouse environments (AWS & Databricks).Proficient in Python and SQL for developing scalable data transformations and ETL workflows.Hands-on experience with Apache Spark, PySpark, and tools like Airflow and DBT for data orchestration.Skilled in version control and CI/CD practices using Git and platforms like GitLab.Familiar with data integration from APIs and other sources, with a strong understanding of data security and governance best practices.There are a few vacancies for the same client. Looking for Principal/Lead/Senior Data Engineers who are still happy to remain hands-on.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionInformation TechnologyIndustriesStaffing and RecruitingReferrals increase your chances of interviewing at Method Recruitment Group by 2xGet notified about new Data Engineer jobs in Melbourne, Victoria, Australia.Melbourne, Victoria, Australia 2 months agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 2 days agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 5 days agoMelbourne, Victoria, Australia 1 week agoSoftware Engineer (Python) - Data Platform (Open to remote across ANZ)Melbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia A$120,000.00-A$140,000.00 3 weeks agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia A$100,000.00-A$120,000.00 5 days agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 6 days agoMelbourne, Victoria, Australia 6 days agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 2 days agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 7 hours agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 4 weeks agoMelbourne, Victoria, Australia 5 days agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 2 days agoCustomer Engineer, Data and AI, Google CloudMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 2 weeks agoMelbourne, Victoria, Australia 1 week agoMelbourne, Victoria, Australia 16 hours agoMelbourne, Victoria, Australia 2 weeks agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr