Location: Sydney
Job Description:
Design, build, and optimize scalable data pipelines using Azure Data Services and Databricks. Develop robust ETL/ELT workflows using PySpark and Azure Data Factory. Write efficient and reusable Python code for data transformation, ingestion, and orchestration. Manage and optimize Delta Lake tables for performance and reliability. Integrate various Azure services (Data Lake, Synapse, Event Hubs, Key Vault) for end-to-end solutions. Implement and monitor data quality, lineage, and governance standards. Collaborate with data scientists and analysts to ensure data availability and usability. Ensure CI/CD pipelines for data workflows using Azure DevOps or GitHub Actions. Optimize Databricks clusters for cost and performance efficiency. Stay up to date with evolving Azure and Databricks features and recommend improvements Interested Candidates can share their updated resumes on or can reach me on +61 290 559 949.
Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Information Services, Data Infrastructure and Analytics, and Technology, Information and Media Referrals increase your chances of interviewing at CareCone Group by 2x
Get notified about new Data Engineer jobs in Sydney, New South Wales, Australia .
Macquarie Park, New South Wales, Australia 3 months ago
Sydney, New South Wales, Australia 2 days ago
Sydney, New South Wales, Australia 4 days ago
Sydney, New South Wales, Australia 4 days ago
Sydney, New South Wales, Australia 6 days ago
Data Engineer, 2025/2026 Intern Australia & New Zealand Sydney, New South Wales, Australia 1 day ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 3 days ago
Sydney, New South Wales, Australia 4 days ago
Sydney, New South Wales, Australia 4 days ago
Sydney, New South Wales, Australia 2 weeks ago
Software Engineer, Early Career, NetSoft Sydney, New South Wales, Australia 4 hours ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 2 days ago
Software Engineer (Python) - Data Platform (Open to remote across ANZ) Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 1 month ago
Sydney, New South Wales, Australia 2 weeks ago
Macquarie Park, New South Wales, Australia 5 months ago
Mascot, New South Wales, Australia 3 weeks ago
Sydney, New South Wales, Australia 4 weeks ago
Sydney, New South Wales, Australia 2 weeks ago
Sydney, New South Wales, Australia 1 day ago
Haymarket, New South Wales, Australia 5 days ago
Sydney, New South Wales, Australia 5 days ago
Sydney, New South Wales, Australia 3 days ago
Software Engineer, Early Career, iOS, Photos Sydney, New South Wales, Australia 2 weeks ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr