We are seeking a highly skilled Lead Databricks Engineer to join our client’s growing team. This is a hands-on leadership role where you will set the technical direction, mentor engineers, and drive best practices while delivering robust, high-performing data solutions.
Responsibilities of the role include:
- Provide technical leadership to a team of engineers, establishing best practices for coding, performance, and CI/CD pipelines.
- Design and implement end-to-end data pipelines (ETL/ELT) to support scalable, high-quality data solutions.
- Remain hands-on in development to optimise performance and maintain data quality across all pipelines.
- Implement robust data validation, cleansing, and governance processes, including security controls such as Data-bricks Unity Catalog.
Experience required:
- 5+ years in Data Engineering Lead position with proven experience managing a team.
- Solid experience with Databricks (Azure).
- Must have hands-on experience with DBT Core
- Advanced proficiency in Python and SQL, with in-depth knowledge of the Apache Spark ecosystem.
- Strong track record working with at least one major cloud platform (Azure, AWS, or GCP).
- Exceptional problem-solving ability, with expertise in diagnosing and resolving complex data engineering challenges.
If you are interested, please apply now. For a confidential discussion, please reach out to *************@talentinternational.com
📌 Lead Databricks Developer
🏢 Talent International
📍 Sydney