Job Description:
Data Engineering Lead
As a Data Engineering Lead at Natural Selection Group, you will provide technical leadership in designing, developing, and operating systems to efficiently acquire, ingest, process, and store large data sets for consumption by data applications and platforms.
You will design and drive the development of data engineering solutions, balancing functional and non-functional requirements while aligning with strategic objectives. Additionally, you will monitor the application of data standards and architectures, including security and compliance.
Key Responsibilities:
* Lead the design and development of data engineering solutions, ensuring alignment with business objectives and adherence to data standards and architectures.
* Collaborate with cross-functional teams to implement cloud infrastructure and dev-ops practices, preferably on Azure.
* Mentor and guide junior team members in data analysis, preparation, and problem-solving skills.
* Develop and maintain databases, ensuring data quality, integrity, and security.
* Stay up-to-date with emerging technologies and trends in data engineering, making recommendations for implementation and adoption.
* Communicate effectively with stakeholders, presenting complex data insights and recommendations.
Requirements:
1. 6+ years of experience in data analysis, preparation, and engineering, including working with very large data sets and unstructured data.
2. Strong experience in database development, data model design, and SQL.
3. Extensive experience with at least two of the following technologies: Python, Scala, Java.
4. Experience working with Agile processes and practices, as well as traditional RDBMS, MPP (Snowflake), NoSQL, and DBT.
5. Exceptional written and verbal communication and problem-solving capabilities.
Tertiary Qualifications:
A tertiary qualification in Computer Science, Information Technology, or a related field is essential for this role.
We are seeking a skilled Data Engineering Lead who can drive innovation, collaboration, and excellence in our data-driven initiatives. If you are passionate about data engineering and have a strong track record of delivering results, we encourage you to apply.