About the Role:We are seeking a highly skilled Chief Product Engineer - Big Data to design, build, and modernize enterprise-scale Big Data frameworks in the cloud. You will lead software engineering initiatives, architect distributed systems, and drive innovation in big data engineering and secure application development.Key Responsibilities:Lead and mentor a team of software engineers delivering large-scale Big Data solutions.Architect and deliver cloud-native Big Data frameworks (Azure Cloud focus).Design automation utilities for legacy pipeline migration at scale.Optimize performance of big data ingestion and processing pipelines.Implement and enforce data encryption, application security, and DevSecOps best practices.Develop APIs and metadata models to enhance data pipeline flexibility and user experience.Integrate big data systems with Hadoop ecosystem tools (HDFS, Hive, HBase, Phoenix, YARN).Drive continuous improvement of deployment automation through CI/CD pipelines (e.g., Jenkins, GitHub Actions).Collaborate with platform users and stakeholders to capture requirements and deliver secure, scalable solutions.Minimum Qualifications:12+ years in Python, Spark, and SQL development.Deep expertise with Hadoop technologies and Big Data frameworks.Hands-on experience with Azure services: ADLS, AKV, CosmosDB, Event Hubs.Proficiency in DevSecOps, data encryption techniques, and secure software architecture.Strong background in software engineering principles, distributed systems design, and test-driven development.Solid experience leading engineering teams and delivering enterprise-scale platforms.Excellent understanding of API development with Flask, FastAPI, or Django.Familiarity with data visualization tools like Qlikview/Qliksense is a bonus.Education:Bachelor's degree in Information Technology, Computer Science, or a related field (Distinction preferred).Preferred:Experience building greenfield cloud migration projects.Proven track record improving engineering cycle times and performance metrics.Why Join Us:Work on cutting-edge cloud Big Data technologies.Leadership opportunities with high-impact engineering teams.Competitive salary and benefits.Flexible working arrangements.Be part of a culture that values innovation, security, and engineering excellence.Seniority levelDirectorEmployment typeFull-timeJob functionEngineering and Information TechnologyIndustriesIT Services and IT Consulting
#J-18808-Ljbffr