About the Role:
We are seeking a highly skilled Chief Product Engineer - Big Data to design, build, and modernize enterprise-scale Big Data frameworks in the cloud. You will lead software engineering initiatives, architect distributed systems, and drive innovation in big data engineering and secure application development.
Key Responsibilities:
* Lead and mentor a team of software engineers delivering large-scale Big Data solutions.
* Architect and deliver cloud-native Big Data frameworks (Azure Cloud focus).
* Design automation utilities for legacy pipeline migration at scale.
* Optimize performance of big data ingestion and processing pipelines.
* Implement and enforce data encryption, application security, and DevSecOps best practices.
* Develop APIs and metadata models to enhance data pipeline flexibility and user experience.
* Integrate big data systems with Hadoop ecosystem tools (HDFS, Hive, HBase, Phoenix, YARN).
* Drive continuous improvement of deployment automation through CI/CD pipelines (e.g., Jenkins, GitHub Actions).
* Collaborate with platform users and stakeholders to capture requirements and deliver secure, scalable solutions.
Minimum Qualifications:
* 12+ years in Python, Spark, and SQL development.
* Deep expertise with Hadoop technologies and Big Data frameworks.
* Hands-on experience with Azure services: ADLS, AKV, CosmosDB, Event Hubs.
* Proficiency in DevSecOps, data encryption techniques, and secure software architecture.
* Strong background in software engineering principles, distributed systems design, and test-driven development.
* Solid experience leading engineering teams and delivering enterprise-scale platforms.
* Excellent understanding of API development with Flask, FastAPI, or Django.
* Familiarity with data visualization tools like Qlikview/Qliksense is a bonus.
Education:
* Bachelor's degree in Information Technology, Computer Science, or a related field (Distinction preferred).
Preferred:
* Experience building greenfield cloud migration projects.
* Proven track record improving engineering cycle times and performance metrics.
Why Join Us:
* Work on cutting-edge cloud Big Data technologies.
* Leadership opportunities with high-impact engineering teams.
* Competitive salary and benefits.
* Flexible working arrangements.
* Be part of a culture that values innovation, security, and engineering excellence.
Seniority level
Director
Employment type
Full-time
Job function
Engineering and Information Technology
Industries
IT Services and IT Consulting
#J-18808-Ljbffr