Overview
We are seeking a highly skilled Senior Dataiku Architect to lead the migration of analytics and data workloads from Lavastone to Dataiku, operating within a Snowflake data platform environment. This is a hands-on architecture role requiring deep Dataiku DSS expertise, strong Python and SQL engineering, and the ability to guide delivery across culturally diverse onshore and offshore teams.
A key expectation of this role is modern engineering practice, including the effective use of AI-assisted coding and automation tools such as Claude Code and GitHub Copilot to accelerate delivery, improve repeatability, and uplift quality, with appropriate governance and validation.
Key Responsibilities
Architecture and Migration Leadership
* Lead end-to-end migration planning and execution for workloads transitioning from Lavastone to Dataiku
* Define target-state architecture for Dataiku projects, workflow patterns, and environment strategy (DEV/UAT/PROD)
* Establish migration approach: discovery, workload assessment, prioritisation, rebuild/refactor patterns, and cutover planning
* Ensure functional parity, performance improvements, and operational readiness post-migration
* Identify and mitigate migration risks including dependency mapping, environment differences, and data quality issues
Dataiku Platform Architecture and Standards
* Architect Dataiku DSS solutions including project structure, modular design, reusability, and performance optimisation
* Establish best practices for visual vs code recipes, managed folders, dataset design, and orchestration patterns
* Design automation and operational controls using scenarios, triggers, scheduling, monitoring, and alerting
* Provide hands-on technical direction and governance, including reviews and technical decisioning
Snowflake Data Platform Engineering
* Architect integration patterns between Dataiku and Snowflake (ELT/ETL strategy, pushdown optimisation, compute management)
* Drive best practices for SQL design, query optimisation, data modelling patterns, and incremental processing
* Ensure secure and efficient data access patterns aligned to enterprise security expectations
AI-Assisted Engineering and Coding Automation
* Use Claude Code and GitHub Copilot to accelerate engineering outputs (code generation, refactoring, documentation, test scaffolding)
* Define safe usage patterns: code validation, testing requirements, peer review, security and IP awareness
* Build and promote coding automation patterns to reduce repetitive work and improve delivery consistency
Leadership, Collaboration and Stakeholder Management
* Lead and mentor Dataiku developers (including offshore resources), providing clear technical direction and coaching
* Work effectively with product owners, data platform teams, and stakeholders to translate requirements into technical delivery
* Communicate clearly across culturally diverse teams and maintain high delivery cadence
Required Skills and Experience
* Extensive enterprise experience with Dataiku DSS (architecture + hands-on build)
* Proven track record delivering platform/workload migrations, ideally tool-to-tool migration (e.g., Lavastone to Dataiku)
* Strong Python engineering skills (OOP, packaging, performance tuning, reliability, testing)
* Advanced SQL skills with strong Snowflake experience (optimisation, ELT patterns, modelling)
* Strong experience with workflow orchestration, scheduling, automation, monitoring, and production support patterns
* Experience with source control and engineering discipline (GitHub, PRs, branching, reviews)
* Demonstrated ability to lead teams and deliver through onshore/offshore models
Desirable / Nice to Have
* Exposure to CI/CD patterns for data/analytics workflows
* Understanding of MLOps concepts (model lifecycle, deployment patterns, monitoring)
* Experience uplifting governance, documentation, and operating model maturity
Personal Attributes
* Strong problem solver, proactive and outcomes-focused
* Quick learner, self-driven, and comfortable with ambiguity
* Strong interpersonal skills; effective communicator
* Comfortable working in culturally diverse teams
#J-18808-Ljbffr