Join to apply for the Senior Data Engineer role at Cognizant2 weeks ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at CognizantWhat makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.Position SummaryData Engineer with 7+ years of experience with end-to-end Big Data Pipeline design, ETL pipeline build using Apache Spark, Py-Spark, hive and having hands-on experience in building real-time data pipeline using HBase and Hadoop ecosystem.Have knowledge in AWS environment and worked on mainly Agile methodology.Working for a service-based IT consultancy will provide opportunities to work for different clients all over the globe and explore different scenarios including live streaming data. This will expose you to different types of enterprise environments, which will help you gain knowledge in terms of technology, people, processes, and delivery.Mandatory SkillsSkills/Tools: Apache Spark, MapReduce, Sqoop, Py-spark, Spark SQL, KafkaDatabase: Hive, MySQL, Oracle, HBaseLanguage and No-SQL : Python and HBaseBuild Tools: Expertise in setting up and managing continuous integration and continuous deployment pipelines in Bitbucket and JenkinsJob Scheduler: Familiarity with control-M scheduling tool for ordering the Job pipeline.Monitoring and Logging: Skills in using monitoring tools and analysing the root cause using Spark Logs and control m logSecurity and Compliance: Understanding of security best practices and compliance requirementsBusiness Domain Knowledge: Banking (BFSI)Roles And ResponsibilitiesBeing part of the Data Product team, building the data Transformation- more precisely on Data Transform Built a data product which will be able to collect customer data from various sources from raw layers to create comprehensive customer profiles into different layers.Built an end-end Metadata driven data Quality Framework that can be utilized across different projects which consists of Metadata, Attribute and Process sheets.Involved in Building Python Scripts for temporary transformation tables using Py-spark and Spark SQL before populating the records into SCD TableWork on complex data structures.Work on analyzing the jobs and providing RCA if issues raised post sprint Release.Take part in an Implementation and Design Walkthrough with various teams and work on Production Deployment on change related Activities.Proven Experience in delivering projects successfully through effective planning, prioritizing, team building, task scheduling and tracking scheduled tasks.Utilize Atlassian tools, including Jira, confluence, and Bitbucket, for project management and team collaboration.Involve on doing the Tech PIV and testing the functionality of the tables as part of Production ImplementationSalary Range: >$100,000Date of Posting: 26th of May 2025Next Steps: If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers. Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionInformation TechnologyIndustriesIT Services and IT Consulting and Business Consulting and ServicesReferrals increase your chances of interviewing at Cognizant by 2xSign in to set job alerts for “Senior Data Engineer” roles.Sydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 4 months agoSydney, New South Wales, Australia 3 weeks agoSydney, New South Wales, Australia 1 day agoMillers Point, New South Wales, Australia 1 day agoSenior Software Engineer - Global Payroll PlatformSenior Software Engineer - Global Payroll PlatformSydney, New South Wales, Australia 2 weeks agoSenior Analyst | Workplace Integrity DataSydney, New South Wales, Australia 3 weeks agoSydney, New South Wales, Australia 1 day agoParramatta, New South Wales, Australia 1 week agoSydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 3 weeks agoSenior ANZ Database Specialist Solutions Architect, AGS Specialists Data and AISydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 4 days agoSydney, New South Wales, Australia 2 weeks agoSenior Finance Analyst | Data and TransformationSydney, New South Wales, Australia $140,000.00-$180,000.00 2 weeks agoSenior Business Analyst - Data GovernanceMacquarie Park, New South Wales, Australia A$800.00-A$1,000.00 3 weeks agoSenior ANZ GenAI / ML Specialist Solutions Architect, AGS Specialists Data and AISydney, New South Wales, Australia 3 weeks agoAPS6 Senior Analyst / EL1 Manager, Data Insights and VisualisationSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 1 month agoSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 2 weeks agoSurry Hills, New South Wales, Australia 1 week agoValidation & Verification and Hardware Engineering ManagerLane Cove West, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 3 days agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr