Job Title: Senior Data Platform Specialist
Job Description:
We are seeking an experienced data platform professional to join our organization.
The successful candidate will be responsible for designing and implementing scalable and efficient data storage and retrieval systems, optimizing data lake performance, and ensuring the smooth handling of our data workloads on AWS.
* Implement and manage data lake solutions using Apache Iceberg to handle time-travel, schema evolution, and transaction support.
* Optimize data storage and querying by integrating Iceberg tables into AWS services like S3, Glue, Redshift, and EMR.
* Work closely with data scientists and analysts to ensure seamless data access and efficient data processing workflows.
* Monitor, troubleshoot, and optimize performance of data solutions, managing scalability and cost-effectiveness.
* Keep up-to-date with the latest AWS offerings and Apache Iceberg features, continuously improving our data infrastructure.
* Develop best practices for data governance, security, and compliance within our AWS and Iceberg environments.
* Document system designs, architectures, and operational manuals for data solutions.
To succeed in this role, you must have extensive experience with AWS data services and a strong understanding of Apache Iceberg. A proven track record in building and optimizing data lakes and data warehouse solutions is also required.
Required Skills and Qualifications:
Our ideal candidate will possess the following skills and qualifications:
* Extensive experience with AWS data services.
* Strong understanding of Apache Iceberg.
* Proven track record in building and optimizing data lakes and data warehouse solutions.
* Proficiency in working with big data processing tools and frameworks.
* Strong coding skills in languages such as Python, Java, or Scala.
* Experience with infrastructure as code (IaC), such as AWS CloudFormation or Terraform.
* Familiarity with data orchestration tools like Apache Airflow.
* Excellent analytical, problem-solving, and teamwork skills.
* Strong communication abilities for both technical and non-technical audiences.
Benefits:
This role offers a unique opportunity to work with a talented team of professionals and contribute to the development of innovative data solutions.
Others:
Please submit your resume and cover letter to apply for this position.