Data Engineer - AWS Analytics Expert (6+ years)
About the Role:
We are seeking a highly skilled and experienced Data Engineer to join our team and build the future of our data infrastructure. You will play a key role in designing, developing, and implementing analytical solutions utilizing the best of AWS services. You will collaborate with stakeholders across the organization to understand their data needs and translate them into efficient and scalable data pipelines.
Responsibilities:
1. Design and build analytical architectures including data warehouses, data lakes, and data lake houses.
2. Implement data lakes on S3 using Lake Formation for secure and controlled data governance.
3. Leverage AWS Glue to set up catalogs, crawlers, and ETL jobs for automated data ingestion and transformation.
4. Implement robust governance practices for AWS-based analytical solutions.
5. Develop real-time analytics pipelines using Amazon Kinesis for capturing and processing streaming data.
6. Design and deploy data warehouse solutions with Amazon Redshift for high-performance analytics.
7. Apply your expertise in dimensional modeling principles for efficient data organization.
8. Implement common ETL patterns to optimize data flow for data warehouse workloads.
9. Utilize Redshift Spectrum for federated querying across diverse data sources.
10. Possess strong Python programming skills for scripting and automation.
Bonus points if you have:
11. Familiarity with DataOps principles and practices.
12. Experience with Power BI or other data visualization tools.
13. Understanding of Snowflake data platform.
Qualifications:
14. 6+ years of experience as a data engineer.
15. Proven experience with AWS data services, including RDS, Aurora, S3, Lake Formation, Glue, Redshift, Kinesis, and Spectrum.
16. Deep understanding of relational databases and data warehousing concepts.
17. Strong expertise in designing and implementing ETL pipelines.
18. Excellent Python programming skills.
19. Strong communication and collaboration skills.
20. Ability to work independently and manage multiple projects simultaneously.
If you are passionate about data, love working with AWS technologies, and have a knack for building scalable and efficient data solutions, we encourage you to apply!