For a client we are seeking an experienced Data Engineer to join our Data Foundation team. This full-time position is set to commence on 01/11/2024 and will conclude on 31/10/2025.

Responsibilities:

• Design, implement, and maintain scalable data architectures, including databases, AWS data lakes, and data warehouses.
• Build and optimize ETL processes for data movement from various sources to data repositories.
• Integrate diverse data sources into cohesive, unified views for analysis and reporting.
• Ensure data consistency, accuracy, and quality throughout the data lifecycle.
• Manage and optimize data infrastructure for efficiency, storage, and costs.
• Collaborate with teams to ensure scalability, security, and performance of data systems.
• Develop and maintain code for data processing tasks using Python, Spark, SQL, and ensure automation and regular execution.
• Work closely with cross-functional teams to understand data requirements and deliver solutions.
• Engage with business stakeholders to gather and understand data-related requirements.
• Create and maintain comprehensive documentation for data processes, pipelines, and architectures.
• Adhere to and promote data engineering best practices.

Qualifications and Experience:

• Proven experience as a Senior Data Engineer or similar role.
• Demonstrated experience in Data Platform Management.
• Proficiency with AWS services such as S3, Athena, Glue, Redshift.
• Practical experience in Databricks (preferably on AWS).
• Strong programming skills in Python, Spark, SQL, or another data engineering language.
• Familiarity with data processing technologies.
• Understanding of Agile processes (Scrum, Kanban).
• Knowledge of DataIku.
• Familiarity with Azure DevOps & release Pipelines.
• AWS certifications (Cloud Data Engineer) are desirable.

Language Proficiency:

• Fluency in English is required.

This role is an excellent opportunity for a seasoned Data Engineer to work on challenging and impactful projects.