Spark Developer

Location: Brussels

Work Arrangement: Hybrid, 1-2 days on-site per week

Job Description:

We are looking for a skilled Spark Developer to design and implement the Gold layer of our Data Warehouse using the Medallion Architecture. The ideal candidate will possess strong expertise in Apache Spark and a solid understanding of data engineering best practices.

Key Responsibilities:

• Develop and optimize Spark-based data pipelines for the Gold layer.
• Ensure data quality, performance, and scalability in the data warehouse architecture.
• Collaborate with data analysts to deliver business-ready datasets.
• Implement transformations and aggregations aligned with business requirements.

Qualifications:

• Airflow: Junior (1-3 years of experience)
• Data Warehousing: Professional (4-5 years of experience)
• Delta Lake: Junior (1-3 years of experience)
• Java: Junior (1-3 years of experience)
• Spark: Professional (4-5 years of experience)