Data Engineer Position

Location: Gent

Remote Work: Up to 2 days per week after the onboarding period

Role Description:

We are looking to reinforce our team with a Data Engineer to assist in implementing a data lake designed to collect, process, and store environmental data from our manufacturing clusters. The role involves:

• Developing and maintaining scalable data pipelines using Azure Databricks.
• Collaborating with business data analysts to understand data requirements and deliver solutions.
• Implementing data integration and transformation processes from diverse sources, including REST APIs.
• Optimizing and troubleshooting data workflows for performance and reliability.
• Ensuring data quality and consistency across various structured and unstructured data sources.
• Staying updated with the latest trends and best practices in data engineering, Databricks, and data integration technologies.

Technical Profile:

• Proven experience as a Data Engineer with a strong focus on Azure Databricks and related technologies in the Microsoft data ecosystem.
• Familiarity with the lake house medallion architecture.
• Proficiency in SQL, Python, and Apache Spark.
• Solid understanding of REST APIs, including secure and efficient consumption, and experience in ingesting and transforming JSON/XML data from web APIs is a strong plus.
• Experience with data management & governance using Unity Catalog is a plus.
• Willingness and knowledge to build technical reports in PowerBI.
• Natural reflex to document activities during analysis and development (in Wiki, DevOps, etc.).
• Fluency in English is required. Any other European language such as French, Dutch, or Spanish is appreciated.

Social Profile:

• Autonomous, flexible, organized, and rigorous.
• Strong problem-solving skills, hands-on, and attention to detail.
• Collaborative.