Data Engineer
For a customer we are looking for a Data Engineer.
Start date: As soon as possible
Duration: Until 31-12-2027
Location: Brussels, 3 days onsite & 2 days remote
Context of the assignment
Within Grid Development, the digital, data and analytical foundations are laid for smarter investment decisions and more resilient grid planning. The SGS (Scenarios & Grid Studies Solutions) product line provides the digital capabilities for the entire lifecycle of scenario and network study management. The consultant will strengthen this product team.
Tasks and responsibilities:
Designing, developing and maintaining scalable data pipelines on Azure and Databricks.
Collection, transformation and integration of data from internal and external sources.
Ensuring data quality, consistency, traceability and governance.
Manage and optimize Azure Data Lake, Databricks workspaces and distributed processing environments.
Developing data models and datasets for network studies, scenario management and business analytics.
Enabling AI / ML and advanced analytical applications with reliable, controlled datasets.
Monitoring, automation and performance optimization of data workflows.
Technical documentation in Markdown and Confluence.
Profile requirements:
Mandatory skills:
Fluent in Python (Pandas, Polars) with demonstrable project experience.
Advanced knowledge of SQL and data access frameworks.
Experience with outscaling technologies: Databricks, Azure, PySpark.
Good understanding of scalable and distributed data processing.
Experience in building and maintaining data pipelines, analytical data sets and data products.
Experience with dashboards and reporting in Power BI or Streamlit.
Advanced knowledge of Excel and VBA.
Experience with Git and collaborative software development.
Bachelor in IT / Computer Science / Data Engineering or equivalent (master is a plus).
Desired skills:
Knowledge of R, in particular data.table.
Understanding AI / ML concepts and AI-supported data solutions.
Experience in the energy sector, power systems or grid planning.
Experience with documenting in Markdown and Confluence.
Languages:
Fluent English; Dutch and / or French is a strong advantage.