Senior Data Architect Position
For a client, we are seeking a Senior Data Architect with over 7 years of experience. The ideal candidate will have expertise in Azure and Databricks, with certifications preferred. Below are the details and technical requirements for the role.
Role Overview
As a Data Solution Architect, you will be responsible for designing, implementing, and optimizing cloud-based data solutions using Azure and Databricks. This includes migrating ETL jobs to Databricks and ensuring that data architectures are scalable, secure, and aligned with enterprise standards.
Primary Tasks & Responsibilities
- Azure Engineering & Architecture
- Configure and set up Azure services.
- Manage environment provisioning, networking, IAM, and security.
- Design secure and efficient Azure architectures in collaboration with the Enterprise Architect and team.
- Troubleshoot and optimize systems.
- Databricks Engineering
- Migrate ETL jobs to Databricks.
- Redesign ETL/ELT processes in Databricks.
- Configure clusters, workspaces, notebooks, and CI/CD.
- Perform performance tuning and workflow optimization.
- Architecture & Best Practices
- Define end-to-end data architectures and standards.
- Ensure alignment with governance, lineage, and security.
- Produce architecture documentation.
- Collaborate with cross-functional teams.
- Transition & Solution Design (Legacy → New Platform)
- Support the transition design and decision-making process.
- Analyze platform constraints and propose solutions.
- Participate in refinement to define migration strategies.
- Design temporary or hybrid solutions for smooth transitions.
- Support & Collaboration
- Provide guidance on Azure and Databricks usage.
- Manage user stories and ensure alignment with objectives.
- Participate in sprint reviews and planning sessions.
- Fulfill product ownership responsibilities for the Data Platform.
- Mentor team members on best practices.
Secondary Tasks & Responsibilities
- Support incident resolution related to data pipelines or cloud services.
- Improve monitoring, observability, and alerting systems.
- Contribute to CI/CD improvements for data pipelines.
- Support data quality initiatives and validation frameworks.
- Evaluate new tools or technologies.
- Enforce coding standards.
- Collaborate with security teams for compliance.
- Assist in cloud cost optimization and resource usage governance.
- Provide backup support for other architects/engineers.
Technical Profile Requirements
Required Technical Skills
- Certification & strong hands-on experience with Azure (Key Vault, IAM, networking).
- Certification & strong hands-on experience with Databricks (Clusters, Delta Lake, Unity Catalog, PySpark, Notebooks).
- Experience in migrating ETL jobs to Databricks.
- Solid knowledge of data lake house architectures.
- Strong understanding of cloud security principles.
- Hands-on experience with CI/CD and Git workflows.
Nice-to-Have Skills
- Terraform or Bicep.
- Docker or Kubernetes.
- Data governance tools (e.g., Purview, Collibra).
Non-Technical Profile Requirements
Communication & Collaboration
- Excellent communication skills with both technical and business stakeholders.
- Ability to explain complex concepts clearly.
- Ability to work in multilingual environments.
Leadership & Ownership
- Proactive, autonomous, and able to take ownership of architectural decisions.
- Capable of leading technical initiatives from design to implementation.
- Strong sense of responsibility and commitment to delivery deadlines.
Problem-Solving & Analytical Thinking
- Structured and analytical mindset.
- Ability to troubleshoot complex data or cloud architecture issues.
- Capacity to anticipate risks and propose mitigation strategies.
Team Spirit & Adaptability
- Collaborative mindset and willingness to work with diverse teams.
- Flexibility to adapt to evolving priorities and new technologies.
- Comfortable working in a hybrid onsite/remote model.
Professional Attitude
- Strong client orientation and result-driven mentality.
- Highly organized, with excellent time-management skills.
- Respectful, reliable, and able to maintain confidentiality where needed.
Certifications
- Azure Certification – required.
- Databricks Certification – required.
Work Location
Brussel
Languages
French and/or Dutch (knowledge of the second language is a plus) and very good English proficiency.