Lead Data Engineer Position
Role Overview:
As a Lead Data Engineer for the IdAM 2.0 Programme – Data Cluster, you will collaborate closely with the Lead Data Architect across multiple delivery Epics. Your focus will be on designing, developing, testing, and launching data-related features that support the entire IdAM 2.0 solution, such as Identify Fabric, Metrics & Dashboard, and Privileged Technical Account Inventory. You will be responsible for creating and documenting an integrated end-to-end IdAM data model that ensures data consistency, integrity, timeliness, and operational efficiency through automation across the IdAM ecosystem.
Key Responsibilities:
- Build database objects and manage data extraction/loading from SQL Server using repeatable scripting solutions (PowerShell) or ETL tools (Azure Data Factory) and/or API calls.
- Document solutions using standard templates, including Entity Relationship Diagrams, Detailed Functional Design, and Detailed Technical Design.
- Collaborate with colleagues and external suppliers to gather requirements and design secure solutions.
- Conduct formal testing stages and obtain sign-offs from internal customers.
- Perform handovers with the IdAM Infrastructure Operations team, including training and knowledge sharing.
- Support migration to Production Infrastructure and provide warranty support.
- Identify and address security risks and exposures during analysis and design.
- Make recommendations for changes and implement agreed enhancements.
- Work alongside other projects with dependencies on the PTA Inventory.
Skills and Experience:
- 5+ years of experience in Data Architecture, Data Modelling, and Data Engineering, including data modelling tools such as ERWIN.
- 5+ years of experience with PowerShell for automating tasks in a Windows environment.
- 5+ years of experience with SQL (on SQL Server), especially in writing and maintaining Stored Procedures.
- Experience with 5+ full software development lifecycle product launches.
- 1-2 years of hands-on experience with data dictionary, lineage, and management tools, especially Collibra.
- 3+ years of hands-on experience with ETL tools and concepts; experience with Azure Data Factory is a plus.
- Knowledge of other database technologies (e.g., Oracle) is a bonus.
- Familiarity with scheduling tools and techniques for automating routine tasks.
- Awareness of Operational Production Support in a level 2/3 context.
- Familiarity with security mechanisms across operating platforms and applications.
- Understanding of access control and management principles.
- Professional certification in CISSP, CISM, and CISA, or equivalent is a plus.
Interpersonal / Soft Skills:
- Strong belief in teamwork for achieving results.
- Ability to leverage influence and negotiate to achieve goals.
- Diplomatic attitude and strong communication skills, both verbal and written.
- Adaptability to continuous change and a spirit of continuous improvement.
- Self-motivated, autonomous, and problem-oriented with a focus on high-quality solutions.
Language Requirements:
Mandatory: Excellent proficiency in English, both speaking and writing.
The role is initially for up to 12 months, with the possibility of extension to work on a wider IAM regulatory programme with a multi-year timescale.