Senior Data Engineer
<div class="show-more-less-html__markup show-more-less-html__markup--clamp-after-5 relative overflow-hidden"> <strong><strong>The Opportunity<br/><br/></strong></strong>We are supporting a major <strong>data platform transformation within a banking environment</strong>, moving from a legacy SQL Server and SSIS-based setup to a modern, scalable architecture built on <strong>dbt, Dagster, and OpenShift</strong>.<br/><br/>This role is not about maintaining existing systems. It is about <strong>rebuilding a critical data platform from the ground up</strong>, with direct impact on <strong>risk, trading PnL, and core financial data flows</strong>.<br/><br/>We are looking for a <strong>hands-on Senior Data Engineer</strong> who can take ownership of complex migration workstreams and deliver reliably in a regulated, high-stakes environment.<br/><br/><strong><strong><strong>What You Will Do<br/><br/></strong></strong></strong>You will play a central role in the <strong>end-to-end migration and modernisation</strong> of the data platform.<br/><br/><strong>Platform Transformation<br/><br/></strong><ul><li>Translate legacy ETL logic from SSIS and stored procedures into modern ELT pipelines using dbt</li><li>Implement Data Vault 2.0 structures including Raw Vault and Business Vault</li><li>Build datamarts and curated datasets for downstream analytics and reporting<br/><br/></li></ul><strong>Orchestration & Infrastructure<br/><br/></strong><ul><li>Design and operate workflows using Dagster, including scheduling, dependencies, and recovery mechanisms</li><li>Deploy and run data workloads on OpenShift / Kubernetes environments<br/><br/></li></ul><strong>Event-Driven Data Processing<br/><br/></strong><ul><li>Enable near real-time data processing using Kafka-triggered pipelines</li><li>Integrate with upstream data lake environments and external data providers<br/><br/></li></ul><strong>Data Quality & Validation<br/><br/></strong><ul><li>Establish robust data validation and reconciliation processes</li><li>Implement automated testing and monitoring using dbt<br/><br/></li></ul><strong>Operational Ownership<br/><br/></strong><ul><li>Support production pipelines and resolve incidents when required</li><li>Create clear documentation and ensure operational readiness</li><li>Continuously improve performance, reliability, and maintainability<br/><br/></li></ul><strong><strong><strong>What You Will Do<br/><br/></strong></strong></strong>You will play a central role in the <strong>end-to-end migration and modernisation</strong> of the data platform.<br/><br/><strong>Platform Transformation<br/><br/></strong><ul><li>Translate legacy ETL logic from SSIS and stored procedures into modern ELT pipelines using dbt</li><li>Implement Data Vault 2.0 structures including Raw Vault and Business Vault</li><li>Build datamarts and curated datasets for downstream analytics and reporting<br/><br/></li></ul><strong>Orchestration & Infrastructure<br/><br/></strong><ul><li>Design and operate workflows using Dagster, including scheduling, dependencies, and recovery mechanisms</li><li>Deploy and run data workloads on OpenShift / Kubernetes environments<br/><br/></li></ul><strong>Event-Driven Data Processing<br/><br/></strong><ul><li>Enable near real-time data processing using Kafka-triggered pipelines</li><li>Integrate with upstream data lake environments and external data providers<br/><br/></li></ul><strong>Data Quality & Validation<br/><br/></strong><ul><li>Establish robust data validation and reconciliation processes</li><li>Implement automated testing and monitoring using dbt<br/><br/></li></ul><strong>Operational Ownership<br/><br/></strong><ul><li>Support production pipelines and resolve incidents when required</li><li>Create clear documentation and ensure operational readiness</li><li>Continuously improve performance, reliability, and maintainability<br/><br/></li></ul><strong><strong>Requirements<br/><br/></strong></strong><strong><strong>What You Bring<br/><br/></strong></strong><strong>Technical Expertise<br/><br/></strong><ul><li>Strong experience with SQL Server and T-SQL, including performance optimisation</li><li>Proven hands-on experience with dbt in production environments</li><li>Solid experience with workflow orchestration tools, ideally Dagster</li><li>Practical knowledge of Data Vault 2.0 modelling concepts</li><li>Experience working with container platforms such as OpenShift or Kubernetes</li><li>Familiarity with event-driven architectures and Kafka<br/><br/></li></ul><strong><strong>Domain Experience<br/><br/></strong></strong><ul><li>Experience working with financial data, ideally in banking or trading environments</li><li>Understanding of risk and PnL data structures is a strong advantage<br/><br/></li></ul><strong>Working Style<br/><br/></strong><ul><li>Strong ownership mindset with the ability to work independently</li><li>Structured, pragmatic, and delivery-focused</li><li>Comfortable operating in complex and regulated environments</li><li>Clear communicator across both technical and business stakeholders<br/><br/></li></ul><strong><strong><strong>What Success Looks Like<br/><br/></strong></strong></strong>Within the first months, you will have:<br/><br/><ul><li>Delivered initial Data Vault structures and migrated datasets into the new platform</li><li>Established stable, event-driven pipelines</li><li>Ensured data consistency and validation between legacy and new systems</li><li>Contributed to a production-ready, scalable data platform</li></ul> </div>