Senior Data EngineerCreated

Last refreshed: 13:59:36
Back to matched candidates
DS

Diana Souza

Head of Data Engineering at Parliamentary Digital Service

London, United KingdomLinkedIn

765/1000

3 to check

Role

Role Name

Senior Data Engineer

Company

Northstar Lending

Location(s)

London, Shoreditch

Work Mode

hybrid

Employment Type

full-time

Pay

£85,000 to £100,000 per year

Key Requirements

Skills

PythonAdvanced SQLdbtAirflowAWSData pipeline orchestrationData modeling

Tools

PythonSQLKafkaSnowflakedbtAirflowTerraformAWS

Candidate

Summary

Head of Data Engineering with long-standing hands-on data engineering experience (end-to-end pipelines, Azure microservices, Spark/Databricks, SQL/NoSQL). Recent leadership responsibility at a central public-sector digital service; strong focus on scalable pipeline design, security (ARM/Bicep, Key Vault), performance tuning and mentoring engineering teams.

Work History

  • Head of Data Engineering at Parliamentary Digital Service

    Dec 2023 to present

    Leading design and delivery of enterprise-scale data solutions: translating business requirements into data engineering architecture; developing greenfield microservices in Microsoft Azure; designing end-to-end data pipelines to handle terabytes; ensuring data security (NSGs, Key Vault, ARM/Bicep); SQL and NoSQL design (CosmosDB, GraphDB); performance tuning; mentoring and code review.

  • Senior Data Engineer at Betway Group

    Oct 2017 to Nov 2023

    Developed greenfield microservices and large-scale data pipelines on Microsoft Azure; CI/CD; ARM templates; network/security tooling; worked with SQL and NoSQL (CosmosDB, Exasol); Spark (RDD, Spark SQL, PySpark) for streaming and batch processing; Python for data analytics; handling large datasets, Parquet/Avro/CSV; Databricks exposure; created POCs for streaming ingestion and Spark ML.

  • BI Developer at Penguin Random House UK

    Jan 2016 to Oct 2017

    Database design and T-SQL development; SSIS ETL development; SSRS reporting; data warehouse design (Kimball); schema and ETL deployment and administration.

  • SQL Programmer at Data Know How

    Aug 2015 to Jan 2016

    Designed and developed reporting solutions using MS SQL Server and SSRS; SSIS ETL; database administration and migration; bespoke client reporting solutions.

  • Analista de Sistemas at Banco Bradesco

    Apr 2006 to Apr 2012

    Database development and administration (MS SQL Server); T-SQL programming; ETL/SSIS; data warehouse design; reporting and dashboards for business stakeholders.

Education

  • Northeastern University London, 2027

Match Information

Match factors

3 to check

Matched(7)

  • Location
    Role: London, Shoreditch · Candidate: London, United Kingdom (same area)
  • Work mode
    Role: hybrid · Candidate accepts: remote, hybrid, on-site
  • Python
    Role needs Python; candidate lists Python as a skill and used it for data analytics at Betway Group.
  • Advanced SQL
    Role needs advanced SQL; candidate lists SQL (T-SQL) and has done T-SQL development across BI and database roles.
  • Data pipeline orchestration
    Role needs pipeline orchestration; candidate designed end-to-end data pipelines at two employers but names no orchestrator.
  • Data modeling
    Role needs data modelling; candidate did Kimball data warehouse design at Penguin Random House UK.
  • SQLNice to have
    Role needs SQL; candidate lists SQL (T-SQL) as a skill and has worked with SQL since 2006.

Gaps(0)

No proven gaps

For your judgment(12)

  • Seniority
    Role: senior · Candidate: head
  • Employment type
    Role: full-time · Candidate: not stated
  • Pay
    Role: £85,000–£100,000 · Candidate: pay expectation not stated
  • dbt
    Role needs dbt; dbt is not named in candidate's skills, tools or roles, though the career is in data engineering.
  • Airflow
    Role needs Airflow; Airflow is not named in candidate's skills, tools or roles.

Reasoning

Why it fits

  • Candidate has recent and relevant experience leading data engineering teams and designing scalable data pipelines.
  • Strong skills in Python, SQL, and data pipeline architecture align well with job requirements.
  • Experience with mentoring engineers matches the job's mentoring expectations.
  • Candidate is located in London and open to hybrid work, matching the job's location and work mode.

Watch-outs

  • Candidate's current role is at a head level, which is senior to the job's senior level, indicating a potential seniority mismatch.
  • Candidate's primary experience is with Azure, while the job requires AWS and related tools, showing a cloud platform mismatch.
  • The job requires specific tools like dbt, Airflow, and Snowflake, which are not evidenced in the candidate's profile.
  • The job is focused on credit and finance data domains, which are not reflected in the candidate's public sector and media experience.

Reach Diana

Outreach:
Diana SouzaHead of Data Engineering at Parliamentary Digital Service
Email not revealed
Phone not revealed
LinkedIn

Tick a way of sending, then use its button above.

Draft Message