Senior Data Engineer

We're seeking an experienced Senior Data Engineer to join a leading global organisation on a contract basis, helping to design and deliver scalable, enterprise-grade data solutions.

This role will focus on building and optimising modern data platforms using Python, Databricks and Spark, enabling advanced analytics, reporting and data-driven innovation across the business.

Client Details

Our client is a leading international financial institution with a long-established presence across major global markets. Serving a diverse client base that includes corporates, financial institutions and investors, the organisation delivers a broad range of banking, financing and capital markets services.

With significant investment in digital transformation and data-led innovation, the organisation is modernising its technology estate and expanding its enterprise data capabilities. Data plays a critical role in supporting business operations, regulatory obligations, analytics and strategic decision-making, making this an exciting opportunity to contribute to large-scale, business-critical data initiatives within a complex global environment.

Description

• Design, build and maintain scalable data pipelines using Python and Databricks
• Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake
• Create robust data models and data architectures within modern Lakehouse environments
• Implement and manage data workflows across the Databricks ecosystem
• Ensure data quality, governance, reliability and performance across platforms
• Optimise distributed data processing workloads at scale
• Collaborate closely with data scientists, analysts and stakeholders to support analytics and machine learning initiatives
• Implement monitoring, logging and alerting capabilities across data solutions
• Champion engineering best practices and mentor less experienced team members

Profile

You will bring:

• 10+ years' experience in Data Engineering
• Experience delivering data engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments.
• Strong hands-on expertise in Python
• Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake
• Strong knowledge of Apache Spark / PySpark
• Experience designing and delivering large-scale ETL/ELT pipelines
• Advanced SQL skills and experience with relational databases
• Experience working with cloud technologies such as AWS, Azure or GCP
• Knowledge of modern data warehousing platforms such as Snowflake, Redshift or BigQuery
• Understanding of data modelling principles and Lakehouse architecture
• Excellent communication, stakeholder management and problem-solving skills

Desirable experience includes:

• Databricks certifications
• Streaming technologies such as Kafka or Structured Streaming
• CI/CD and DevOps practices
• Docker and Kubernetes
• Exposure to machine learning pipelines

Job Offer

• Competitive day rate of £550-£880 Inside IR35 (Umbrella)
• Initial 6-month contract
• Hybrid working model with flexibility
• Opportunity to work on cutting-edge data engineering projects
• Exposure to modern cloud and data technologies
• Collaborative and high-performing engineering environment
• Chance to make a tangible impact on enterprise-scale data transformation initiatives