PySpark Data Engineer
STAFIDEAs a PySpark Data Engineer, you will: Design, develop, and maintain scalable data pipelines using PySpark on Databricks Build and optimize data processing workflows using Python Implement workflow orchestration and scheduling (preferably using Airflow, if applicable) Work in an Agile delivery environment with cross-functional teams Ensure data quality, performance, and reliability of data solutions Support integration of data from multiple sources into analytics-ready structures What You Bring …
This is a preview — the full job description is on Adzuna.
Opens the company's application page
Listed via
Adzuna
adzuna.com
Similar roles
Design & Tech
Related reads from TCHNX
The Quiet Revolution in Local-First Software
As major platforms face outages and data breaches, a new generation of developers is building applications that prioritise local data storage and peer-to-peer sync, challenging the cloud-first orthodoxy that's dominated tech for two decades.
The Quiet Revolution in Edge AI: Why Your Next Computer Might Not Need the Cloud
As neural processing units become standard in consumer devices, we're witnessing a fundamental shift in how AI applications work. Local processing is no longer a fallback; it's becoming the preferred architecture.
The Rise of AI-Assisted Code Generation 2: Are Developers Becoming Prompt Engineers?
As AI coding assistants reshape software development, the industry grapples with a fundamental question: is writing code giving way to writing prompts? We examine how London's tech scene is adapting to this seismic shift.