About this role
This is a six-month contract for a Data Engineer (Databricks) based in Leeds, working hybrid with travel to the Leeds office one to two days per month. The role combines L2/L3 production support with data engineering tasks, running and maintaining production data pipelines on Databricks and AWS. You will keep scheduled data processing reliable, resolve incidents, and improve data services performance. Strong hands-on Databricks, PySpark, AWS, SQL and Python experience is required, covering notebooks, scheduled jobs, cluster configuration, driver and executor logs, Spark UI and performance troubleshooting. Day rate is £500 - £550 per day (Inside IR35).
Job Description
Data Engineer (Databricks)
Leeds (Hybrid)
6 Month Contract
£(Apply online only)/day (Inside IR35)
Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience.
6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026.
Hybrid Working Model - primarily working from home with travel to the Leeds office 1-2 days per month.
A chance to work with a leading global IT transformation on a large-scale Government project:
- Data Engineer with strong Databricks, AWS, Python, PySpark + SQL skills.
- Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS.
- Keeping scheduled data processing reliable, resolve incidents, fixes + improving data services performance.
- The role combines L2/L3 production support and Data Engineering tasks.
- Databricks experience covering notebooks, scheduled jobs, cluster configuration, driver / executor logs, Spark UI + performance troubleshooting.
- Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation.
- Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, including schemas, partitions and the relationship between table metadata and underlying files.
- Hands-on AWS experience, particularly S3, IAM and CloudWatch, with an understanding of role-based access, KMS encryption and diagnosing data access failures.
- Owning incidents from investigation through recovery and closure. Diagnosing issues in Python, PySpark, SQL, Databricks jobs and AWS integrations + providing clear progress updates and timely escalation.
- Working knowledge of Git, code reviews, CI/CD and controlled production deployments, including testing, rollback and release validation.
- Advantageous: AWS Glue, Lambda, Step Functions, Linux, Shell Scripts, Terraform, Gitlab, Jenkins.