Lead Data Engineer

Vector Resourcing

United Kingdom

Posted about 1 month ago

This is a job posted by our partner Jooble

Below is a snippet of the job description. To read the full text, please click on the "Apply Now" link.

Advanced Python and SQL skills
Hands-on experience with:
- Apache Kafka
- Apache Spark
- Delta tables
Proficient in:
- Airflow
- Message brokers (e.g., RabbitMQ, AWS SQS)
Expert-level knowledge of:
- Docker
- Kubernetes
Define testing frameworks for validating and transforming synthetic data
Set best practices for containerization and deployment to Kubernetes clusters
Conduct monthly AWS cost reviews with DevOps to identify savings and optimize resources
Experience in lead data engineering or a similar senior role, with strong leadership and architecture design experience

Compensation

up to £80K

Role type

Full time

Visa sponsorship

Not provided

Benefits & perks

Ground Floor, Verse Building, 18 Brunswick Place, London, N1 6DZ

108 E 16th Street, New York, NY 10003

Join over 111,000 others and get access to exclusive content, job opportunities and more!