Lead Data Engineer

Lead Data Engineer (Real-Time Data Streaming)

This role is a remote role with weekly/fortnightly travel to the Brighton office.

Salary up to £100k.

Our partner is looking for an experienced Lead Data Engineer to join their Brighton-based team to drive their real-time data streaming initiatives.

As a key member of the data team, you'll play a pivotal role in shaping our data engineering roadmap and ensuring the success of our genAI products.

Responsibilities:

• Be the primary data engineering subject matter expert.
• Design and implement robust, scalable data pipelines using technologies like Kafka, Python, AWS, Snowflake, DBT, Looker.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Develop and maintain self-service tooling for efficient data access and analysis.
• Ensure data quality and governance through documentation, observability, and controls.
• Mentor team members and promote best practices within the organisation.

Required Skills and Experience:

• Proven experience as a Lead Data Engineer or similar role.
• Strong experience in Python and data engineering concepts.
• Expertise in real-time data streaming technologies such as Kafka or similar.
• Experience with ELT pipelines and the full data lifecycle.
• Excellent communication and collaboration skills.
• Able to travel to the Brighton office weekly or fortnightly.