Lead Data Engineer

Lead Data Engineer

Data Insights

Permanent

Office location: ITV White City

Hiring range: £85,000 - £95,000

Your work matters to millions.

Shaping culture is in the DNA of ITV. Our productions are famous all over the world and we’re at the forefront of the digital streaming revolution. When you join us, you enter a fun working environment with opportunities to learn, grow, and make a real difference.

Your impact sends ripples.

Our data team is responsible for helping us realize the value of data. This includes up-skilling our people, increasing revenue through experimentation and personalization, and working on genuinely groundbreaking innovations.

As a Lead Data Engineer, both directly and via your team, you will be responsible for developing, maintaining, and optimizing our data pipeline infrastructure using our proprietary central data platform (Symphony) based on Databricks. You will collaborate with cross-functional teams to design and implement scalable data solutions, ensuring efficient data ingestion, transformation, storage, and analysis.

This is a hands-on leadership role where you will manage a small team of data engineers. You will work with your agile delivery manager and product manager to size and breakdown work, distribute tasks across your team, and proactively bring activities to closure. A key aspect of this role is to inspire and motivate your team to contribute enthusiastically to the shared vision.

Key Responsibilities of this role include:

1. Deliver technical leadership, monitoring productivity and output; setting objectives and commitments; contributing to reviews and performance assessment of a small number of data engineers.
2. Ownership and delivery of the design, development, and maintenance of scalable data pipelines, infrastructure, and data products using Databricks.
3. Assist and collaborate with internal and external stakeholders.
4. Develop and optimize extract, transform, load (ELT) processes ensuring smooth flow of data from various sources into the data platform.
5. Ensure adherence to data architecture principles, best practices, and processes, collaborating with data scientists, analysts, and stakeholders.
6. Monitor and optimize data pipelines and workflows to ensure high performance and reliability.
7. Define data quality characteristics of your data products and work with the QA team to implement automated quality processes.
8. Implement data governance practices and ensure compliance with ITV data privacy and security regulations.
9. Ensure all data products conform to observability requirements and suitable dashboards are in place.
10. Work closely with cross-functional teams to understand their requirements and provide data engineering support.
11. Communicate complex solutions clearly to both technologists and business stakeholders.
12. Stay up-to-date with industry trends and emerging technologies.

Skills you’ll need (minimum criteria)

1. Extensive experience leading small teams of data engineers.
2. Experience designing and building Databricks data products.
3. Strong programming skills in languages such as Python (PySpark preferred), Scala, or SQL.
4. Experience in owning, designing, and implementing data pipelines with strong knowledge of data engineering concepts.
5. Ability to write production-grade code including automated testing and deploy code via CI/CD platforms.
6. Experience with distributed computing frameworks, such as Apache Spark and data modelling.
7. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and associated services.

Other things we’re looking for (key criteria)

1. Knowledge of the UK broadcast industry and digital marketing and advertising industry.
2. Familiarity with data design techniques for classification and regression.
3. Knowledge of architecture disciplines such as Data Mesh Architecture and Enterprise Architecture.
4. Understanding of data governance, data privacy, and security principles.
5. Experience with tools across other data management capabilities.
6. Designing and building out data visualization solutions based on technology such as Tableau or AWS QuickSight.
7. A strong people leader, coach, and mentor with exceptional communication skills.

Please note that if you are NOT a passport holder of the country for the vacancy you might need a work permit. Check our Blog for more information.

Bank or payment details should not be provided when applying for a job. Eurojobs.com is not responsible for any external website content. All applications should be made via the 'Apply now' button.

#J-18808-Ljbffr