Tech4 | Senior Data Engineer

Tech4
Liverpool
3 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Architect

Senior Data Architect

Senior Manager (Data Science)

Travelport - Software Development Engineer

Quantitative Developer

Junior Data Scientist

Senior Data Engineer - Python / Data Pipelines / Data Platform / AWS - is required by fast growing, highly successful and and tech focused organisation.


About the job


You will play a crucial role in designing, building, and maintaining their data platform, with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.


Key Responsibilities:


  • Architect and Implement Data Pipelines:
  • Design, develop, and maintain scalable and efficient data pipelines
  • Optimize ETL processes to ensure seamless data ingestion, processing, and integration across various systems
  • Streaming Data Platform Development:
  • Lead the development and maintenance of a real-time data streaming platform using tools like Apache Kafka, Databricks, Kinesis.
  • Ensure the integration of streaming data with batch processing systems for comprehensive data management
  • Cloud Infrastructure Management:
  • Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.) to build and manage our data infrastructure
  • Continuously optimize the platform for performance, scalability, and cost-effectiveness
  • Communications:
  • Collaborate with cross-functional teams, including data scientists and BI developers, to understand data needs and deliver solutions
  • Leverage the project management team to coordinate project, requirements, timelines and deliverables, allowing you to concentrate on technical excellence
  • ML Ops and Advanced Data Engineering:
  • Establish ML Ops practices within the data engineering framework, focusing on automation, monitoring, and optimization of machine learning pipelines
  • Data Quality and Governance:
  • Implement and maintain data quality frameworks, ensuring the accuracy, consistency, and reliability of data across the platform
  • Drive data governance initiatives, including data cataloguing, lineage tracking, and adherence to security and compliance standards


Requirements


Experience:

  • 3+ years of experience in data engineering, with a proven track record in building and maintaining data platforms, preferably on AWS
  • Strong proficiency in Python, experience in SQL and PostgreSQL. PySpark, Scala or Java is a plus
  • Familiarity with Databricks and the Delta Lakehouse concept
  • Experience mentoring or leading junior engineers is highly desirable


Skills:

  • Deep understanding of cloud-based data architectures and best practices
  • Proficiency in designing, implementing, and optimizing ETL/ELT workflows
  • Strong database and data lake management skills
  • Familiarity with ML Ops practices and tools, with a desire to expand skills in this area
  • Excellent problem-solving abilities and a collaborative mindset


Nice to Have:


  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes)
  • Knowledge of machine learning pipelines and their integration with data platforms


Great training and career development opportunities exist for the right candidate.

Basic salary £60-65,000 + excellent benefits

Office based in Northumberland. Fully remote working available

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Contract vs Permanent Data Science Jobs: Which Pays Better in 2025?

Data science sits at the intersection of statistics, machine learning, and domain expertise, driving crucial business decisions in almost every sector. As UK organisations leverage AI for predictive analytics, customer insights, and automation, data scientists have become some of the most in-demand professionals in the tech job market. By 2025, data scientists with expertise in deep learning, natural language processing (NLP), and MLOps are commanding top-tier compensation packages. However, deciding whether to become a day‑rate contractor, a fixed-term contract (FTC) employee, or a permanent member of an organisation can be challenging. Each path offers a unique blend of earning potential, career progression, and work–life balance. This guide will walk you through the UK data science job market in 2025, examine the differences between these three employment models, present sample take‑home pay scenarios, and offer strategic considerations to help you determine the best fit for your career.

Data Science Jobs for Non‑Technical Professionals: Where Do You Fit In?

Beyond Jupyter Notebooks Ask most people what a data‑science career looks like and they’ll picture Python wizards optimising XGBoost hyper‑parameters. The truth? Britain’s data‑driven firms need storytellers, strategists, ethicists and project leaders every bit as much as they need statisticians. The Open Data Institute’s UK Data Skills Gap 2024 places demand for non‑technical data talent at 42 % of all data‑science vacancies—roles focused on turning model outputs into business value and trustworthy decisions. This guide highlights the fastest‑growing non‑coding roles, the transferable skills many professionals already have, and a 90‑day action plan to land a data‑science job—no pandas required.

McKinsey & Company Data‑Science Jobs in 2025: Your Complete UK Guide to Turning Data into Impact

When CEOs need to unlock billion‑pound efficiencies or launch AI‑first products, they often call McKinsey & Company. What many graduates don’t realise is that behind every famous strategy deck sits a global network of data scientists, engineers and AI practitioners—unified under QuantumBlack, AI by McKinsey. From optimising Formula One pit stops to reducing NHS wait times, McKinsey’s analytics teams turn messy data into operational gold. With the launch of the McKinsey AI Studio in late 2024 and sustained demand for GenAI strategy, the firm is growing its UK analytics headcount faster than ever. The McKinsey careers portal lists 350+ open analytics roles worldwide, over 120 in the UK, spanning data science, machine‑learning engineering, data engineering, product management and AI consulting. Whether you love Python notebooks, Airflow DAGs, or white‑boarding an LLM governance roadmap for a FTSE 100 board, this guide details how to land a McKinsey data‑science job in 2025.