Tech4 | Senior Data Engineer

Tech4
Liverpool
2 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Sr. Business Intelligence Engineer (BIE), UK Insights & Innovation

Senior Data Science Manager, EU Expansion

Senior AI Engineer - Remote - LegalTech - Circa. £120k

Data Scientist

Senior Machine Learning Engineer

Senior Data Engineer - Python / Data Pipelines / Data Platform / AWS - is required by fast growing, highly successful and and tech focused organisation.


About the job


You will play a crucial role in designing, building, and maintaining their data platform, with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.


Key Responsibilities:


  • Architect and Implement Data Pipelines:
  • Design, develop, and maintain scalable and efficient data pipelines
  • Optimize ETL processes to ensure seamless data ingestion, processing, and integration across various systems
  • Streaming Data Platform Development:
  • Lead the development and maintenance of a real-time data streaming platform using tools like Apache Kafka, Databricks, Kinesis.
  • Ensure the integration of streaming data with batch processing systems for comprehensive data management
  • Cloud Infrastructure Management:
  • Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.) to build and manage our data infrastructure
  • Continuously optimize the platform for performance, scalability, and cost-effectiveness
  • Communications:
  • Collaborate with cross-functional teams, including data scientists and BI developers, to understand data needs and deliver solutions
  • Leverage the project management team to coordinate project, requirements, timelines and deliverables, allowing you to concentrate on technical excellence
  • ML Ops and Advanced Data Engineering:
  • Establish ML Ops practices within the data engineering framework, focusing on automation, monitoring, and optimization of machine learning pipelines
  • Data Quality and Governance:
  • Implement and maintain data quality frameworks, ensuring the accuracy, consistency, and reliability of data across the platform
  • Drive data governance initiatives, including data cataloguing, lineage tracking, and adherence to security and compliance standards


Requirements


Experience:

  • 3+ years of experience in data engineering, with a proven track record in building and maintaining data platforms, preferably on AWS
  • Strong proficiency in Python, experience in SQL and PostgreSQL. PySpark, Scala or Java is a plus
  • Familiarity with Databricks and the Delta Lakehouse concept
  • Experience mentoring or leading junior engineers is highly desirable


Skills:

  • Deep understanding of cloud-based data architectures and best practices
  • Proficiency in designing, implementing, and optimizing ETL/ELT workflows
  • Strong database and data lake management skills
  • Familiarity with ML Ops practices and tools, with a desire to expand skills in this area
  • Excellent problem-solving abilities and a collaborative mindset


Nice to Have:


  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes)
  • Knowledge of machine learning pipelines and their integration with data platforms


Great training and career development opportunities exist for the right candidate.

Basic salary £60-65,000 + excellent benefits

Office based in Northumberland. Fully remote working available

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Job-Hunting During Economic Uncertainty: Data Science Edition

Data science has become essential for modern businesses, enabling data-driven decisions that enhance efficiency, profitability, and strategic foresight. From predictive analytics in finance to recommendation engines in retail, data scientists sit at the crossroads of statistics, programming, and domain expertise, building models that translate raw information into tangible insights. Yet, when broader economic forces create uncertainty—through market downturns, shifting investor priorities, or internal budget constraints—data science roles can experience increased scrutiny, competition, and extended hiring cycles. Despite these pressures, data-driven approaches remain crucial to organizations looking to weather challenges and find opportunities in volatile environments. Whether you’re refining advanced machine learning techniques, fine-tuning data pipelines, or collaborating with business stakeholders on dashboards, your skill set is often still in demand. The key is adapting your job search strategy and personal branding to cut through the noise when fewer roles may be available. This article explores: Why economic headwinds affect data science hiring. Actionable strategies to stand out in a tighter job market. Ways to emphasize your technical and soft skills effectively. Techniques to maintain focus and resilience despite potential setbacks. How www.datascience-jobs.co.uk can help you secure the ideal data science position. By combining strategic thinking, polished communications, and adaptability, you can land a fulfilling data science role that leverages your expertise—even if the market feels more demanding.

How to Achieve Work-Life Balance in Data Science Jobs: Realistic Strategies and Mental Health Tips

Data science has quickly emerged as one of the most influential fields in the modern workplace, shaping how businesses make critical decisions and expanding our understanding of everything from consumer behaviour to public health trends. As the global demand for data insights continues to rise, companies of all sizes are seeking professionals who can effectively harness analytics and machine learning to drive innovation. Yet, this promise of limitless opportunity comes with significant challenges. Data scientists often grapple with large volumes of complex data, tight project deadlines, cross-functional collaboration, and constant upskilling. Amid the excitement of discovering actionable insights and developing high-performing models, many wonder if it’s truly possible to maintain a healthy work-life balance. With the field evolving at breakneck speed, the intensity of these roles can leave even the most passionate data professionals drained and questioning how to protect their personal well-being. This article delves into the reality of high-intensity data science jobs, offering practical guidance on setting realistic expectations and preserving mental health. We’ll look at common pitfalls like burnout and perpetual “always learning” pressure, while also highlighting proven strategies for boundary-setting and effective time management. Whether you’re a seasoned data architect, an aspiring machine learning engineer, or somewhere in between, you’ll find actionable tips to help you manage your career trajectory without sacrificing your personal life.

From Research Labs to Real-World Insights: How Academic Researchers Can Thrive in Data Science

Over the past decade, the data science revolution has swept across industries—retailers predicting shopping habits, hospitals personalising patient treatments, and finance companies detecting fraud in near-real time. This surge in data-driven decision-making has created a pressing need for specialists capable of extracting meaningful insights from complex datasets. As a result, PhD holders and academic researchers are uniquely positioned to bring high-calibre analytical skills to the commercial realm. But transitioning from academia to data science can seem daunting: Where do you begin? How do you communicate your research background in industry-friendly terms? What new tools should you learn? This comprehensive guide, explores the paths, challenges, and strategies for academics making the leap into data science. You’ll discover how to leverage your scholarly expertise, adopt a commercial mindset, and build a career that transforms raw data into actionable insights—fostering innovations across every sector of the economy.