Data Engineer

Haystack
London
1 month ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer - UK Perm - London Hrbrid

Data Engineer, DE55

Data Engineer - Databricks - £60,000

Role Overview

We are looking for aData/BI Engineerto join our technology team and contribute to the development and maintenance of scalable data solutions. This role involves working with structured and unstructured data, integrating new sources, and optimizing data pipelines to support reporting and analytics.

The position focuses onSQL Serveras the primary database technology, with an increasing emphasis oncloud-based services, includingAWS tools such as Athena, Glue, and SageMaker.

This role will play a key part in enabling data-driven decision-making by ensuring efficient data processing and high-quality insights.


Key Responsibilities

  • Collaborate with stakeholders to define and scope data processing requirements.
  • Develop and maintain data pipelines usingSQL, SSIS, AWS Glue, and Athena.
  • Optimize and debugSQL Serverprocedures, functions, and queries for performance and efficiency.
  • Work with internal teams to integrate data from various sources into a centralized data platform.
  • Ensure data quality, consistency, and reliability for business intelligence and analytics.
  • Stay updated on cloud-based data pipeline tools and big data technologies to enhance scalability and performance.


Skills & Experience

Required:

  • Strong proficiency inSQL Server (T-SQL, Query Optimization, Indexing, Partitioning).
  • Experience withSSISfor data integration and ETL processes.
  • Scripting knowledge usingPowerShell.
  • Familiarity withdata modelingand designing efficient database structures.
  • Strong problem-solving and analytical skills.

Preferred:

  • Experience withAWS services(Glue, Lambda, Redshift, Athena).
  • Knowledge ofbig data technologiesand scalable data architectures.
  • Proficiency inPythonfor data processing and automation.


Ideal Candidate Traits

Successful candidates typically:

  • Have a passion for working with data and solving complex challenges.
  • Are curious, detail-oriented, and proactive in optimizing data solutions.
  • Demonstrate strong time management and prioritization skills.
  • Adapt well to changing requirements and business needs.
  • Communicate effectively and collaborate across teams.
  • Take ownership of their work and seek continuous improvement.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

Top 10 Data Science Career Myths Debunked: Key Facts for Aspiring Professionals

Data science has become one of the most sought-after fields in the tech world, promising attractive salaries, cutting-edge projects, and the opportunity to shape decision-making in virtually every industry. From e-commerce recommendation engines to AI-powered medical diagnostics, data scientists are the force behind innovations that drive productivity and improve people’s lives. Yet, despite the demand and glamour often associated with this discipline, data science is also shrouded in misconceptions. Some believe you need a PhD in mathematics or statistics; others assume data science is exclusively about machine learning or coding. At DataScience-Jobs.co.uk, we’ve encountered a wide array of myths that can discourage talented individuals or mislead those exploring a data science career. This article aims to bust the top 10 data science career myths—providing clarity on what data scientists actually do and illuminating the true diversity and inclusiveness of this exciting field. Whether you’re a recent graduate, a professional looking to pivot, or simply curious about data science, read on to discover the reality behind the myths.

Careers

Global vs. Local: Comparing the UK Data Science Job Market to International Landscapes

How to evaluate salaries, opportunities, and work culture in data science across the UK, the US, Europe, and Asia Data science has proven to be more than a passing trend; it is now a foundational pillar of modern decision-making in virtually every industry—from healthcare and finance to retail and entertainment. As the volume of data grows exponentially, organisations urgently need professionals who can transform raw information into actionable insights. This high demand has sparked a wave of new opportunities for data scientists worldwide. In this article, we’ll compare the UK data science job market to those in the United States, Europe, and Asia. We’ll explore hiring trends, salary benchmarks, and cultural nuances to help you decide whether to focus your career locally or consider opportunities overseas or in fully remote roles. Whether you’re a fresh graduate looking for your first data science position, an experienced data professional pivoting from analytics, or a software engineer eager to break into machine learning, understanding the global data science landscape can be a game-changer. By the end of this overview, you’ll be better equipped to navigate the expanding world of data science—knowing which skills and certifications matter most, how salaries differ between regions, and what to expect from distinct work cultures. Let’s dive in.

Careers

Data Science Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Data-Driven Teams

Data science has become a linchpin in modern business, transforming oceans of raw data into actionable insights that guide strategy, product development, and personalised customer experiences. With this surge in data-centric operations, the need for effective data science leadership has never been more critical. Guiding a team of data scientists, analysts, and machine learning engineers requires not only technical acumen but also the ability to foster collaboration, champion ethical practices, and align complex modelling efforts with overarching business goals. This article provides practical guidance for managers and aspiring leaders aiming to excel in data-driven environments. By exploring strategies to motivate data science professionals, develop mentoring frameworks, and set achievable milestones, you will be better prepared to steer your team towards meaningful, evidence-based outcomes.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.