Senior Data Engineer

Digital Skills ltd
Leeds
1 week ago
Create job alert

Lead Data Engineer (AWS)


Permanent - Up to £108,000 per annum plus excellent benefits and pension scheme.

Fully remote working


Digital Skills are working with a growing tech company that builds and provides tools and services to a range of end clients. The company specializes in designing, building and continuously improving data-enabling products within highly governed sectors.


We are currently recruiting for a Data Engineer who will assist in the development of a secure batch/Real Time data platform for a number of clients leveraging the latest commercial and open-source technologies.


This involves getting data from a variety of different sources, getting it into the right format, assuring alignment to target models, and ensuring that data can be made available to downstream consumers.


Responsibilities;

  • Code, test, and document new or modified data pipelines that meet functional/non- functional business requirements
  • Conduct logical and physical database design
  • Expand and grows data platform capabilities to solve new data and analytics problems
  • Conduct data analysis, identifying feasible solutions and enhancements to data processing challenges
  • Ensure that data models are consistent with the data architecture (eg entity names, relationships and definitions)
  • Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement


Qualifications needed;

  • Data pipeline development using data processing technologies and frameworks
  • Agile or other rapid application development methods
  • Datamodelling and understanding of different data structures and their benefits and limitations under particular use cases
  • Experience in Public Cloud services, such as AWS. Practical experience with core services such as EC2, RDS, Lambda, Athena & Glue would be even better!
  • Configuring and tuning Relational and NoSQL databases, including both query processing and query planning, or other data processing infrastructure
  • Programming or Scripting languages, such as Python
  • Exposure to Kafka would be ideal.
  • Test Driven Development with appropriate tools and frameworks


Please don't hesitate to apply if this role seems right for you.

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Data Migration

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Navigating Data Science Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Data science has taken centre stage in the modern workplace. Organisations rely on data-driven insights to shape everything from product innovation and customer experience to operational efficiency and strategic planning. As a result, there is a growing need for skilled data scientists who can analyse large volumes of data, build predictive models, communicate findings effectively, and collaborate cross-functionally. If you are looking to accelerate your data science career—or even land your first role—attending data science career fairs can be a game-changer. Unlike traditional online applications, face-to-face interactions let you showcase your personality, passion, and communication skills in addition to your technical expertise. However, to stand out in a busy environment, you need a clear strategy: from polishing your personal pitch and asking thoughtful questions to following up with a memorable message. In this article, we’ll guide you through every step of making a strong impression at data science career fairs in the UK and beyond.

Common Pitfalls Data Science Job Seekers Face and How to Avoid Them

Data science has become a linchpin for decision-making and innovation across countless industries, from finance and healthcare to tech and retail. The demand for data scientists in the UK continues to climb, with businesses seeking professionals who can interpret complex datasets, build predictive models, and communicate actionable insights. Despite this high demand, the job market can be extremely competitive—and many applicants unknowingly fall into avoidable traps. Whether you’re an aspiring data scientist fresh out of university, a professional transitioning from a quantitative role, or a seasoned analyst looking to expand your skill set, it’s crucial to navigate your job search effectively. In this article, we explore the most common pitfalls data science job seekers face and provide pragmatic advice to help you stand out. By refining your CV, portfolio, interview strategies, and communication skills, you can significantly increase your chances of landing a rewarding data science role. If you’re looking for your next data science job in the UK, don’t forget to explore the listings at Data Science Jobs. Read on to discover how to avoid critical mistakes and position yourself for success.

Career Paths in Data Science: From Entry-Level Analysis to Leadership and Beyond

Data is the lifeblood of modern business, and Data Scientists are the experts who turn raw information into strategic insights. From building recommendation engines to predicting market trends, the impact of data science extends across virtually every industry—finance, healthcare, retail, manufacturing, and beyond. In the UK, data-driven decision-making is critical to remaining competitive in a global market, making data science one of the most sought-after career paths. But how does one launch a career in data science, and how can professionals progress from entry-level analysts to senior leadership roles? In this comprehensive guide, we’ll explore the typical career trajectory, from junior data scientist to chief data officer, discussing the key skills, qualifications, and strategic moves you need to succeed. Whether you’re a recent graduate, transitioning from another technical field, or an experienced data scientist aiming for management, you’ll find actionable insights on forging a successful career in the UK data science sector.