Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

Seargin
Glasgow
1 week ago
Create job alert

Seargin Glasgow, Scotland, United Kingdom


Data Engineer II - Databricks and Python

Employment Type: Full-time, engagement inside IR‑35 through an umbrella company.


Responsibilities

  • Collaborating with cross‑functional teams to understand data requirements and design efficient, scalable, and reliable ETL processes using Python and Databricks.
  • Developing and deploying ETL jobs that extract data from various sources, transforming them to meet business needs.
  • Taking ownership of the end‑to‑end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency.
  • Creating and managing data pipelines, ensuring proper error handling, monitoring and performance optimizations.
  • Working in an agile environment, participating in sprint planning, daily stand‑ups, and retrospectives.
  • Conducting code reviews, providing constructive feedback, and enforcing coding standards to maintain a high quality.
  • Developing and maintaining tooling and automation scripts to streamline repetitive tasks.
  • Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes.
  • Utilizing REST APIs and other integration techniques to connect various data sources.
  • Maintaining documentation, including data flow diagrams, technical specifications, and processes.
  • Designing and implementing tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.
  • Collaborate seamlessly across diverse technical stacks, including Databricks, Snowflake, etc.
  • Developing various components in Python as part of a unified data pipeline framework.
  • Contributing towards the establishment of best practices for the optimal and efficient usage of data across various on‑prem and cloud platforms.
  • Assisting with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling.
  • Monitoring the performance of queries and data loads and performing tuning as necessary.
  • Providing assistance and guidance during QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.
  • Adhering to Agile practices throughout the solution development process.
  • Design, build, and deploy databases and data stores to support organizational requirements.

Qualifications

  • Education: Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
  • 4+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
  • 3+ years hands‑on experience with cloud services, especially Databricks, for building and managing scalable data pipelines.
  • 3+ years proficiency in working with Snowflake or similar cloud‑based data warehousing solutions.
  • 3+ years of experience in data development and solutions in highly complex data environments with large data volumes.
  • Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices – Familiarity with agile methodologies and the ability to work collaboratively in a fast‑paced, dynamic environment.
  • Experience with code versioning tools (e.g., Git).
  • Knowledge of Linux operating systems.
  • Familiarity with REST APIs and integration techniques.
  • Familiarity with data visualization tools and libraries (e.g., Power BI).
  • Background in database administration or performance tuning.
  • Familiarity with data orchestration tools, such as Apache Airflow.
  • Previous exposure to big data technologies (e.g., Hadoop, Spark) for large data processing.
  • Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.
  • Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
  • Self‑starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
  • Strong problem‑solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.

Nice to have

  • Experience in financial services.
  • Knowledge of regulatory requirements in the financial industry.

Seniority level

Mid-Senior level


Employment type

Full-time


Job function

Consulting


Industries

IT Services and IT Consulting


Referrals increase your chances of interviewing at Seargin by 2x


Get notified about new Data Engineer jobs in Glasgow, Scotland, United Kingdom.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK data science hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise rigorous problem framing, high‑quality analytics & modelling, experiment/causality, production awareness (MLOps), governance/ethics, and measurable product or commercial impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for product/data scientists, applied ML scientists, decision scientists, econometricians, growth/marketing analysts, and ML‑adjacent data scientists supporting LLM/AI products. Who this is for: Product/decision/data scientists, applied ML scientists, econometrics & causal inference specialists, experimentation leads, analytics engineers crossing into DS, ML generalists with strong statistics, and data scientists collaborating with platform/MLOps teams in the UK.

Why Data Science Careers in the UK Are Becoming More Multidisciplinary

Data science once meant advanced statistics, machine learning models and coding in Python or R. In the UK today, it has become one of the most in-demand professions across sectors — from healthcare to finance, retail to government. But as the field matures, employers now expect more than technical modelling skills. Modern data science is multidisciplinary. It requires not just coding and algorithms, but also legal knowledge, ethical reasoning, psychological insight, linguistic clarity and human-centred design. Data scientists are expected to interpret, communicate and apply data responsibly, with awareness of law, human behaviour and accessibility. In this article, we’ll explore why data science careers in the UK are becoming more multidisciplinary, how these five disciplines intersect with data science, and what job-seekers & employers need to know to succeed in this transformed field.

Data Science Team Structures Explained: Who Does What in a Modern Data Science Department

Data science is one of the most in-demand, dynamic, and multidisciplinary areas in the UK tech and business landscape. Organisations from finance, retail, health, government, and beyond are using data to drive decisions, automate processes, personalise services, predict trends, detect fraud, and more. To do that well, companies don’t just need good data scientists; they need teams with clearly defined roles, responsibilities, workflows, collaboration, and governance. If you're aiming for a role in data science or recruiting for one, understanding the structure of a data science department—and who does what—can make all the difference. This article breaks down the key roles, how they interact across the lifecycle of a data science project, what skills and qualifications are typical in the UK, expected salary ranges, challenges, trends, and how to build or grow an effective team.