Senior Data Engineer

Commify
Nottingham
3 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Location: Nottingham, England, United Kingdom


Employment Type: Contract


Salary: £65,000 – £75,000 per annum


About the Company

Commify is a CPaaS leader with 25 years of experience, enabling businesses worldwide to connect via advanced channels such as SMS, RCS, and complex mobile journeys. Operating across the UK, EMEA, the USA, and Australia, we foster a diverse and connected environment that consistently scores high in employee engagement.


About the Role

We’re looking for a super‑talented, highly experienced Senior Data Engineer to engage with our data engineering initiatives. In this role, you will design and implement robust data architectures and pipelines that help drive data‑driven decision making and collaborate closely with cross‑functional teams to ensure data is accessible, reliable, and valuable.


Key Responsibilities

  • Lead the design, development, and implementation of high‑performance, scalable, and reliable data pipelines and ETL/ELT processes using Azure Data Factory, Databricks, and other Azure data services.
  • Architect and manage data solutions within the Azure ecosystem, including Azure Data Lake Storage, Databricks, Databricks DLT, and streaming and event‑based architectures.
  • Drive the adoption of best practices for data governance, data quality, data security, and data lineage.
  • Collaborate closely with data scientists, analysts, and other engineering teams to understand data requirements and translate them into technical solutions.
  • Optimise data processing performance and cost efficiency on Azure Databricks, leveraging Spark capabilities effectively.
  • Develop and maintain robust monitoring, alerting, and logging for data pipelines.
  • Mentor and provide technical guidance to junior and mid‑level data engineers, fostering a culture of continuous learning and improvement.
  • Evaluate and recommend new data technologies and tools to enhance our data platform capabilities.
  • Contribute to the overall data strategy and roadmap, ensuring alignment with business objectives.
  • Troubleshoot and resolve complex data‑related issues in a timely manner.

What You'll Bring

  • Extensive experience as a Data Engineer, with a significant portion in a principal or lead capacity.
  • Deep expertise in Azure data platform services, including:

    • Azure Databricks (extensive hands‑on experience with Spark, Python/Scala for real‑time data processing).
    • Azure Data Factory (maintaining complex data pipelines).
    • Azure Data Lake Storage.
    • Azure SQL Database and/or Azure Synapse Analytics.

  • Strong proficiency in SQL.
  • Exposure to Infrastructure as Code and CICD deployments.
  • Excellent programming skills in Python (Scala is a strong advantage).
  • Proven experience with data modelling, schema design, and data warehousing concepts.
  • Solid understanding of data governance, data quality, and data security principles.
  • Experience with version control systems (e.g., Git).
  • Strong problem‑solving abilities and a methodical approach to complex technical challenges.
  • Excellent communication and interpersonal skills, with the ability to articulate complex technical concepts to both technical and non‑technical stakeholders.
  • Proven ability to lead and mentor other engineers.

Desirable

  • Experience with real‑time data streaming technologies (e.g., Azure Event Hubs, Kafka).
  • Knowledge of CI/CD pipelines for data solutions.
  • Familiarity with containerisation technologies (e.g., Docker, Kubernetes).
  • Experience with other cloud platforms (AWS, GCP) is a plus.
  • Relevant Microsoft Azure certifications (e.g., Azure Data Engineer Associate).

What We Offer

  • Competitive salary range of £65,000 – £75,000 per annum.
  • Flexible working.
  • Generous paid leave and enhanced family leave.
  • Birthday off – because it’s your day!
  • Mental health support through our wellbeing partner, Calm.
  • Wellbeing leave and a mental health first aider program.
  • Giving back days to help support causes close to your heart.
  • Unlimited professional and personal learning.
  • Total rewards including retirement planning, healthcare, and life assurance.
  • Epic team socials and celebrations.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

Jobs

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

Education

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.